2024-03-31T16:24:19.325 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-31T16:24:19.326 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} --name vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --verbose --archive /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726 -- /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/orig.config.yaml 2024-03-31T16:24:19.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T16:24:19.483 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726 branch: wip-vshankar-testing-20240330.170739 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7631726' kernel: client: sha1: distro flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240330.170739 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240330.170739 sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6891 sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 sleep_before_teardown: 0 subset: 932/1024 suite: fs suite_branch: wip-vshankar-testing-20240330.170739 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhY8US6Ge34UWgaDHj0ZjdR4fCh2E7PyFW209rLTnqcuKDV1IQJV1P84aHVznOmLFCnkOlj8N/0a4djwkNHB1c= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwiwdjjC9aL5fb+iaVZ4hHAo/12NgvfdqjIyaYoTZLH1KH4Sln9iXwd+6AguPT0P8uM4+hZVue+8pZhE1ILMBQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-30_23:12:08 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-31T16:24:19.483 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa; will attempt to use it 2024-03-31T16:24:19.484 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks 2024-03-31T16:24:19.484 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-31T16:24:19.485 INFO:teuthology.task.internal:Checking packages... 2024-03-31T16:24:19.509 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2271579d5e735cfd6d436b8349c004f06527cb0' 2024-03-31T16:24:19.510 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-31T16:24:19.510 INFO:teuthology.packaging:ref: None 2024-03-31T16:24:19.510 INFO:teuthology.packaging:tag: None 2024-03-31T16:24:19.510 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240330.170739 2024-03-31T16:24:19.510 INFO:teuthology.packaging:sha1: d2271579d5e735cfd6d436b8349c004f06527cb0 2024-03-31T16:24:19.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240330.170739 2024-03-31T16:24:19.660 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2574.gd2271579 2024-03-31T16:24:19.663 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-31T16:24:19.670 INFO:teuthology.task.internal:no buildpackages task found 2024-03-31T16:24:19.670 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-31T16:24:19.678 INFO:teuthology.task.internal:Saving configuration 2024-03-31T16:24:19.696 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-31T16:24:19.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-31T16:24:19.726 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 16:19:10.435615', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhY8US6Ge34UWgaDHj0ZjdR4fCh2E7PyFW209rLTnqcuKDV1IQJV1P84aHVznOmLFCnkOlj8N/0a4djwkNHB1c='} 2024-03-31T16:24:19.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 16:19:10.437638', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwiwdjjC9aL5fb+iaVZ4hHAo/12NgvfdqjIyaYoTZLH1KH4Sln9iXwd+6AguPT0P8uM4+hZVue+8pZhE1ILMBQ='} 2024-03-31T16:24:19.745 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-31T16:24:19.751 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-31T16:24:19.751 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-31T16:24:19.751 INFO:teuthology.run_tasks:Running task console_log... 2024-03-31T16:24:19.817 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f816b3fa160>, signals=[15]) 2024-03-31T16:24:19.818 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-31T16:24:19.824 INFO:teuthology.task.internal:Opening connections... 2024-03-31T16:24:19.824 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-03-31T16:24:19.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:24:19.918 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-03-31T16:24:19.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:24:20.007 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-31T16:24:20.013 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-03-31T16:24:20.030 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-03-31T16:24:20.031 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-03-31T16:24:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-03-31T16:24:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-03-31T16:24:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-03-31T16:24:20.086 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T16:24:20.087 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T16:24:20.088 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-03-31T16:24:20.110 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-03-31T16:24:20.127 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-03-31T16:24:20.127 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-03-31T16:24:20.184 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-03-31T16:24:20.185 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T16:24:20.185 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-03-31T16:24:20.185 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T16:24:20.185 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T16:24:20.185 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T16:24:20.185 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-03-31T16:24:20.201 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-31T16:24:20.210 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-31T16:24:20.260 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-31T16:24:20.260 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-03-31T16:24:20.263 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-03-31T16:24:20.280 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-31T16:24:20.326 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-31T16:24:20.327 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-03-31T16:24:20.329 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-03-31T16:24:20.430 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-31T16:24:20.487 INFO:teuthology.run_tasks:Running task kernel... 2024-03-31T16:24:20.503 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-03-31T16:24:20.503 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-03-31T16:24:20.503 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-03-31T16:24:20.503 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-31T16:24:20.504 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-31T16:24:20.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T16:24:20.520 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-03-31T16:24:20.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T16:24:20.521 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-03-31T16:24:20.576 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-361.el9.x86_64 2024-03-31T16:24:20.577 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.14.0-361.el9.x86_64 2024-03-31T16:24:20.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2024-03-31T16:24:20.578 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-361.el9.x86_64 2024-03-31T16:24:20.578 INFO:teuthology.task.kernel:Running kernel on smithi203: 5.14.0-361.el9.x86_64 2024-03-31T16:24:20.578 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum install -y kernel 2024-03-31T16:24:23.128 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS-9 - AppStream 7.2 MB/s | 6.7 MB 00:00 2024-03-31T16:24:23.187 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - AppStream 8.1 MB/s | 6.7 MB 00:00 2024-03-31T16:24:24.595 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.0 MB 00:00 2024-03-31T16:24:24.745 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2024-03-31T16:24:25.778 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-31T16:24:26.003 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.0 MB 00:01 2024-03-31T16:24:27.971 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-03-31T16:24:33.896 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.1 MB 00:02 2024-03-31T16:24:35.347 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-03-31T16:24:37.478 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-03-31T16:24:42.559 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-03-31T16:24:44.824 INFO:teuthology.orchestra.run.smithi203.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-31T16:24:44.824 INFO:teuthology.orchestra.run.smithi203.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-31T16:24:44.930 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-03-31T16:24:44.942 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-03-31T16:24:44.942 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-03-31T16:24:44.942 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-03-31T16:24:44.942 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-03-31T16:24:44.942 INFO:teuthology.orchestra.run.smithi203.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-31T16:24:44.942 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout:Install 4 Packages 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 76 M 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 123 M 2024-03-31T16:24:44.943 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-03-31T16:24:45.093 INFO:teuthology.orchestra.run.smithi203.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-03-31T16:24:45.735 INFO:teuthology.orchestra.run.smithi203.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 19 MB/s | 15 MB 00:00 2024-03-31T16:24:46.635 INFO:teuthology.orchestra.run.smithi203.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 20 MB/s | 34 MB 00:01 2024-03-31T16:24:46.911 INFO:teuthology.orchestra.run.smithi203.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 15 MB/s | 28 MB 00:01 2024-03-31T16:24:46.914 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-03-31T16:24:46.914 INFO:teuthology.orchestra.run.smithi203.stdout:Total 39 MB/s | 76 MB 00:01 2024-03-31T16:24:46.914 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-03-31T16:24:47.321 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-03-31T16:24:47.321 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-03-31T16:24:47.535 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 935 kB/s | 19 MB 00:20 2024-03-31T16:24:48.167 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-03-31T16:24:48.168 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-03-31T16:24:50.470 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-03-31T16:24:51.062 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-31T16:24:51.155 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T16:24:53.937 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T16:24:54.076 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T16:24:58.753 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T16:24:58.793 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 809 kB/s | 6.1 MB 00:07 2024-03-31T16:24:58.884 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:00.336 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-03-31T16:25:01.563 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-03-31T16:25:03.635 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:06.571 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-03-31T16:25:08.845 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-31T16:25:08.845 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-31T16:25:08.937 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-03-31T16:25:08.948 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-03-31T16:25:08.948 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-03-31T16:25:08.948 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-03-31T16:25:08.948 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-03-31T16:25:08.949 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:25:08.950 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 76 M 2024-03-31T16:25:08.950 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 123 M 2024-03-31T16:25:08.950 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-03-31T16:25:09.139 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.0 MB/s | 192 kB 00:00 2024-03-31T16:25:09.898 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 16 MB/s | 15 MB 00:00 2024-03-31T16:25:10.590 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 20 MB/s | 34 MB 00:01 2024-03-31T16:25:11.165 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 14 MB/s | 28 MB 00:02 2024-03-31T16:25:11.168 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-03-31T16:25:11.168 INFO:teuthology.orchestra.run.smithi120.stdout:Total 34 MB/s | 76 MB 00:02 2024-03-31T16:25:11.168 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-03-31T16:25:11.542 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-03-31T16:25:11.542 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-03-31T16:25:12.397 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-03-31T16:25:12.397 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-03-31T16:25:14.708 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-03-31T16:25:15.364 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-31T16:25:15.451 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T16:25:18.225 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T16:25:18.374 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T16:25:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T16:25:23.123 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:33.031 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:33.031 INFO:teuthology.orchestra.run.smithi203.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-31T16:25:33.031 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:25:33.074 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:33.418 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:33.418 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-31T16:25:33.418 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T16:25:33.418 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T16:25:33.830 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:33.830 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:25:33.830 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-03-31T16:25:33.830 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-31T16:25:33.830 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-31T16:25:33.830 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-31T16:25:33.830 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-31T16:25:33.830 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:25:33.831 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-03-31T16:25:34.181 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q kernel | sort -rV | head -n 1 2024-03-31T16:25:34.279 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-31T16:25:34.280 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-31T16:25:34.280 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-31T16:25:34.280 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-31T16:25:34.280 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-31T16:25:34.280 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-03-31T16:25:34.280 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=None, version=distro) 2024-03-31T16:25:34.281 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q kernel | sort -rV | head -n 1 2024-03-31T16:25:34.366 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-31T16:25:34.366 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-31T16:25:34.366 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -qi grub2-tools 2024-03-31T16:25:34.410 INFO:teuthology.orchestra.run.smithi203.stdout:Name : grub2-tools 2024-03-31T16:25:34.410 INFO:teuthology.orchestra.run.smithi203.stdout:Epoch : 1 2024-03-31T16:25:34.410 INFO:teuthology.orchestra.run.smithi203.stdout:Version : 2.06 2024-03-31T16:25:34.410 INFO:teuthology.orchestra.run.smithi203.stdout:Release : 68.el9 2024-03-31T16:25:34.410 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: x86_64 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Group : Unspecified 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Size : 8264254 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:License : GPLv3+ 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Packager : builder@centos.org 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Vendor : CentOS 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Summary : Support tools for GRUB. 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout:Description : 2024-03-31T16:25:34.411 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:25:34.412 INFO:teuthology.orchestra.run.smithi203.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-31T16:25:34.412 INFO:teuthology.orchestra.run.smithi203.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-31T16:25:34.412 INFO:teuthology.orchestra.run.smithi203.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-31T16:25:34.412 INFO:teuthology.orchestra.run.smithi203.stdout:hardware devices. 2024-03-31T16:25:34.412 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:25:34.412 INFO:teuthology.orchestra.run.smithi203.stdout:This subpackage provides tools for support of all platforms. 2024-03-31T16:25:34.413 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-31T16:25:34.413 INFO:teuthology.task.kernel:Updating grub on smithi203 to boot 5.14.0-434.el9.x86_64 2024-03-31T16:25:34.413 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-31T16:25:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-03-31T16:25:36.407 INFO:teuthology.orchestra.run.smithi203.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-31T16:25:36.440 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-03-31T16:25:36.442 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-03-31T16:25:36.457 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.9mvM1kNEXE 2024-03-31T16:25:36.458 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9mvM1kNEXE 2024-03-31T16:25:36.527 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.9mvM1kNEXE 2024-03-31T16:25:36.659 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.9mvM1kNEXE is 6KB 2024-03-31T16:25:36.707 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.9mvM1kNEXE 2024-03-31T16:25:36.722 DEBUG:teuthology.orchestra.run.smithi203:> sudo /bin/ls /boot/loader/entries || true 2024-03-31T16:25:36.787 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-31T16:25:36.788 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-31T16:25:36.788 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-31T16:25:36.788 INFO:teuthology.orchestra.run.smithi203.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-31T16:25:36.789 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-31T16:25:36.954 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-03-31T16:25:57.159 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:57.159 INFO:teuthology.orchestra.run.smithi120.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-31T16:25:57.159 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:25:57.201 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:57.587 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:57.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-31T16:25:57.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-31T16:25:57.587 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-31T16:25:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-31T16:25:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:25:58.022 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-03-31T16:25:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-31T16:25:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-31T16:25:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-31T16:25:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-31T16:25:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:25:58.023 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-03-31T16:25:58.371 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-03-31T16:25:58.511 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-31T16:25:58.511 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-31T16:25:58.511 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-31T16:25:58.511 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-31T16:25:58.511 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-31T16:25:58.511 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-31T16:25:58.511 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-03-31T16:25:58.512 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-03-31T16:25:58.591 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-31T16:25:58.592 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-31T16:25:58.592 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-03-31T16:25:58.634 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-03-31T16:25:58.634 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 68.el9 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8264254 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-31T16:25:58.635 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-31T16:25:58.636 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-03-31T16:25:58.637 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:25:58.637 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-03-31T16:25:58.637 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-31T16:25:58.637 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 5.14.0-434.el9.x86_64 2024-03-31T16:25:58.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-31T16:25:59.261 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-03-31T16:26:00.537 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-31T16:26:00.568 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-03-31T16:26:00.570 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-03-31T16:26:00.585 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.jcybsleXEQ 2024-03-31T16:26:00.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jcybsleXEQ 2024-03-31T16:26:00.653 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.jcybsleXEQ 2024-03-31T16:26:00.797 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.jcybsleXEQ is 6KB 2024-03-31T16:26:00.846 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.jcybsleXEQ 2024-03-31T16:26:00.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-03-31T16:26:00.931 INFO:teuthology.orchestra.run.smithi120.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-31T16:26:00.931 INFO:teuthology.orchestra.run.smithi120.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-31T16:26:00.931 INFO:teuthology.orchestra.run.smithi120.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-31T16:26:00.931 INFO:teuthology.orchestra.run.smithi120.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-31T16:26:00.932 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-31T16:26:01.086 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-03-31T16:26:06.962 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-31T16:26:06.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-31T16:26:06.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:26:31.111 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-31T16:26:31.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-03-31T16:26:31.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:26:41.566 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-03-31T16:26:50.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-31T16:26:50.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:27:31.155 DEBUG:teuthology.orchestra.remote:timed out 2024-03-31T16:27:40.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-03-31T16:27:40.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:27:41.612 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-03-31T16:27:42.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-03-31T16:27:42.148 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-434.el9.x86_64"... 2024-03-31T16:27:42.148 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-03-31T16:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-434.el9.x86_64 2024-03-31T16:27:42.163 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-31T16:27:42.163 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-31T16:27:42.163 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-31T16:27:43.164 DEBUG:teuthology.parallel:result is None 2024-03-31T16:27:50.579 DEBUG:teuthology.orchestra.remote:timed out 2024-03-31T16:28:02.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-31T16:28:02.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:28:02.842 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-03-31T16:28:03.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-31T16:28:03.230 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-434.el9.x86_64"... 2024-03-31T16:28:03.230 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-03-31T16:28:03.246 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-434.el9.x86_64 2024-03-31T16:28:03.246 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-31T16:28:03.246 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-31T16:28:03.247 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-31T16:28:04.248 DEBUG:teuthology.parallel:result is None 2024-03-31T16:28:04.248 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-31T16:28:04.255 INFO:teuthology.task.internal:Creating test directory... 2024-03-31T16:28:04.256 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-31T16:28:04.259 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-31T16:28:04.277 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-31T16:28:04.283 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-31T16:28:04.294 INFO:teuthology.task.internal:Creating archive directory... 2024-03-31T16:28:04.294 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-31T16:28:04.319 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-31T16:28:04.598 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-31T16:28:04.605 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-31T16:28:04.606 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-31T16:28:04.608 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-31T16:28:04.706 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T16:28:04.731 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T16:28:04.739 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T16:28:04.765 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-31T16:28:04.767 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-31T16:28:04.774 INFO:teuthology.task.internal:Configuring sudo... 2024-03-31T16:28:04.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-31T16:28:04.776 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-31T16:28:04.807 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-31T16:28:04.818 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-31T16:28:04.818 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-31T16:28:04.848 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-31T16:28:04.865 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T16:28:04.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T16:28:04.996 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T16:28:05.079 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T16:28:05.123 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:28:05.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-31T16:28:05.191 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T16:28:05.235 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-31T16:28:05.291 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T16:28:05.377 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-31T16:28:05.424 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:28:05.424 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-31T16:28:05.493 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-03-31T16:28:05.496 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-03-31T16:28:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-31T16:28:05.576 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-31T16:28:06.021 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-31T16:28:06.029 INFO:teuthology.task.internal:Starting timer... 2024-03-31T16:28:06.029 INFO:teuthology.run_tasks:Running task pcp... 2024-03-31T16:28:06.091 INFO:teuthology.run_tasks:Running task selinux... 2024-03-31T16:28:06.100 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-31T16:28:06.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-03-31T16:28:06.165 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-03-31T16:28:06.167 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-03-31T16:28:06.223 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-03-31T16:28:06.225 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-31T16:28:06.225 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-03-31T16:28:06.245 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-03-31T16:28:06.246 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-03-31T16:28:06.263 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-03-31T16:28:06.265 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi120.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-03-31T16:28:06.265 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-31T16:28:06.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T16:28:06.314 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-31T16:28:06.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T16:28:06.345 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-31T16:28:06.345 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-03-31T16:28:06.405 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-03-31T16:28:06.440 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-31T16:28:06.450 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-31T16:28:06.467 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-31T16:28:06.470 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-31T16:32:26.705 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-03-31T16:32:26.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-03-31T16:32:26.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:32:26.798 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-03-31T16:32:26.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-03-31T16:32:26.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-31T16:32:26.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T16:32:26.963 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-03-31T16:32:26.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-03-31T16:32:27.000 INFO:teuthology.run_tasks:Running task clock... 2024-03-31T16:32:27.011 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-31T16:32:27.011 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-31T16:32:27.011 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-31T16:32:27.014 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-31T16:32:27.014 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-31T16:32:27.042 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-31T16:32:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-31T16:32:27.070 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-31T16:32:27.087 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-31T16:32:27.088 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-03-31T16:32:27.101 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-03-31T16:32:27.116 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-03-31T16:32:27.117 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-31T16:32:27.129 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-03-31T16:32:27.134 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-31T16:32:27.146 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-31T16:32:27.162 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-31T16:32:27.192 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-03-31T16:32:27.196 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-31T16:32:27.196 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-03-31T16:32:27.196 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T16:32:27.196 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T16:32:27.196 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T16:32:27.196 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T16:32:27.214 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-03-31T16:32:27.218 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-31T16:32:27.218 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-03-31T16:32:27.218 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T16:32:27.218 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T16:32:27.219 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T16:32:27.219 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-31T16:32:27.219 INFO:teuthology.run_tasks:Running task install... 2024-03-31T16:32:27.230 DEBUG:teuthology.task.install:project ceph 2024-03-31T16:32:27.230 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}} 2024-03-31T16:32:27.230 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'} 2024-03-31T16:32:27.230 INFO:teuthology.task.install:Using flavor: default 2024-03-31T16:32:27.236 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-31T16:32:27.236 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-31T16:32:27.237 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'tag': None, 'wait_for_package': False} 2024-03-31T16:32:27.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-03-31T16:32:27.239 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'tag': None, 'wait_for_package': False} 2024-03-31T16:32:27.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-03-31T16:32:27.378 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/ 2024-03-31T16:32:27.378 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2574.gd2271579 2024-03-31T16:32:27.477 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/ 2024-03-31T16:32:27.478 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2574.gd2271579 2024-03-31T16:32:27.484 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-31T16:32:27.484 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:32:27.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-31T16:32:27.511 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-31T16:32:27.511 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2271579d5e735cfd6d436b8349c004f06527cb0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-31T16:32:27.579 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-31T16:32:27.586 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240330.170739/d2271579d5e735cfd6d436b8349c004f06527cb0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-31T16:32:27.586 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:32:27.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-31T16:32:27.614 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-31T16:32:27.614 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d2271579d5e735cfd6d436b8349c004f06527cb0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-31T16:32:27.659 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-31T16:32:27.681 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-31T16:32:27.725 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-03-31T16:32:27.727 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-03-31T16:32:27.761 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-31T16:32:27.828 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-03-31T16:32:27.830 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-03-31T16:32:27.970 INFO:teuthology.orchestra.run.smithi203.stdout:74 files removed 2024-03-31T16:32:27.998 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-31T16:32:28.084 INFO:teuthology.orchestra.run.smithi120.stdout:74 files removed 2024-03-31T16:32:28.111 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-31T16:32:28.660 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 231 kB/s | 83 kB 00:00 2024-03-31T16:32:28.812 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 206 kB/s | 83 kB 00:00 2024-03-31T16:32:29.085 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-03-31T16:32:29.188 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-03-31T16:32:29.402 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 6.7 kB/s | 1.9 kB 00:00 2024-03-31T16:32:29.522 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 6.3 kB/s | 1.9 kB 00:00 2024-03-31T16:32:29.805 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-03-31T16:32:29.957 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-03-31T16:32:31.172 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-03-31T16:32:31.683 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS-9 - BaseOS 3.2 MB/s | 2.0 MB 00:00 2024-03-31T16:32:32.463 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.0 MB 00:00 2024-03-31T16:32:33.273 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.0 MB 00:01 2024-03-31T16:32:35.947 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 19 MB 00:02 2024-03-31T16:32:39.773 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.1 MB 00:00 2024-03-31T16:32:42.207 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-03-31T16:32:43.950 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-31T16:32:48.917 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-31T16:32:51.502 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T16:32:51.502 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T16:32:51.514 INFO:teuthology.orchestra.run.smithi203.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-31T16:32:51.515 INFO:teuthology.orchestra.run.smithi203.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-31T16:32:51.516 INFO:teuthology.orchestra.run.smithi203.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-31T16:32:51.516 INFO:teuthology.orchestra.run.smithi203.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-31T16:32:51.518 INFO:teuthology.orchestra.run.smithi203.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-31T16:32:51.520 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-31T16:32:51.521 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-31T16:32:51.601 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-03-31T16:32:51.614 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================================ 2024-03-31T16:32:51.614 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-03-31T16:32:51.614 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================================ 2024-03-31T16:32:51.614 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:19.0.0-2574.gd2271579.el9 ceph 6.6 k 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.4 M 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 889 k 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2574.gd2271579.el9 ceph 145 k 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.5 M 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 141 k 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 3.5 M 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 7.4 M 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 49 k 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 9.8 M 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:19.0.0-2574.gd2271579.el9 ceph 48 M 2024-03-31T16:32:51.615 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 264 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 762 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 225 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell x86_64 2:19.0.0-2574.gd2271579.el9 ceph 27 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 18 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 32 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 746 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 127 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-31T16:32:51.616 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:19.0.0-2574.gd2271579.el9 ceph 162 k 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:19.0.0-2574.gd2271579.el9 ceph 320 k 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 298 k 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 99 k 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 85 k 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 171 k 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-31T16:32:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.4 M 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-03-31T16:32:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 21 M 2024-03-31T16:32:51.619 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 34 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:19.0.0-2574.gd2271579.el9 ceph 2.4 M 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 249 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:19.0.0-2574.gd2271579.el9 ceph 4.7 M 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 17 M 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 16 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:19.0.0-2574.gd2271579.el9 ceph 25 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-31T16:32:51.620 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:19.0.0-2574.gd2271579.el9 ceph 163 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 501 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.1 M 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-31T16:32:51.621 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-31T16:32:51.622 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 45 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 134 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-31T16:32:51.623 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-31T16:32:51.624 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-31T16:32:51.625 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-31T16:32:51.626 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================================ 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout:Install 150 Packages 2024-03-31T16:32:51.627 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 24 Packages 2024-03-31T16:32:51.628 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:32:51.628 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 226 M 2024-03-31T16:32:51.628 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-03-31T16:32:52.684 INFO:teuthology.orchestra.run.smithi203.stdout:(1/174): ceph-19.0.0-2574.gd2271579.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-03-31T16:32:53.001 INFO:teuthology.orchestra.run.smithi203.stdout:(2/174): ceph-fuse-19.0.0-2574.gd2271579.el9.x8 2.7 MB/s | 889 kB 00:00 2024-03-31T16:32:53.827 INFO:teuthology.orchestra.run.smithi203.stdout:(3/174): ceph-immutable-object-cache-19.0.0-257 175 kB/s | 145 kB 00:00 2024-03-31T16:32:55.152 INFO:teuthology.orchestra.run.smithi203.stdout:(4/174): ceph-base-19.0.0-2574.gd2271579.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-03-31T16:32:55.397 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 920 kB/s | 19 MB 00:21 2024-03-31T16:32:55.727 INFO:teuthology.orchestra.run.smithi203.stdout:(5/174): ceph-mgr-19.0.0-2574.gd2271579.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-03-31T16:32:55.852 INFO:teuthology.orchestra.run.smithi203.stdout:(6/174): ceph-mds-19.0.0-2574.gd2271579.el9.x86 1.2 MB/s | 2.4 MB 00:02 2024-03-31T16:32:56.503 INFO:teuthology.orchestra.run.smithi203.stdout:(7/174): ceph-common-19.0.0-2574.gd2271579.el9. 5.0 MB/s | 21 MB 00:04 2024-03-31T16:32:58.010 INFO:teuthology.orchestra.run.smithi203.stdout:(8/174): ceph-mon-19.0.0-2574.gd2271579.el9.x86 2.1 MB/s | 4.7 MB 00:02 2024-03-31T16:32:58.102 INFO:teuthology.orchestra.run.smithi203.stdout:(9/174): ceph-selinux-19.0.0-2574.gd2271579.el9 275 kB/s | 25 kB 00:00 2024-03-31T16:32:58.628 INFO:teuthology.orchestra.run.smithi203.stdout:(10/174): ceph-radosgw-19.0.0-2574.gd2271579.el 4.6 MB/s | 9.8 MB 00:02 2024-03-31T16:32:58.720 INFO:teuthology.orchestra.run.smithi203.stdout:(11/174): cephfs-mirror-19.0.0-2574.gd2271579.e 2.4 MB/s | 225 kB 00:00 2024-03-31T16:32:58.811 INFO:teuthology.orchestra.run.smithi203.stdout:(12/174): cephfs-shell-19.0.0-2574.gd2271579.el 295 kB/s | 27 kB 00:00 2024-03-31T16:32:58.903 INFO:teuthology.orchestra.run.smithi203.stdout:(13/174): libcephfs-devel-19.0.0-2574.gd2271579 346 kB/s | 32 kB 00:00 2024-03-31T16:32:59.137 INFO:teuthology.orchestra.run.smithi203.stdout:(14/174): libcephfs2-19.0.0-2574.gd2271579.el9. 3.1 MB/s | 746 kB 00:00 2024-03-31T16:32:59.245 INFO:teuthology.orchestra.run.smithi203.stdout:(15/174): libcephsqlite-19.0.0-2574.gd2271579.e 1.5 MB/s | 163 kB 00:00 2024-03-31T16:32:59.354 INFO:teuthology.orchestra.run.smithi203.stdout:(16/174): librados-devel-19.0.0-2574.gd2271579. 1.1 MB/s | 127 kB 00:00 2024-03-31T16:32:59.512 INFO:teuthology.orchestra.run.smithi203.stdout:(17/174): libradosstriper1-19.0.0-2574.gd227157 3.1 MB/s | 501 kB 00:00 2024-03-31T16:33:00.056 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.1 MB 00:01 2024-03-31T16:33:00.846 INFO:teuthology.orchestra.run.smithi203.stdout:(18/174): librgw2-19.0.0-2574.gd2271579.el9.x86 3.9 MB/s | 5.1 MB 00:01 2024-03-31T16:33:00.888 INFO:teuthology.orchestra.run.smithi203.stdout:(19/174): python3-ceph-argparse-19.0.0-2574.gd2 1.1 MB/s | 45 kB 00:00 2024-03-31T16:33:00.946 INFO:teuthology.orchestra.run.smithi203.stdout:(20/174): python3-ceph-common-19.0.0-2574.gd227 2.3 MB/s | 134 kB 00:00 2024-03-31T16:33:01.005 INFO:teuthology.orchestra.run.smithi203.stdout:(21/174): python3-cephfs-19.0.0-2574.gd2271579. 2.7 MB/s | 162 kB 00:00 2024-03-31T16:33:01.080 INFO:teuthology.orchestra.run.smithi203.stdout:(22/174): python3-rados-19.0.0-2574.gd2271579.e 4.2 MB/s | 320 kB 00:00 2024-03-31T16:33:01.139 INFO:teuthology.orchestra.run.smithi203.stdout:(23/174): python3-rbd-19.0.0-2574.gd2271579.el9 5.0 MB/s | 298 kB 00:00 2024-03-31T16:33:01.189 INFO:teuthology.orchestra.run.smithi203.stdout:(24/174): python3-rgw-19.0.0-2574.gd2271579.el9 2.0 MB/s | 99 kB 00:00 2024-03-31T16:33:01.240 INFO:teuthology.orchestra.run.smithi203.stdout:(25/174): rbd-fuse-19.0.0-2574.gd2271579.el9.x8 1.7 MB/s | 85 kB 00:00 2024-03-31T16:33:01.523 INFO:teuthology.orchestra.run.smithi203.stdout:(26/174): rbd-mirror-19.0.0-2574.gd2271579.el9. 11 MB/s | 3.1 MB 00:00 2024-03-31T16:33:01.573 INFO:teuthology.orchestra.run.smithi203.stdout:(27/174): rbd-nbd-19.0.0-2574.gd2271579.el9.x86 3.4 MB/s | 171 kB 00:00 2024-03-31T16:33:01.616 INFO:teuthology.orchestra.run.smithi203.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2574.g 810 kB/s | 34 kB 00:00 2024-03-31T16:33:01.639 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 16 kB 00:00 2024-03-31T16:33:01.666 INFO:teuthology.orchestra.run.smithi203.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2574.gd227157 2.8 MB/s | 141 kB 00:00 2024-03-31T16:33:01.975 INFO:teuthology.orchestra.run.smithi203.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2574.gd2271 11 MB/s | 3.5 MB 00:00 2024-03-31T16:33:02.600 INFO:teuthology.orchestra.run.smithi203.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-03-31T16:33:02.650 INFO:teuthology.orchestra.run.smithi203.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2574.gd2 4.9 MB/s | 249 kB 00:00 2024-03-31T16:33:02.692 INFO:teuthology.orchestra.run.smithi203.stdout:(33/174): ceph-mgr-rook-19.0.0-2574.gd2271579.e 1.2 MB/s | 49 kB 00:00 2024-03-31T16:33:02.734 INFO:teuthology.orchestra.run.smithi203.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2574.gd 395 kB/s | 16 kB 00:00 2024-03-31T16:33:02.766 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:00 2024-03-31T16:33:02.792 INFO:teuthology.orchestra.run.smithi203.stdout:(35/174): ceph-volume-19.0.0-2574.gd2271579.el9 4.4 MB/s | 264 kB 00:00 2024-03-31T16:33:02.901 INFO:teuthology.orchestra.run.smithi203.stdout:(36/174): cephadm-19.0.0-2574.gd2271579.el9.noa 6.9 MB/s | 762 kB 00:00 2024-03-31T16:33:02.951 INFO:teuthology.orchestra.run.smithi203.stdout:(37/174): cephfs-top-19.0.0-2574.gd2271579.el9. 365 kB/s | 18 kB 00:00 2024-03-31T16:33:03.102 INFO:teuthology.orchestra.run.smithi203.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 662 kB 00:00 2024-03-31T16:33:03.160 INFO:teuthology.orchestra.run.smithi203.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-03-31T16:33:03.194 INFO:teuthology.orchestra.run.smithi203.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-03-31T16:33:03.236 INFO:teuthology.orchestra.run.smithi203.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-03-31T16:33:03.394 INFO:teuthology.orchestra.run.smithi203.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 200 kB/s | 32 kB 00:00 2024-03-31T16:33:03.487 INFO:teuthology.orchestra.run.smithi203.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-03-31T16:33:03.520 INFO:teuthology.orchestra.run.smithi203.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 516 kB/s | 17 kB 00:00 2024-03-31T16:33:03.554 INFO:teuthology.orchestra.run.smithi203.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 302 kB/s | 10 kB 00:00 2024-03-31T16:33:03.587 INFO:teuthology.orchestra.run.smithi203.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-03-31T16:33:03.613 INFO:teuthology.orchestra.run.smithi203.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2024-03-31T16:33:03.655 INFO:teuthology.orchestra.run.smithi203.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2024-03-31T16:33:03.696 INFO:teuthology.orchestra.run.smithi203.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-03-31T16:33:03.722 INFO:teuthology.orchestra.run.smithi203.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2024-03-31T16:33:03.764 INFO:teuthology.orchestra.run.smithi203.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-03-31T16:33:03.806 INFO:teuthology.orchestra.run.smithi203.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-03-31T16:33:03.840 INFO:teuthology.orchestra.run.smithi203.stdout:(53/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2024-03-31T16:33:04.015 INFO:teuthology.orchestra.run.smithi203.stdout:(54/174): ceph-osd-19.0.0-2574.gd2271579.el9.x8 2.1 MB/s | 17 MB 00:08 2024-03-31T16:33:04.031 INFO:teuthology.orchestra.run.smithi203.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 178 kB/s | 34 kB 00:00 2024-03-31T16:33:04.157 INFO:teuthology.orchestra.run.smithi203.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2024-03-31T16:33:04.208 INFO:teuthology.orchestra.run.smithi203.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 8.7 MB/s | 1.5 MB 00:00 2024-03-31T16:33:04.249 INFO:teuthology.orchestra.run.smithi203.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 8.8 MB/s | 817 kB 00:00 2024-03-31T16:33:04.274 INFO:teuthology.orchestra.run.smithi203.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 132 kB 00:00 2024-03-31T16:33:04.392 INFO:teuthology.orchestra.run.smithi203.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-03-31T16:33:04.425 INFO:teuthology.orchestra.run.smithi203.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-03-31T16:33:04.450 INFO:teuthology.orchestra.run.smithi203.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-31T16:33:04.567 INFO:teuthology.orchestra.run.smithi203.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2024-03-31T16:33:04.609 INFO:teuthology.orchestra.run.smithi203.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 157 kB/s | 24 kB 00:00 2024-03-31T16:33:04.634 INFO:teuthology.orchestra.run.smithi203.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 271 kB/s | 18 kB 00:00 2024-03-31T16:33:04.660 INFO:teuthology.orchestra.run.smithi203.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-31T16:33:04.685 INFO:teuthology.orchestra.run.smithi203.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2024-03-31T16:33:04.785 INFO:teuthology.orchestra.run.smithi203.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-03-31T16:33:04.811 INFO:teuthology.orchestra.run.smithi203.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2024-03-31T16:33:04.836 INFO:teuthology.orchestra.run.smithi203.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-31T16:33:04.861 INFO:teuthology.orchestra.run.smithi203.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-31T16:33:04.886 INFO:teuthology.orchestra.run.smithi203.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 825 kB/s | 41 kB 00:00 2024-03-31T16:33:04.914 INFO:teuthology.orchestra.run.smithi203.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-03-31T16:33:04.937 INFO:teuthology.orchestra.run.smithi203.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-31T16:33:04.962 INFO:teuthology.orchestra.run.smithi203.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-31T16:33:04.979 INFO:teuthology.orchestra.run.smithi203.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-31T16:33:04.996 INFO:teuthology.orchestra.run.smithi203.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 43 kB 00:00 2024-03-31T16:33:05.063 INFO:teuthology.orchestra.run.smithi203.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 591 kB/s | 39 kB 00:00 2024-03-31T16:33:05.297 INFO:teuthology.orchestra.run.smithi203.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-03-31T16:33:05.314 INFO:teuthology.orchestra.run.smithi203.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 165 kB/s | 41 kB 00:00 2024-03-31T16:33:05.339 INFO:teuthology.orchestra.run.smithi203.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2024-03-31T16:33:05.356 INFO:teuthology.orchestra.run.smithi203.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 838 kB/s | 35 kB 00:00 2024-03-31T16:33:05.373 INFO:teuthology.orchestra.run.smithi203.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-03-31T16:33:05.398 INFO:teuthology.orchestra.run.smithi203.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-03-31T16:33:05.415 INFO:teuthology.orchestra.run.smithi203.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-03-31T16:33:05.441 INFO:teuthology.orchestra.run.smithi203.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-03-31T16:33:05.457 INFO:teuthology.orchestra.run.smithi203.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-31T16:33:05.483 INFO:teuthology.orchestra.run.smithi203.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-03-31T16:33:05.508 INFO:teuthology.orchestra.run.smithi203.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-31T16:33:05.542 INFO:teuthology.orchestra.run.smithi203.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-31T16:33:05.567 INFO:teuthology.orchestra.run.smithi203.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-31T16:33:05.592 INFO:teuthology.orchestra.run.smithi203.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-31T16:33:05.618 INFO:teuthology.orchestra.run.smithi203.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2024-03-31T16:33:05.910 INFO:teuthology.orchestra.run.smithi203.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 591 kB/s | 187 kB 00:00 2024-03-31T16:33:05.943 INFO:teuthology.orchestra.run.smithi203.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-03-31T16:33:05.993 INFO:teuthology.orchestra.run.smithi203.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-03-31T16:33:06.019 INFO:teuthology.orchestra.run.smithi203.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-03-31T16:33:06.077 INFO:teuthology.orchestra.run.smithi203.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 258 kB/s | 21 kB 00:00 2024-03-31T16:33:06.094 INFO:teuthology.orchestra.run.smithi203.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 339 kB/s | 25 kB 00:00 2024-03-31T16:33:06.537 INFO:teuthology.orchestra.run.smithi203.stdout:(100/174): ceph-test-19.0.0-2574.gd2271579.el9. 5.7 MB/s | 48 MB 00:08 2024-03-31T16:33:06.620 INFO:teuthology.orchestra.run.smithi203.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 467 kB/s | 245 kB 00:00 2024-03-31T16:33:06.662 INFO:teuthology.orchestra.run.smithi203.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-03-31T16:33:06.704 INFO:teuthology.orchestra.run.smithi203.stdout:(103/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.5 MB/s | 248 kB 00:00 2024-03-31T16:33:06.771 INFO:teuthology.orchestra.run.smithi203.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 6.0 MB/s | 4.1 MB 00:00 2024-03-31T16:33:06.796 INFO:teuthology.orchestra.run.smithi203.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-03-31T16:33:06.930 INFO:teuthology.orchestra.run.smithi203.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-03-31T16:33:07.063 INFO:teuthology.orchestra.run.smithi203.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 146 kB/s | 19 kB 00:00 2024-03-31T16:33:07.088 INFO:teuthology.orchestra.run.smithi203.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-03-31T16:33:07.130 INFO:teuthology.orchestra.run.smithi203.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-03-31T16:33:07.189 INFO:teuthology.orchestra.run.smithi203.stdout:(110/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.3 MB/s | 548 kB 00:00 2024-03-31T16:33:07.214 INFO:teuthology.orchestra.run.smithi203.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-03-31T16:33:07.248 INFO:teuthology.orchestra.run.smithi203.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-03-31T16:33:07.306 INFO:teuthology.orchestra.run.smithi203.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-03-31T16:33:07.549 INFO:teuthology.orchestra.run.smithi203.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-03-31T16:33:07.590 INFO:teuthology.orchestra.run.smithi203.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-03-31T16:33:07.632 INFO:teuthology.orchestra.run.smithi203.stdout:(116/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.1 MB/s | 838 kB 00:00 2024-03-31T16:33:07.649 INFO:teuthology.orchestra.run.smithi203.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-03-31T16:33:07.666 INFO:teuthology.orchestra.run.smithi203.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 447 kB/s | 15 kB 00:00 2024-03-31T16:33:07.733 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-03-31T16:33:07.750 INFO:teuthology.orchestra.run.smithi203.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-03-31T16:33:07.859 INFO:teuthology.orchestra.run.smithi203.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2024-03-31T16:33:07.909 INFO:teuthology.orchestra.run.smithi203.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-03-31T16:33:07.926 INFO:teuthology.orchestra.run.smithi203.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 529 kB/s | 35 kB 00:00 2024-03-31T16:33:08.001 INFO:teuthology.orchestra.run.smithi203.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-03-31T16:33:08.076 INFO:teuthology.orchestra.run.smithi203.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-03-31T16:33:08.110 INFO:teuthology.orchestra.run.smithi203.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 322 kB/s | 11 kB 00:00 2024-03-31T16:33:08.143 INFO:teuthology.orchestra.run.smithi203.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 535 kB/s | 18 kB 00:00 2024-03-31T16:33:08.177 INFO:teuthology.orchestra.run.smithi203.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 697 kB/s | 23 kB 00:00 2024-03-31T16:33:08.211 INFO:teuthology.orchestra.run.smithi203.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 584 kB/s | 19 kB 00:00 2024-03-31T16:33:08.244 INFO:teuthology.orchestra.run.smithi203.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 593 kB/s | 20 kB 00:00 2024-03-31T16:33:08.620 INFO:teuthology.orchestra.run.smithi203.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 2.7 MB/s | 1.0 MB 00:00 2024-03-31T16:33:08.653 INFO:teuthology.orchestra.run.smithi203.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-03-31T16:33:08.729 INFO:teuthology.orchestra.run.smithi203.stdout:(132/174): python3-grpcio-1.46.7-10.el9.x86_64. 2.5 MB/s | 2.0 MB 00:00 2024-03-31T16:33:08.754 INFO:teuthology.orchestra.run.smithi203.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 785 kB/s | 79 kB 00:00 2024-03-31T16:33:08.812 INFO:teuthology.orchestra.run.smithi203.stdout:(134/174): libarrow-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-03-31T16:33:08.829 INFO:teuthology.orchestra.run.smithi203.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-03-31T16:33:08.855 INFO:teuthology.orchestra.run.smithi203.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 392 kB/s | 16 kB 00:00 2024-03-31T16:33:08.897 INFO:teuthology.orchestra.run.smithi203.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-03-31T16:33:08.913 INFO:teuthology.orchestra.run.smithi203.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 484 kB/s | 28 kB 00:00 2024-03-31T16:33:08.947 INFO:teuthology.orchestra.run.smithi203.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 932 kB/s | 31 kB 00:00 2024-03-31T16:33:08.989 INFO:teuthology.orchestra.run.smithi203.stdout:(140/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-03-31T16:33:09.014 INFO:teuthology.orchestra.run.smithi203.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-03-31T16:33:09.040 INFO:teuthology.orchestra.run.smithi203.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 643 kB/s | 59 kB 00:00 2024-03-31T16:33:09.056 INFO:teuthology.orchestra.run.smithi203.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-03-31T16:33:09.073 INFO:teuthology.orchestra.run.smithi203.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 870 kB/s | 51 kB 00:00 2024-03-31T16:33:09.116 INFO:teuthology.orchestra.run.smithi203.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-03-31T16:33:09.157 INFO:teuthology.orchestra.run.smithi203.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 481 kB/s | 20 kB 00:00 2024-03-31T16:33:09.216 INFO:teuthology.orchestra.run.smithi203.stdout:(147/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-03-31T16:33:09.258 INFO:teuthology.orchestra.run.smithi203.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-03-31T16:33:09.283 INFO:teuthology.orchestra.run.smithi203.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.0 MB/s | 427 kB 00:00 2024-03-31T16:33:10.025 INFO:teuthology.orchestra.run.smithi203.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-03-31T16:33:10.175 INFO:teuthology.orchestra.run.smithi203.stdout:(151/174): librados2-19.0.0-2574.gd2271579.el9. 3.7 MB/s | 3.4 MB 00:00 2024-03-31T16:33:10.242 INFO:teuthology.orchestra.run.smithi203.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-03-31T16:33:10.284 INFO:teuthology.orchestra.run.smithi203.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-03-31T16:33:10.309 INFO:teuthology.orchestra.run.smithi203.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 643 kB/s | 41 kB 00:00 2024-03-31T16:33:10.325 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T16:33:10.326 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-31T16:33:10.335 INFO:teuthology.orchestra.run.smithi203.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 4.8 MB/s | 247 kB 00:00 2024-03-31T16:33:10.338 INFO:teuthology.orchestra.run.smithi120.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-31T16:33:10.338 INFO:teuthology.orchestra.run.smithi120.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-31T16:33:10.339 INFO:teuthology.orchestra.run.smithi120.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-31T16:33:10.340 INFO:teuthology.orchestra.run.smithi120.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-31T16:33:10.342 INFO:teuthology.orchestra.run.smithi120.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-31T16:33:10.344 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-31T16:33:10.345 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-31T16:33:10.360 INFO:teuthology.orchestra.run.smithi203.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-03-31T16:33:10.424 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-03-31T16:33:10.436 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================================ 2024-03-31T16:33:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-03-31T16:33:10.436 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================================ 2024-03-31T16:33:10.436 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-03-31T16:33:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-31T16:33:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:19.0.0-2574.gd2271579.el9 ceph 6.6 k 2024-03-31T16:33:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.4 M 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 889 k 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2574.gd2271579.el9 ceph 145 k 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:19.0.0-2574.gd2271579.el9 ceph 1.5 M 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 141 k 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 3.5 M 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 7.4 M 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 49 k 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 9.8 M 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:19.0.0-2574.gd2271579.el9 ceph 48 M 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 264 k 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 762 k 2024-03-31T16:33:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 225 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell x86_64 2:19.0.0-2574.gd2271579.el9 ceph 27 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 18 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 32 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 746 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:19.0.0-2574.gd2271579.el9 ceph 127 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-31T16:33:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:19.0.0-2574.gd2271579.el9 ceph 162 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:19.0.0-2574.gd2271579.el9 ceph 320 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 298 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:19.0.0-2574.gd2271579.el9 ceph 99 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 85 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 171 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-31T16:33:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.4 M 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 3.1 M 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-31T16:33:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 21 M 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 34 k 2024-03-31T16:33:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:19.0.0-2574.gd2271579.el9 ceph 2.4 M 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 249 k 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:19.0.0-2574.gd2271579.el9 ceph 4.7 M 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:19.0.0-2574.gd2271579.el9 ceph 17 M 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2574.gd2271579.el9 ceph-noarch 16 k 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:19.0.0-2574.gd2271579.el9 ceph 25 k 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-31T16:33:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:19.0.0-2574.gd2271579.el9 ceph 163 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 501 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:19.0.0-2574.gd2271579.el9 ceph 5.1 M 2024-03-31T16:33:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-31T16:33:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:19.0.0-2574.gd2271579.el9 ceph 45 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:19.0.0-2574.gd2271579.el9 ceph 134 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-31T16:33:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-31T16:33:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-31T16:33:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-31T16:33:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-31T16:33:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================================ 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout:Install 150 Packages 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 24 Packages 2024-03-31T16:33:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:33:10.451 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 226 M 2024-03-31T16:33:10.451 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-03-31T16:33:10.535 INFO:teuthology.orchestra.run.smithi203.stdout:(157/174): librbd1-19.0.0-2574.gd2271579.el9.x8 2.5 MB/s | 3.1 MB 00:01 2024-03-31T16:33:10.577 INFO:teuthology.orchestra.run.smithi203.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 168 kB/s | 36 kB 00:00 2024-03-31T16:33:10.602 INFO:teuthology.orchestra.run.smithi203.stdout:(159/174): acl-2.3.1-4.el9.x86_64.rpm 267 kB/s | 71 kB 00:00 2024-03-31T16:33:10.686 INFO:teuthology.orchestra.run.smithi203.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.3 MB/s | 192 kB 00:00 2024-03-31T16:33:10.711 INFO:teuthology.orchestra.run.smithi203.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-03-31T16:33:10.736 INFO:teuthology.orchestra.run.smithi203.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 172 kB/s | 23 kB 00:00 2024-03-31T16:33:10.762 INFO:teuthology.orchestra.run.smithi203.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-03-31T16:33:10.787 INFO:teuthology.orchestra.run.smithi203.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-03-31T16:33:10.812 INFO:teuthology.orchestra.run.smithi203.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-03-31T16:33:10.829 INFO:teuthology.orchestra.run.smithi203.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 951 kB/s | 64 kB 00:00 2024-03-31T16:33:10.846 INFO:teuthology.orchestra.run.smithi203.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 489 kB/s | 29 kB 00:00 2024-03-31T16:33:10.913 INFO:teuthology.orchestra.run.smithi203.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2024-03-31T16:33:10.963 INFO:teuthology.orchestra.run.smithi203.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 16 MB/s | 2.2 MB 00:00 2024-03-31T16:33:11.014 INFO:teuthology.orchestra.run.smithi203.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 4.5 MB/s | 465 kB 00:00 2024-03-31T16:33:11.030 INFO:teuthology.orchestra.run.smithi203.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 465 kB/s | 31 kB 00:00 2024-03-31T16:33:11.097 INFO:teuthology.orchestra.run.smithi203.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 9.1 MB/s | 2.3 MB 00:00 2024-03-31T16:33:11.139 INFO:teuthology.orchestra.run.smithi203.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 8.6 MB/s | 1.1 MB 00:00 2024-03-31T16:33:11.164 INFO:teuthology.orchestra.run.smithi203.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 556 kB/s | 74 kB 00:00 2024-03-31T16:33:11.172 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-03-31T16:33:11.172 INFO:teuthology.orchestra.run.smithi203.stdout:Total 12 MB/s | 226 MB 00:19 2024-03-31T16:33:11.176 INFO:teuthology.orchestra.run.smithi120.stdout:(1/174): ceph-19.0.0-2574.gd2271579.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-03-31T16:33:11.535 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-03-31T16:33:11.651 INFO:teuthology.orchestra.run.smithi120.stdout:(2/174): ceph-fuse-19.0.0-2574.gd2271579.el9.x8 1.8 MB/s | 889 kB 00:00 2024-03-31T16:33:11.801 INFO:teuthology.orchestra.run.smithi120.stdout:(3/174): ceph-immutable-object-cache-19.0.0-257 966 kB/s | 145 kB 00:00 2024-03-31T16:33:11.809 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-03-31T16:33:11.809 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-03-31T16:33:13.251 INFO:teuthology.orchestra.run.smithi120.stdout:(4/174): ceph-mds-19.0.0-2574.gd2271579.el9.x86 1.6 MB/s | 2.4 MB 00:01 2024-03-31T16:33:13.693 INFO:teuthology.orchestra.run.smithi120.stdout:(5/174): ceph-base-19.0.0-2574.gd2271579.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-03-31T16:33:13.793 INFO:teuthology.orchestra.run.smithi120.stdout:(6/174): ceph-mgr-19.0.0-2574.gd2271579.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-03-31T16:33:13.963 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-03-31T16:33:13.964 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-03-31T16:33:14.310 INFO:teuthology.orchestra.run.smithi120.stdout:(7/174): ceph-common-19.0.0-2574.gd2271579.el9. 6.1 MB/s | 21 MB 00:03 2024-03-31T16:33:14.769 INFO:teuthology.orchestra.run.smithi120.stdout:(8/174): ceph-mon-19.0.0-2574.gd2271579.el9.x86 4.4 MB/s | 4.7 MB 00:01 2024-03-31T16:33:14.869 INFO:teuthology.orchestra.run.smithi120.stdout:(9/174): ceph-selinux-19.0.0-2574.gd2271579.el9 251 kB/s | 25 kB 00:00 2024-03-31T16:33:15.736 INFO:teuthology.orchestra.run.smithi120.stdout:(10/174): ceph-radosgw-19.0.0-2574.gd2271579.el 6.9 MB/s | 9.8 MB 00:01 2024-03-31T16:33:15.844 INFO:teuthology.orchestra.run.smithi120.stdout:(11/174): cephfs-mirror-19.0.0-2574.gd2271579.e 2.0 MB/s | 225 kB 00:00 2024-03-31T16:33:15.945 INFO:teuthology.orchestra.run.smithi120.stdout:(12/174): cephfs-shell-19.0.0-2574.gd2271579.el 270 kB/s | 27 kB 00:00 2024-03-31T16:33:16.037 INFO:teuthology.orchestra.run.smithi120.stdout:(13/174): libcephfs-devel-19.0.0-2574.gd2271579 346 kB/s | 32 kB 00:00 2024-03-31T16:33:16.237 INFO:teuthology.orchestra.run.smithi120.stdout:(14/174): libcephfs2-19.0.0-2574.gd2271579.el9. 3.6 MB/s | 746 kB 00:00 2024-03-31T16:33:16.345 INFO:teuthology.orchestra.run.smithi120.stdout:(15/174): libcephsqlite-19.0.0-2574.gd2271579.e 1.5 MB/s | 163 kB 00:00 2024-03-31T16:33:16.463 INFO:teuthology.orchestra.run.smithi120.stdout:(16/174): librados-devel-19.0.0-2574.gd2271579. 1.1 MB/s | 127 kB 00:00 2024-03-31T16:33:16.604 INFO:teuthology.orchestra.run.smithi120.stdout:(17/174): libradosstriper1-19.0.0-2574.gd227157 3.5 MB/s | 501 kB 00:00 2024-03-31T16:33:17.313 INFO:teuthology.orchestra.run.smithi120.stdout:(18/174): librgw2-19.0.0-2574.gd2271579.el9.x86 7.3 MB/s | 5.1 MB 00:00 2024-03-31T16:33:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:(19/174): python3-ceph-argparse-19.0.0-2574.gd2 417 kB/s | 45 kB 00:00 2024-03-31T16:33:17.530 INFO:teuthology.orchestra.run.smithi120.stdout:(20/174): python3-ceph-common-19.0.0-2574.gd227 1.2 MB/s | 134 kB 00:00 2024-03-31T16:33:17.639 INFO:teuthology.orchestra.run.smithi120.stdout:(21/174): python3-cephfs-19.0.0-2574.gd2271579. 1.5 MB/s | 162 kB 00:00 2024-03-31T16:33:17.739 INFO:teuthology.orchestra.run.smithi120.stdout:(22/174): python3-rados-19.0.0-2574.gd2271579.e 3.1 MB/s | 320 kB 00:00 2024-03-31T16:33:17.856 INFO:teuthology.orchestra.run.smithi120.stdout:(23/174): python3-rbd-19.0.0-2574.gd2271579.el9 2.5 MB/s | 298 kB 00:00 2024-03-31T16:33:17.964 INFO:teuthology.orchestra.run.smithi120.stdout:(24/174): python3-rgw-19.0.0-2574.gd2271579.el9 918 kB/s | 99 kB 00:00 2024-03-31T16:33:18.081 INFO:teuthology.orchestra.run.smithi120.stdout:(25/174): rbd-fuse-19.0.0-2574.gd2271579.el9.x8 732 kB/s | 85 kB 00:00 2024-03-31T16:33:18.515 INFO:teuthology.orchestra.run.smithi120.stdout:(26/174): rbd-mirror-19.0.0-2574.gd2271579.el9. 7.1 MB/s | 3.1 MB 00:00 2024-03-31T16:33:18.624 INFO:teuthology.orchestra.run.smithi120.stdout:(27/174): rbd-nbd-19.0.0-2574.gd2271579.el9.x86 1.5 MB/s | 171 kB 00:00 2024-03-31T16:33:18.732 INFO:teuthology.orchestra.run.smithi120.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2574.g 314 kB/s | 34 kB 00:00 2024-03-31T16:33:18.849 INFO:teuthology.orchestra.run.smithi120.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2574.gd227157 1.2 MB/s | 141 kB 00:00 2024-03-31T16:33:19.341 INFO:teuthology.orchestra.run.smithi120.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2574.gd2271 7.2 MB/s | 3.5 MB 00:00 2024-03-31T16:33:20.583 INFO:teuthology.orchestra.run.smithi120.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 5.9 MB/s | 7.4 MB 00:01 2024-03-31T16:33:20.808 INFO:teuthology.orchestra.run.smithi120.stdout:(32/174): ceph-osd-19.0.0-2574.gd2271579.el9.x8 2.4 MB/s | 17 MB 00:07 2024-03-31T16:33:20.842 INFO:teuthology.orchestra.run.smithi120.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2574.gd2 963 kB/s | 249 kB 00:00 2024-03-31T16:33:20.909 INFO:teuthology.orchestra.run.smithi120.stdout:(34/174): ceph-mgr-rook-19.0.0-2574.gd2271579.e 493 kB/s | 49 kB 00:00 2024-03-31T16:33:20.915 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-03-31T16:33:20.942 INFO:teuthology.orchestra.run.smithi120.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2574.gd 164 kB/s | 16 kB 00:00 2024-03-31T16:33:21.003 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-31T16:33:21.045 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-31T16:33:21.076 INFO:teuthology.orchestra.run.smithi120.stdout:(36/174): ceph-volume-19.0.0-2574.gd2271579.el9 1.5 MB/s | 264 kB 00:00 2024-03-31T16:33:21.083 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T16:33:21.092 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T16:33:21.133 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-31T16:33:21.143 INFO:teuthology.orchestra.run.smithi120.stdout:(37/174): cephadm-19.0.0-2574.gd2271579.el9.noa 3.7 MB/s | 762 kB 00:00 2024-03-31T16:33:21.160 INFO:teuthology.orchestra.run.smithi120.stdout:(38/174): cephfs-top-19.0.0-2574.gd2271579.el9. 218 kB/s | 18 kB 00:00 2024-03-31T16:33:21.190 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-31T16:33:21.225 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-31T16:33:21.259 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-31T16:33:21.310 INFO:teuthology.orchestra.run.smithi120.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 662 kB 00:00 2024-03-31T16:33:21.360 INFO:teuthology.orchestra.run.smithi120.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 920 kB 00:00 2024-03-31T16:33:21.386 INFO:teuthology.orchestra.run.smithi120.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-03-31T16:33:21.411 INFO:teuthology.orchestra.run.smithi120.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-31T16:33:21.436 INFO:teuthology.orchestra.run.smithi120.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 634 kB/s | 32 kB 00:00 2024-03-31T16:33:21.464 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-31T16:33:21.512 INFO:teuthology.orchestra.run.smithi120.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-03-31T16:33:21.537 INFO:teuthology.orchestra.run.smithi120.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 174 kB/s | 17 kB 00:00 2024-03-31T16:33:21.562 INFO:teuthology.orchestra.run.smithi120.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 200 kB/s | 10 kB 00:00 2024-03-31T16:33:21.596 INFO:teuthology.orchestra.run.smithi120.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-31T16:33:21.621 INFO:teuthology.orchestra.run.smithi120.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 759 kB/s | 44 kB 00:00 2024-03-31T16:33:21.655 INFO:teuthology.orchestra.run.smithi120.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-31T16:33:21.688 INFO:teuthology.orchestra.run.smithi120.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2024-03-31T16:33:21.714 INFO:teuthology.orchestra.run.smithi120.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 806 kB/s | 46 kB 00:00 2024-03-31T16:33:21.739 INFO:teuthology.orchestra.run.smithi120.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-31T16:33:21.764 INFO:teuthology.orchestra.run.smithi120.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-31T16:33:21.789 INFO:teuthology.orchestra.run.smithi120.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-31T16:33:21.814 INFO:teuthology.orchestra.run.smithi120.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 687 kB/s | 34 kB 00:00 2024-03-31T16:33:21.893 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-31T16:33:21.923 INFO:teuthology.orchestra.run.smithi120.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2024-03-31T16:33:21.952 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-03-31T16:33:21.965 INFO:teuthology.orchestra.run.smithi120.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2024-03-31T16:33:21.999 INFO:teuthology.orchestra.run.smithi120.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 817 kB 00:00 2024-03-31T16:33:22.024 INFO:teuthology.orchestra.run.smithi120.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 132 kB 00:00 2024-03-31T16:33:22.073 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-03-31T16:33:22.094 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-03-31T16:33:22.141 INFO:teuthology.orchestra.run.smithi120.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-03-31T16:33:22.183 INFO:teuthology.orchestra.run.smithi120.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.5 MB/s | 1.0 MB 00:00 2024-03-31T16:33:22.187 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-03-31T16:33:22.208 INFO:teuthology.orchestra.run.smithi120.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-03-31T16:33:22.215 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 12/198 2024-03-31T16:33:22.253 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-31T16:33:22.326 INFO:teuthology.orchestra.run.smithi120.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2024-03-31T16:33:22.351 INFO:teuthology.orchestra.run.smithi120.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 175 kB/s | 24 kB 00:00 2024-03-31T16:33:22.376 INFO:teuthology.orchestra.run.smithi120.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 362 kB/s | 18 kB 00:00 2024-03-31T16:33:22.401 INFO:teuthology.orchestra.run.smithi120.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-31T16:33:22.427 INFO:teuthology.orchestra.run.smithi120.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 630 kB/s | 32 kB 00:00 2024-03-31T16:33:22.429 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-31T16:33:22.499 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-31T16:33:22.519 INFO:teuthology.orchestra.run.smithi120.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2024-03-31T16:33:22.525 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-03-31T16:33:22.544 INFO:teuthology.orchestra.run.smithi120.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 217 kB 00:00 2024-03-31T16:33:22.569 INFO:teuthology.orchestra.run.smithi120.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-31T16:33:22.603 INFO:teuthology.orchestra.run.smithi120.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-31T16:33:22.620 INFO:teuthology.orchestra.run.smithi120.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 823 kB/s | 41 kB 00:00 2024-03-31T16:33:22.628 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-03-31T16:33:22.645 INFO:teuthology.orchestra.run.smithi120.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 5.5 MB/s | 238 kB 00:00 2024-03-31T16:33:22.650 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 17/198 2024-03-31T16:33:22.670 INFO:teuthology.orchestra.run.smithi120.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-31T16:33:22.704 INFO:teuthology.orchestra.run.smithi120.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 211 kB 00:00 2024-03-31T16:33:22.724 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 17/198 2024-03-31T16:33:22.729 INFO:teuthology.orchestra.run.smithi120.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 813 kB/s | 47 kB 00:00 2024-03-31T16:33:22.754 INFO:teuthology.orchestra.run.smithi120.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 855 kB/s | 43 kB 00:00 2024-03-31T16:33:22.763 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-31T16:33:22.786 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T16:33:22.801 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T16:33:22.986 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T16:33:23.024 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T16:33:23.063 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-31T16:33:23.205 INFO:teuthology.orchestra.run.smithi120.stdout:(78/174): ceph-test-19.0.0-2574.gd2271579.el9.x 5.7 MB/s | 48 MB 00:08 2024-03-31T16:33:23.248 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-31T16:33:23.400 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T16:33:23.443 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T16:33:23.463 INFO:teuthology.orchestra.run.smithi120.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-03-31T16:33:23.489 INFO:teuthology.orchestra.run.smithi120.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 53 kB/s | 39 kB 00:00 2024-03-31T16:33:23.514 INFO:teuthology.orchestra.run.smithi120.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 134 kB/s | 41 kB 00:00 2024-03-31T16:33:23.539 INFO:teuthology.orchestra.run.smithi120.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2024-03-31T16:33:23.540 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T16:33:23.564 INFO:teuthology.orchestra.run.smithi120.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 702 kB/s | 35 kB 00:00 2024-03-31T16:33:23.587 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T16:33:23.589 INFO:teuthology.orchestra.run.smithi120.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 620 kB/s | 46 kB 00:00 2024-03-31T16:33:23.614 INFO:teuthology.orchestra.run.smithi120.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-03-31T16:33:23.640 INFO:teuthology.orchestra.run.smithi120.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-31T16:33:23.665 INFO:teuthology.orchestra.run.smithi120.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 839 kB/s | 63 kB 00:00 2024-03-31T16:33:23.690 INFO:teuthology.orchestra.run.smithi120.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-03-31T16:33:23.715 INFO:teuthology.orchestra.run.smithi120.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-31T16:33:23.804 INFO:teuthology.orchestra.run.smithi120.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2024-03-31T16:33:23.812 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T16:33:23.841 INFO:teuthology.orchestra.run.smithi120.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 7.6 MB/s | 1.1 MB 00:00 2024-03-31T16:33:23.866 INFO:teuthology.orchestra.run.smithi120.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 1.7 MB/s | 103 kB 00:00 2024-03-31T16:33:23.892 INFO:teuthology.orchestra.run.smithi120.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2024-03-31T16:33:23.917 INFO:teuthology.orchestra.run.smithi120.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-03-31T16:33:23.920 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-31T16:33:24.013 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-31T16:33:24.051 INFO:teuthology.orchestra.run.smithi120.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-31T16:33:24.051 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-31T16:33:24.078 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-31T16:33:24.084 INFO:teuthology.orchestra.run.smithi120.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-03-31T16:33:24.110 INFO:teuthology.orchestra.run.smithi120.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-03-31T16:33:24.122 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-31T16:33:24.145 INFO:teuthology.orchestra.run.smithi120.stdout:(98/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-03-31T16:33:24.194 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-31T16:33:24.249 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-31T16:33:24.268 INFO:teuthology.orchestra.run.smithi120.stdout:(99/174): elfutils-libelf-devel-0.190-2.el9.x86 117 kB/s | 21 kB 00:00 2024-03-31T16:33:24.287 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-31T16:33:24.293 INFO:teuthology.orchestra.run.smithi120.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 138 kB/s | 25 kB 00:00 2024-03-31T16:33:24.352 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-31T16:33:24.388 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-31T16:33:24.431 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-31T16:33:24.452 INFO:teuthology.orchestra.run.smithi120.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 1.3 MB/s | 245 kB 00:00 2024-03-31T16:33:24.477 INFO:teuthology.orchestra.run.smithi120.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.3 MB/s | 248 kB 00:00 2024-03-31T16:33:24.488 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-31T16:33:24.517 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-31T16:33:24.519 INFO:teuthology.orchestra.run.smithi120.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-03-31T16:33:24.586 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-31T16:33:24.621 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 39/198 2024-03-31T16:33:24.636 INFO:teuthology.orchestra.run.smithi120.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-03-31T16:33:24.665 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 40/198 2024-03-31T16:33:24.693 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 41/198 2024-03-31T16:33:24.762 INFO:teuthology.orchestra.run.smithi120.stdout:(105/174): openssl-devel-3.0.7-27.el9.x86_64.rp 6.7 MB/s | 4.1 MB 00:00 2024-03-31T16:33:24.762 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-31T16:33:24.808 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-31T16:33:24.845 INFO:teuthology.orchestra.run.smithi120.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-03-31T16:33:24.881 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-31T16:33:24.979 INFO:teuthology.orchestra.run.smithi120.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-03-31T16:33:24.996 INFO:teuthology.orchestra.run.smithi120.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 130 kB/s | 19 kB 00:00 2024-03-31T16:33:25.021 INFO:teuthology.orchestra.run.smithi120.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-03-31T16:33:25.024 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-31T16:33:25.046 INFO:teuthology.orchestra.run.smithi120.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-03-31T16:33:25.078 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-31T16:33:25.080 INFO:teuthology.orchestra.run.smithi120.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2024-03-31T16:33:25.139 INFO:teuthology.orchestra.run.smithi120.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-03-31T16:33:25.164 INFO:teuthology.orchestra.run.smithi120.stdout:(113/174): libunwind-1.6.2-1.el9.x86_64.rpm 575 kB/s | 67 kB 00:00 2024-03-31T16:33:25.256 INFO:teuthology.orchestra.run.smithi120.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-03-31T16:33:25.348 INFO:teuthology.orchestra.run.smithi120.stdout:(115/174): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-03-31T16:33:25.373 INFO:teuthology.orchestra.run.smithi120.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2024-03-31T16:33:25.398 INFO:teuthology.orchestra.run.smithi120.stdout:(117/174): python3-asyncssh-2.13.2-5.el9.noarch 2.3 MB/s | 548 kB 00:00 2024-03-31T16:33:25.424 INFO:teuthology.orchestra.run.smithi120.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 426 kB/s | 32 kB 00:00 2024-03-31T16:33:25.449 INFO:teuthology.orchestra.run.smithi120.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 198 kB/s | 15 kB 00:00 2024-03-31T16:33:25.482 INFO:teuthology.orchestra.run.smithi120.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-03-31T16:33:25.508 INFO:teuthology.orchestra.run.smithi120.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-31T16:33:25.542 INFO:teuthology.orchestra.run.smithi120.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-03-31T16:33:25.567 INFO:teuthology.orchestra.run.smithi120.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-03-31T16:33:25.596 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-31T16:33:25.600 INFO:teuthology.orchestra.run.smithi120.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.1 MB/s | 203 kB 00:00 2024-03-31T16:33:25.626 INFO:teuthology.orchestra.run.smithi120.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-03-31T16:33:25.659 INFO:teuthology.orchestra.run.smithi120.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-03-31T16:33:25.673 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-31T16:33:25.709 INFO:teuthology.orchestra.run.smithi120.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-03-31T16:33:25.734 INFO:teuthology.orchestra.run.smithi120.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2024-03-31T16:33:25.759 INFO:teuthology.orchestra.run.smithi120.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-03-31T16:33:25.771 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-31T16:33:25.785 INFO:teuthology.orchestra.run.smithi120.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2024-03-31T16:33:25.819 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T16:33:25.827 INFO:teuthology.orchestra.run.smithi120.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-03-31T16:33:25.828 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T16:33:25.852 INFO:teuthology.orchestra.run.smithi120.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-03-31T16:33:25.859 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-31T16:33:25.886 INFO:teuthology.orchestra.run.smithi120.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-03-31T16:33:25.911 INFO:teuthology.orchestra.run.smithi120.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 941 kB/s | 79 kB 00:00 2024-03-31T16:33:25.936 INFO:teuthology.orchestra.run.smithi120.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-03-31T16:33:25.950 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-31T16:33:25.970 INFO:teuthology.orchestra.run.smithi120.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-03-31T16:33:25.987 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 53/198 2024-03-31T16:33:25.995 INFO:teuthology.orchestra.run.smithi120.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-03-31T16:33:26.018 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-31T16:33:26.020 INFO:teuthology.orchestra.run.smithi120.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-03-31T16:33:26.046 INFO:teuthology.orchestra.run.smithi120.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-03-31T16:33:26.071 INFO:teuthology.orchestra.run.smithi120.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-03-31T16:33:26.097 INFO:teuthology.orchestra.run.smithi120.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-31T16:33:26.130 INFO:teuthology.orchestra.run.smithi120.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-03-31T16:33:26.155 INFO:teuthology.orchestra.run.smithi120.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2024-03-31T16:33:26.180 INFO:teuthology.orchestra.run.smithi120.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 609 kB/s | 51 kB 00:00 2024-03-31T16:33:26.206 INFO:teuthology.orchestra.run.smithi120.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-31T16:33:26.231 INFO:teuthology.orchestra.run.smithi120.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-31T16:33:26.265 INFO:teuthology.orchestra.run.smithi120.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-03-31T16:33:26.290 INFO:teuthology.orchestra.run.smithi120.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-03-31T16:33:26.315 INFO:teuthology.orchestra.run.smithi120.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-31T16:33:26.332 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-31T16:33:26.487 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-31T16:33:26.580 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-31T16:33:26.624 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-31T16:33:26.725 INFO:teuthology.orchestra.run.smithi120.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-03-31T16:33:26.768 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-31T16:33:26.819 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-31T16:33:26.873 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-31T16:33:26.920 INFO:teuthology.orchestra.run.smithi120.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-03-31T16:33:26.938 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-31T16:33:26.970 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-31T16:33:26.992 INFO:teuthology.orchestra.run.smithi120.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-03-31T16:33:27.006 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-31T16:33:27.026 INFO:teuthology.orchestra.run.smithi120.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-03-31T16:33:27.053 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-31T16:33:27.067 INFO:teuthology.orchestra.run.smithi120.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-03-31T16:33:27.089 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-31T16:33:27.126 INFO:teuthology.orchestra.run.smithi120.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-03-31T16:33:27.132 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-31T16:33:27.174 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-31T16:33:27.210 INFO:teuthology.orchestra.run.smithi120.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 856 kB/s | 71 kB 00:00 2024-03-31T16:33:27.276 INFO:teuthology.orchestra.run.smithi120.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 546 kB/s | 36 kB 00:00 2024-03-31T16:33:27.309 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-31T16:33:27.343 INFO:teuthology.orchestra.run.smithi120.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-03-31T16:33:27.363 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-31T16:33:27.393 INFO:teuthology.orchestra.run.smithi120.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-03-31T16:33:27.394 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-31T16:33:27.435 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-31T16:33:27.444 INFO:teuthology.orchestra.run.smithi120.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 460 kB/s | 23 kB 00:00 2024-03-31T16:33:27.494 INFO:teuthology.orchestra.run.smithi120.stdout:(161/174): librados2-19.0.0-2574.gd2271579.el9. 2.8 MB/s | 3.4 MB 00:01 2024-03-31T16:33:27.519 INFO:teuthology.orchestra.run.smithi120.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-03-31T16:33:27.530 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-31T16:33:27.569 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-31T16:33:27.594 INFO:teuthology.orchestra.run.smithi120.stdout:(163/174): librbd1-19.0.0-2574.gd2271579.el9.x8 2.5 MB/s | 3.1 MB 00:01 2024-03-31T16:33:27.610 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-31T16:33:27.644 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-31T16:33:27.644 INFO:teuthology.orchestra.run.smithi120.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 155 kB 00:00 2024-03-31T16:33:27.668 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-31T16:33:27.669 INFO:teuthology.orchestra.run.smithi120.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 901 kB/s | 136 kB 00:00 2024-03-31T16:33:27.695 INFO:teuthology.orchestra.run.smithi120.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 635 kB/s | 64 kB 00:00 2024-03-31T16:33:27.746 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-31T16:33:27.795 INFO:teuthology.orchestra.run.smithi120.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-03-31T16:33:27.854 INFO:teuthology.orchestra.run.smithi120.stdout:(168/174): libuuid-2.37.4-18.el9.x86_64.rpm 137 kB/s | 29 kB 00:00 2024-03-31T16:33:27.880 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-31T16:33:27.896 INFO:teuthology.orchestra.run.smithi120.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2024-03-31T16:33:27.938 INFO:teuthology.orchestra.run.smithi120.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 747 kB/s | 31 kB 00:00 2024-03-31T16:33:27.980 INFO:teuthology.orchestra.run.smithi120.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 12 MB/s | 2.3 MB 00:00 2024-03-31T16:33:27.987 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-31T16:33:28.013 INFO:teuthology.orchestra.run.smithi120.stdout:(172/174): util-linux-core-2.37.4-18.el9.x86_64 2.9 MB/s | 465 kB 00:00 2024-03-31T16:33:28.028 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-31T16:33:28.047 INFO:teuthology.orchestra.run.smithi120.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.9 MB/s | 1.1 MB 00:00 2024-03-31T16:33:28.076 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-31T16:33:28.139 INFO:teuthology.orchestra.run.smithi120.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 468 kB/s | 74 kB 00:00 2024-03-31T16:33:28.140 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-31T16:33:28.142 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-03-31T16:33:28.142 INFO:teuthology.orchestra.run.smithi120.stdout:Total 13 MB/s | 226 MB 00:17 2024-03-31T16:33:28.324 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-31T16:33:28.399 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-31T16:33:28.512 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-03-31T16:33:28.537 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-31T16:33:28.580 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-31T16:33:28.612 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-31T16:33:28.643 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T16:33:28.671 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-31T16:33:28.705 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-31T16:33:28.744 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-31T16:33:28.776 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-31T16:33:28.784 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-03-31T16:33:28.784 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-03-31T16:33:28.806 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-31T16:33:28.882 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-31T16:33:28.925 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-31T16:33:28.958 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-31T16:33:29.000 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-31T16:33:29.035 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-31T16:33:29.123 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-31T16:33:29.230 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-31T16:33:29.274 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-31T16:33:29.314 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-31T16:33:29.361 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-31T16:33:29.458 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-31T16:33:29.507 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-31T16:33:30.233 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-31T16:33:30.280 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-31T16:33:30.315 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-31T16:33:30.371 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-31T16:33:30.450 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-31T16:33:30.499 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-31T16:33:30.678 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-31T16:33:30.705 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-31T16:33:30.768 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-03-31T16:33:30.769 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-03-31T16:33:30.784 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-31T16:33:31.435 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-31T16:33:31.545 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-31T16:33:32.771 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-31T16:33:32.850 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-31T16:33:32.881 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-31T16:33:32.912 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-31T16:33:32.940 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-31T16:33:33.251 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-31T16:33:33.278 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 124/198 2024-03-31T16:33:33.360 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 124/198 2024-03-31T16:33:33.392 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 125/198 2024-03-31T16:33:33.428 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-31T16:33:33.882 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-31T16:33:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 128/198 2024-03-31T16:33:33.978 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 128/198 2024-03-31T16:33:34.009 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 129/198 2024-03-31T16:33:36.263 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-03-31T16:33:36.306 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-03-31T16:33:36.855 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-03-31T16:33:36.893 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 131/198 2024-03-31T16:33:36.982 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 131/198 2024-03-31T16:33:36.983 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-31T16:33:36.983 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-31T16:33:36.983 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:37.019 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 132/198 2024-03-31T16:33:37.715 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-03-31T16:33:37.817 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-31T16:33:37.862 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-31T16:33:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T16:33:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-31T16:33:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-31T16:33:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-31T16:33:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-31T16:33:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-31T16:33:38.122 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-31T16:33:38.454 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-31T16:33:38.521 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-03-31T16:33:38.623 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-03-31T16:33:38.664 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-03-31T16:33:38.738 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-03-31T16:33:38.768 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 12/198 2024-03-31T16:33:38.810 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-31T16:33:38.981 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-31T16:33:39.032 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-31T16:33:39.052 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-03-31T16:33:39.155 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-03-31T16:33:39.178 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 17/198 2024-03-31T16:33:39.242 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 17/198 2024-03-31T16:33:39.290 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-31T16:33:39.312 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T16:33:39.328 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-31T16:33:39.479 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T16:33:39.519 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-31T16:33:39.558 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-31T16:33:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-31T16:33:39.885 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T16:33:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-31T16:33:40.048 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T16:33:40.107 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T16:33:40.339 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-31T16:33:40.444 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-31T16:33:40.540 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-31T16:33:40.587 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-31T16:33:40.605 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-31T16:33:40.644 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-31T16:33:40.724 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-31T16:33:40.777 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-31T16:33:40.815 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-31T16:33:40.880 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-31T16:33:40.915 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-31T16:33:40.949 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-31T16:33:40.982 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-31T16:33:41.010 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-31T16:33:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-31T16:33:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 39/198 2024-03-31T16:33:41.158 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 40/198 2024-03-31T16:33:41.187 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 41/198 2024-03-31T16:33:41.258 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-31T16:33:41.301 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-31T16:33:41.376 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-31T16:33:41.508 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-31T16:33:41.563 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-31T16:33:42.081 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-31T16:33:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-31T16:33:42.243 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-31T16:33:42.287 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T16:33:42.297 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-31T16:33:42.327 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-31T16:33:42.377 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-31T16:33:42.414 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 53/198 2024-03-31T16:33:42.445 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-31T16:33:42.738 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-31T16:33:42.951 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-31T16:33:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-31T16:33:43.092 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-31T16:33:43.318 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-31T16:33:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-31T16:33:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-31T16:33:43.514 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-31T16:33:43.546 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-31T16:33:43.574 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-31T16:33:43.621 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-31T16:33:43.657 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-31T16:33:43.700 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-31T16:33:43.742 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-31T16:33:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-31T16:33:43.923 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-31T16:33:43.954 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-31T16:33:43.986 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-31T16:33:44.080 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-31T16:33:44.129 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-31T16:33:44.169 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-31T16:33:44.195 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-31T16:33:44.261 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-31T16:33:44.530 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-31T16:33:44.828 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-31T16:33:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-31T16:33:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-31T16:33:45.026 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-31T16:33:45.082 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-31T16:33:45.269 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-31T16:33:45.325 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-31T16:33:45.453 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-31T16:33:45.490 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-31T16:33:45.522 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-31T16:33:45.553 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T16:33:45.580 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-31T16:33:45.623 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-31T16:33:45.662 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-31T16:33:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-31T16:33:45.724 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-31T16:33:45.821 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-31T16:33:45.860 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-31T16:33:45.893 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-31T16:33:45.934 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-31T16:33:45.969 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-31T16:33:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-31T16:33:46.139 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-31T16:33:46.183 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-31T16:33:46.215 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-31T16:33:46.262 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-31T16:33:46.359 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-31T16:33:46.408 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-31T16:33:47.125 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-31T16:33:47.180 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-31T16:33:47.214 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-31T16:33:47.271 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-31T16:33:47.348 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-31T16:33:47.399 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-31T16:33:47.575 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-31T16:33:47.605 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-31T16:33:47.682 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-31T16:33:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-31T16:33:48.426 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 132/198 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-03-31T16:33:49.210 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:49.382 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 133/198 2024-03-31T16:33:49.397 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 133/198 2024-03-31T16:33:49.397 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:49.397 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-31T16:33:49.397 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:49.622 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-31T16:33:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-31T16:33:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-31T16:33:49.770 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-31T16:33:49.797 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-31T16:33:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-31T16:33:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 124/198 2024-03-31T16:33:50.226 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 124/198 2024-03-31T16:33:50.257 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 125/198 2024-03-31T16:33:50.302 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-31T16:33:50.761 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-31T16:33:50.789 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 128/198 2024-03-31T16:33:50.844 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 128/198 2024-03-31T16:33:50.877 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 134/198 2024-03-31T16:33:50.894 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 129/198 2024-03-31T16:33:50.902 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 134/198 2024-03-31T16:33:50.902 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:50.903 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-31T16:33:50.903 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T16:33:50.903 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T16:33:50.903 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:51.119 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 135/198 2024-03-31T16:33:51.141 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 135/198 2024-03-31T16:33:51.141 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:51.141 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-31T16:33:51.141 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T16:33:51.142 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T16:33:51.142 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:51.595 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 136/198 2024-03-31T16:33:51.617 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 136/198 2024-03-31T16:33:51.617 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:51.617 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-31T16:33:51.617 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T16:33:51.618 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T16:33:51.618 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:51.713 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-31T16:33:52.190 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 138/198 2024-03-31T16:33:52.220 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 138/198 2024-03-31T16:33:52.253 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 139/198 2024-03-31T16:33:52.314 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 140/198 2024-03-31T16:33:52.344 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 141/198 2024-03-31T16:33:53.153 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-03-31T16:33:53.188 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-03-31T16:33:53.387 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 141/198 2024-03-31T16:33:53.421 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 142/198 2024-03-31T16:33:53.733 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 130/198 2024-03-31T16:33:53.775 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 131/198 2024-03-31T16:33:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 131/198 2024-03-31T16:33:53.868 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-31T16:33:53.868 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-31T16:33:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:33:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 132/198 2024-03-31T16:33:54.395 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 142/198 2024-03-31T16:33:54.421 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 143/198 2024-03-31T16:33:54.522 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 143/198 2024-03-31T16:33:54.676 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 144/198 2024-03-31T16:33:54.707 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 145/198 2024-03-31T16:33:54.729 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 145/198 2024-03-31T16:33:54.729 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:54.729 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-31T16:33:54.729 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T16:33:54.729 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T16:33:54.729 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 146/198 2024-03-31T16:33:54.785 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 146/198 2024-03-31T16:33:54.836 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 147/198 2024-03-31T16:33:55.732 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-31T16:33:55.769 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 149/198 2024-03-31T16:33:55.792 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 149/198 2024-03-31T16:33:55.792 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:55.792 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-31T16:33:55.792 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T16:33:55.792 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T16:33:55.792 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:55.836 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 150/198 2024-03-31T16:33:55.858 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2574.gd2271 150/198 2024-03-31T16:33:55.858 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:55.858 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-31T16:33:55.858 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:55.914 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-03-31T16:33:55.936 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-03-31T16:33:55.936 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:55.936 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-31T16:33:55.936 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T16:33:55.936 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T16:33:55.936 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:33:56.254 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/198 2024-03-31T16:33:56.276 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/198 2024-03-31T16:33:56.277 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:33:56.277 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-31T16:33:56.277 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T16:33:56.277 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T16:33:56.277 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:00.776 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 153/198 2024-03-31T16:34:00.826 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 154/198 2024-03-31T16:34:00.856 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 155/198 2024-03-31T16:34:00.883 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-31T16:34:01.063 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 157/198 2024-03-31T16:34:01.183 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-31T16:34:01.232 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 159/198 2024-03-31T16:34:01.284 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-31T16:34:01.341 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-31T16:34:01.384 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-31T16:34:01.417 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 163/198 2024-03-31T16:34:01.466 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-31T16:34:01.495 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-31T16:34:01.575 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-31T16:34:01.645 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-31T16:34:01.686 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-31T16:34:02.278 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T16:34:02.319 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T16:34:02.338 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T16:34:03.170 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 170/198 2024-03-31T16:34:03.249 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-31T16:34:03.289 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-31T16:34:03.370 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-31T16:34:03.403 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-31T16:34:03.428 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-31T16:34:03.453 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-31T16:34:03.480 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-31T16:34:03.480 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T16:34:03.551 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T16:34:03.597 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-31T16:34:03.597 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T16:34:03.691 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T16:34:03.717 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-31T16:34:03.750 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-31T16:34:03.775 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-31T16:34:03.801 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-31T16:34:03.836 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-31T16:34:03.883 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-31T16:34:03.923 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-31T16:34:03.948 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-31T16:34:03.973 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-31T16:34:03.999 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-31T16:34:04.024 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-31T16:34:04.030 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T16:34:04.030 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T16:34:04.219 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T16:34:04.219 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T16:34:04.302 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T16:34:04.333 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-31T16:34:04.360 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-31T16:34:04.386 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-31T16:34:04.420 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-31T16:34:04.485 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T16:34:05.511 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 132/198 2024-03-31T16:34:05.511 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-03-31T16:34:05.511 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-03-31T16:34:05.512 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-03-31T16:34:05.512 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-03-31T16:34:05.512 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-03-31T16:34:05.512 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-03-31T16:34:05.512 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-03-31T16:34:05.512 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:05.669 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 133/198 2024-03-31T16:34:05.684 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 133/198 2024-03-31T16:34:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:05.684 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-31T16:34:05.684 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:07.120 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 134/198 2024-03-31T16:34:07.145 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 134/198 2024-03-31T16:34:07.145 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:07.146 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-31T16:34:07.146 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T16:34:07.146 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-31T16:34:07.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 135/198 2024-03-31T16:34:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 135/198 2024-03-31T16:34:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-31T16:34:07.393 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T16:34:07.394 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-31T16:34:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:07.846 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 136/198 2024-03-31T16:34:07.869 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 136/198 2024-03-31T16:34:07.869 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:07.869 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-31T16:34:07.869 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T16:34:07.869 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-31T16:34:07.869 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:07.965 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-31T16:34:08.334 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 138/198 2024-03-31T16:34:08.364 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 138/198 2024-03-31T16:34:08.396 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 139/198 2024-03-31T16:34:08.457 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 140/198 2024-03-31T16:34:08.496 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 141/198 2024-03-31T16:34:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 141/198 2024-03-31T16:34:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 142/198 2024-03-31T16:34:10.147 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T16:34:10.147 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 1/198 2024-03-31T16:34:10.147 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2/198 2024-03-31T16:34:10.147 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 3/198 2024-03-31T16:34:10.147 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 4/198 2024-03-31T16:34:10.147 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 5/198 2024-03-31T16:34:10.147 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 6/198 2024-03-31T16:34:10.147 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 7/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 8/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 9/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 12/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 13/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 14/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 15/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 17/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 18/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 19/198 2024-03-31T16:34:10.148 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 20/198 2024-03-31T16:34:10.149 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 21/198 2024-03-31T16:34:10.149 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 22/198 2024-03-31T16:34:10.149 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 23/198 2024-03-31T16:34:10.149 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 24/198 2024-03-31T16:34:10.149 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 25/198 2024-03-31T16:34:10.149 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 26/198 2024-03-31T16:34:10.149 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 27/198 2024-03-31T16:34:10.166 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 28/198 2024-03-31T16:34:10.166 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 29/198 2024-03-31T16:34:10.166 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 30/198 2024-03-31T16:34:10.166 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 31/198 2024-03-31T16:34:10.166 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 32/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 33/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 34/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 35/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 36/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 37/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 38/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 39/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-31T16:34:10.167 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-31T16:34:10.168 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-31T16:34:10.169 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-31T16:34:10.170 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-31T16:34:10.171 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-31T16:34:10.172 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-31T16:34:10.173 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-31T16:34:10.174 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-31T16:34:10.175 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 153/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-31T16:34:10.176 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-31T16:34:10.177 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-31T16:34:10.178 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-31T16:34:10.179 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-31T16:34:10.180 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-31T16:34:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 142/198 2024-03-31T16:34:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 143/198 2024-03-31T16:34:10.640 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 143/198 2024-03-31T16:34:10.810 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 144/198 2024-03-31T16:34:10.834 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 145/198 2024-03-31T16:34:10.856 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 145/198 2024-03-31T16:34:10.856 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:10.856 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-31T16:34:10.856 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T16:34:10.856 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-31T16:34:10.857 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:10.901 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 146/198 2024-03-31T16:34:10.912 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 146/198 2024-03-31T16:34:10.963 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 147/198 2024-03-31T16:34:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-31T16:34:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 149/198 2024-03-31T16:34:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 149/198 2024-03-31T16:34:11.893 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:11.893 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-31T16:34:11.893 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T16:34:11.893 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-31T16:34:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 150/198 2024-03-31T16:34:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2574.gd2271 150/198 2024-03-31T16:34:11.959 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:11.959 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-31T16:34:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-03-31T16:34:12.027 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-03-31T16:34:12.027 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:12.027 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-31T16:34:12.027 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T16:34:12.027 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-31T16:34:12.027 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:12.331 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/198 2024-03-31T16:34:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 152/198 2024-03-31T16:34:12.353 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-31T16:34:12.353 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-31T16:34:12.353 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T16:34:12.353 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-31T16:34:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:13.218 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: acl-2.3.1-4.el9.x86_64 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-31T16:34:13.219 INFO:teuthology.orchestra.run.smithi203.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-31T16:34:13.220 INFO:teuthology.orchestra.run.smithi203.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-31T16:34:13.220 INFO:teuthology.orchestra.run.smithi203.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.220 INFO:teuthology.orchestra.run.smithi203.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.220 INFO:teuthology.orchestra.run.smithi203.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.220 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.220 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.221 INFO:teuthology.orchestra.run.smithi203.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.221 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.221 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-31T16:34:13.221 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-31T16:34:13.221 INFO:teuthology.orchestra.run.smithi203.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.221 INFO:teuthology.orchestra.run.smithi203.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.221 INFO:teuthology.orchestra.run.smithi203.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.221 INFO:teuthology.orchestra.run.smithi203.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-31T16:34:13.222 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-31T16:34:13.222 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-03-31T16:34:13.222 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-31T16:34:13.222 INFO:teuthology.orchestra.run.smithi203.stdout: automake-1.16.2-8.el9.noarch 2024-03-31T16:34:13.222 INFO:teuthology.orchestra.run.smithi203.stdout: bison-3.7.4-5.el9.x86_64 2024-03-31T16:34:13.222 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-31T16:34:13.222 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.222 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.223 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.223 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.223 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.223 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.223 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.223 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.224 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: flex-2.6.4-9.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: jq-1.6-16.el9.x86_64 2024-03-31T16:34:13.225 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.226 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: lua-5.4.4-4.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-31T16:34:13.227 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-13.14-1.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-31T16:34:13.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-31T16:34:13.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-31T16:34:13.231 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-31T16:34:13.232 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-31T16:34:13.233 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-3.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-31T16:34:13.234 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-31T16:34:13.235 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-31T16:34:13.235 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:13.235 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-03-31T16:34:13.698 DEBUG:teuthology.parallel:result is None 2024-03-31T16:34:16.835 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 153/198 2024-03-31T16:34:16.877 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 154/198 2024-03-31T16:34:16.907 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 155/198 2024-03-31T16:34:16.934 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-31T16:34:17.123 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 157/198 2024-03-31T16:34:17.235 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-31T16:34:17.274 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 159/198 2024-03-31T16:34:17.322 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-31T16:34:17.375 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-31T16:34:17.410 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-31T16:34:17.443 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 163/198 2024-03-31T16:34:17.483 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-31T16:34:17.515 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-31T16:34:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-31T16:34:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-31T16:34:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-31T16:34:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T16:34:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T16:34:18.349 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-31T16:34:19.183 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 170/198 2024-03-31T16:34:19.251 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-31T16:34:19.291 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-31T16:34:19.374 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-31T16:34:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-31T16:34:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-31T16:34:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-31T16:34:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-31T16:34:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T16:34:19.578 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-31T16:34:19.608 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-31T16:34:19.608 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T16:34:19.709 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-31T16:34:19.735 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-31T16:34:19.768 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-31T16:34:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-31T16:34:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-31T16:34:19.854 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-31T16:34:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-31T16:34:19.941 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-31T16:34:19.966 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-31T16:34:19.991 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-31T16:34:20.017 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-31T16:34:20.042 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-31T16:34:20.049 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T16:34:20.049 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T16:34:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-31T16:34:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T16:34:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-31T16:34:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-31T16:34:20.378 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-31T16:34:20.404 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-31T16:34:20.429 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-31T16:34:20.496 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:19.0.0-2574.gd2271579.el9.x86_64 1/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 3/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 4/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2574.gd2271 5/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 6/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 7/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 8/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 9/198 2024-03-31T16:34:26.084 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 10/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 11/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 12/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 13/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 14/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_ 15/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 16/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 17/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:19.0.0-2574.gd2271579.el9.x86_6 18/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86 19/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 20/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2574.gd2271579.el 21/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:19.0.0-2574.gd2271579.el9. 22/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_6 23/198 2024-03-31T16:34:26.085 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 24/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 25/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 26/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 27/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 28/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 29/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2574.gd2271579. 30/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noa 31/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.n 32/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2574.gd22 33/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el 34/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 35/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.e 36/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 37/198 2024-03-31T16:34:26.086 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:19.0.0-2574.gd2271579.el9.noarch 38/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 39/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-31T16:34:26.087 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-31T16:34:26.088 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-31T16:34:26.089 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-31T16:34:26.090 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-31T16:34:26.091 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-31T16:34:26.092 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-31T16:34:26.093 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:19.0.0-2574.gd2271579.el9.x86_64 151/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 153/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-31T16:34:26.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-31T16:34:26.095 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-31T16:34:26.096 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-31T16:34:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-31T16:34:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-31T16:34:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-31T16:34:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-31T16:34:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-31T16:34:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-31T16:34:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-31T16:34:26.097 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-31T16:34:29.094 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-31T16:34:29.095 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:29.095 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-03-31T16:34:29.095 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-31T16:34:29.095 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-31T16:34:29.095 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-31T16:34:29.095 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-31T16:34:29.095 INFO:teuthology.orchestra.run.smithi120.stdout: acl-2.3.1-4.el9.x86_64 2024-03-31T16:34:29.095 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.096 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-31T16:34:29.097 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: automake-1.16.2-8.el9.noarch 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: bison-3.7.4-5.el9.x86_64 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.098 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.099 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top-2:19.0.0-2574.gd2271579.el9.noarch 2024-03-31T16:34:29.100 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: flex-2.6.4-9.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: jq-1.6-16.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-31T16:34:29.101 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.102 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: lua-5.4.4-4.el9.x86_64 2024-03-31T16:34:29.103 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-13.14-1.el9.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-31T16:34:29.104 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.105 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-31T16:34:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-31T16:34:29.107 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-31T16:34:29.108 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-31T16:34:29.109 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-31T16:34:29.110 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-31T16:34:29.111 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:19.0.0-2574.gd2271579.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-3.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-31T16:34:29.112 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-31T16:34:29.113 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-31T16:34:29.113 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:29.113 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-03-31T16:34:29.563 DEBUG:teuthology.parallel:result is None 2024-03-31T16:34:29.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-03-31T16:34:29.705 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-31T16:34:29.726 INFO:teuthology.orchestra.run.smithi120.stdout:19.0.0-2574.gd2271579.el9 2024-03-31T16:34:29.727 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2574.gd2271579.el9 2024-03-31T16:34:29.727 INFO:teuthology.task.install:The correct ceph version 19.0.0-2574.gd2271579 is installed. 2024-03-31T16:34:29.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d2271579d5e735cfd6d436b8349c004f06527cb0 2024-03-31T16:34:29.941 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-31T16:34:29.966 INFO:teuthology.orchestra.run.smithi203.stdout:19.0.0-2574.gd2271579.el9 2024-03-31T16:34:29.967 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2574.gd2271579.el9 2024-03-31T16:34:29.967 INFO:teuthology.task.install:The correct ceph version 19.0.0-2574.gd2271579 is installed. 2024-03-31T16:34:29.968 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-31T16:34:29.969 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:29.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-31T16:34:29.999 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:34:29.999 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-31T16:34:30.040 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-31T16:34:30.041 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:30.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-03-31T16:34:30.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-31T16:34:30.133 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:34:30.134 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-03-31T16:34:30.163 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-31T16:34:30.236 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-31T16:34:30.236 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:30.236 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-31T16:34:30.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-31T16:34:30.329 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:34:30.329 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-31T16:34:30.357 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-31T16:34:30.424 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-31T16:34:30.424 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:30.424 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-03-31T16:34:30.451 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-31T16:34:30.517 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:34:30.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-03-31T16:34:30.545 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-31T16:34:30.612 INFO:teuthology.run_tasks:Running task ceph... 2024-03-31T16:34:30.695 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-31T16:34:30.695 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-03-31T16:34:30.697 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /var/log/ceph 2024-03-31T16:34:30.724 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-31T16:34:30.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-31T16:34:30.764 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-31T16:34:30.791 INFO:tasks.ceph:Creating extra log directories... 2024-03-31T16:34:30.791 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-31T16:34:30.830 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-31T16:34:30.865 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-31T16:34:30.865 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-31T16:34:30.865 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-31T16:34:30.865 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:30.865 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-31T16:34:30.910 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-31T16:34:31.028 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-31T16:34:31.055 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:34:31.055 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-31T16:34:31.070 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-31T16:34:31.188 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-31T16:34:31.221 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-31T16:34:31.221 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-31T16:34:31.221 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726', 'branch': 'wip-vshankar-testing-20240330.170739', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7631726', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240330.170739'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240330.170739', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6891, 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'sleep_before_teardown': 0, 'subset': '932/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240330.170739', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhY8US6Ge34UWgaDHj0ZjdR4fCh2E7PyFW209rLTnqcuKDV1IQJV1P84aHVznOmLFCnkOlj8N/0a4djwkNHB1c=', 'smithi203.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwiwdjjC9aL5fb+iaVZ4hHAo/12NgvfdqjIyaYoTZLH1KH4Sln9iXwd+6AguPT0P8uM4+hZVue+8pZhE1ILMBQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd2271579d5e735cfd6d436b8349c004f06527cb0', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-30_23:12:08', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-31T16:34:31.222 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-31T16:34:31.224 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-31T16:34:31.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-03-31T16:34:31.279 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/run/ceph 2024-03-31T16:34:31.337 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:31.337 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-03-31T16:34:31.359 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-31T16:34:31.359 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-03-31T16:34:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-31T16:34:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T16:34:31.414 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-31T16:34:31.414 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T16:34:31.414 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T16:34:31.415 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-03-31 16:34:20.832445525 +0000 2024-03-31T16:34:31.415 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-03-31 16:32:05.254603214 +0000 2024-03-31T16:34:31.415 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-03-31 16:32:05.254603214 +0000 2024-03-31T16:34:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-03-31 16:32:05.254603214 +0000 2024-03-31T16:34:31.416 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-31T16:34:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-03-31T16:34:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-03-31T16:34:31.479 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000261645 s, 2.0 MB/s 2024-03-31T16:34:31.480 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-31T16:34:31.536 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-03-31T16:34:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-31T16:34:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T16:34:31.591 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-31T16:34:31.591 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T16:34:31.591 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T16:34:31.591 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-03-31 16:34:20.833445502 +0000 2024-03-31T16:34:31.592 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-03-31 16:32:05.608595097 +0000 2024-03-31T16:34:31.592 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-03-31 16:32:05.608595097 +0000 2024-03-31T16:34:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-03-31 16:32:05.608595097 +0000 2024-03-31T16:34:31.592 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-31T16:34:31.656 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-03-31T16:34:31.656 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-03-31T16:34:31.656 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000186786 s, 2.7 MB/s 2024-03-31T16:34:31.657 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-31T16:34:31.713 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-03-31 16:34:20.833445502 +0000 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-03-31 16:32:05.955587141 +0000 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-03-31 16:32:05.955587141 +0000 2024-03-31T16:34:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-03-31 16:32:05.955587141 +0000 2024-03-31T16:34:31.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-31T16:34:31.833 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-03-31T16:34:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-03-31T16:34:31.834 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000191284 s, 2.7 MB/s 2024-03-31T16:34:31.835 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-31T16:34:31.891 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-03-31 16:34:20.834445480 +0000 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-03-31 16:32:06.302579184 +0000 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-03-31 16:32:06.302579184 +0000 2024-03-31T16:34:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-03-31 16:32:06.302579184 +0000 2024-03-31T16:34:31.947 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-31T16:34:32.011 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-03-31T16:34:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-03-31T16:34:32.012 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000177434 s, 2.9 MB/s 2024-03-31T16:34:32.013 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-31T16:34:32.068 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:32.069 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:34:32.069 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-03-31T16:34:32.086 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-31T16:34:32.086 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-03-31T16:34:32.142 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-31T16:34:32.142 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T16:34:32.142 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-31T16:34:32.142 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T16:34:32.143 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T16:34:32.143 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-03-31 16:34:04.826427032 +0000 2024-03-31T16:34:32.143 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-03-31 16:31:59.189320349 +0000 2024-03-31T16:34:32.143 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-03-31 16:31:59.189320349 +0000 2024-03-31T16:34:32.143 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-03-31 16:31:59.189320349 +0000 2024-03-31T16:34:32.143 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-31T16:34:32.209 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-03-31T16:34:32.209 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-03-31T16:34:32.209 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000191697 s, 2.7 MB/s 2024-03-31T16:34:32.211 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-31T16:34:32.267 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-03-31T16:34:32.322 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-31T16:34:32.323 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T16:34:32.323 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-31T16:34:32.323 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T16:34:32.323 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T16:34:32.323 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-03-31 16:34:04.826427032 +0000 2024-03-31T16:34:32.323 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-03-31 16:31:59.532311253 +0000 2024-03-31T16:34:32.323 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-03-31 16:31:59.532311253 +0000 2024-03-31T16:34:32.323 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-03-31 16:31:59.532311253 +0000 2024-03-31T16:34:32.323 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-31T16:34:32.390 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-03-31T16:34:32.390 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-03-31T16:34:32.390 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000228144 s, 2.2 MB/s 2024-03-31T16:34:32.390 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-31T16:34:32.446 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-03-31T16:34:32.501 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-31T16:34:32.501 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T16:34:32.501 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-31T16:34:32.501 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T16:34:32.501 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T16:34:32.501 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-03-31 16:34:04.826427032 +0000 2024-03-31T16:34:32.501 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-03-31 16:31:59.868302343 +0000 2024-03-31T16:34:32.502 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-03-31 16:31:59.868302343 +0000 2024-03-31T16:34:32.502 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-03-31 16:31:59.868302343 +0000 2024-03-31T16:34:32.502 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-31T16:34:32.567 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-03-31T16:34:32.567 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-03-31T16:34:32.567 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000186514 s, 2.7 MB/s 2024-03-31T16:34:32.568 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-31T16:34:32.624 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-03-31T16:34:32.679 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-31T16:34:32.679 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-31T16:34:32.679 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-31T16:34:32.679 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-31T16:34:32.679 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-03-31T16:34:32.679 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-03-31 16:34:04.827427006 +0000 2024-03-31T16:34:32.680 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-03-31 16:32:00.205293406 +0000 2024-03-31T16:34:32.680 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-03-31 16:32:00.205293406 +0000 2024-03-31T16:34:32.680 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-03-31 16:32:00.205293406 +0000 2024-03-31T16:34:32.680 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-31T16:34:32.745 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-03-31T16:34:32.745 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-03-31T16:34:32.745 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000173841 s, 2.9 MB/s 2024-03-31T16:34:32.747 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-31T16:34:32.802 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:32.802 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-31T16:34:32.802 INFO:tasks.ceph:Generating config... 2024-03-31T16:34:32.803 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-31T16:34:32.803 INFO:tasks.ceph:[client] debug client = 20 2024-03-31T16:34:32.803 INFO:tasks.ceph:[client] debug ms = 1 2024-03-31T16:34:32.803 INFO:tasks.ceph:[client] pid file = 2024-03-31T16:34:32.803 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-31T16:34:32.803 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-31T16:34:32.804 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-31T16:34:32.804 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-31T16:34:32.805 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-31T16:34:32.805 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-31T16:34:32.805 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-31T16:34:32.805 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-31T16:34:32.805 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-31T16:34:32.805 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-31T16:34:32.806 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-31T16:34:32.806 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-31T16:34:32.806 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-31T16:34:32.806 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-31T16:34:32.806 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-31T16:34:32.806 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-31T16:34:32.806 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-31T16:34:32.806 INFO:tasks.ceph:Setting up mon.a... 2024-03-31T16:34:32.806 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-31T16:34:32.859 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2024-03-31T16:34:32.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-31T16:34:32.904 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-31T16:34:32.971 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120'), ('mon.b', '172.21.15.203'), ('mon.c', '[v2:172.21.15.203:3301,v1:172.21.15.203:6790]')] 2024-03-31T16:34:32.971 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.120,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-31T16:34:32.972 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:32.972 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-31T16:34:33.026 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.120 --add b 172.21.15.203 --addv c '[v2:172.21.15.203:3301,v1:172.21.15.203:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:33.111 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:33.111 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid 8cbda8ce-b993-4141-a43e-650fa7bfe1da 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = quincy 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 8cbda8ce-b993-4141-a43e-650fa7bfe1da 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2024-03-31T16:34:33.108523+0000 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-03-31T16:34:33.108523+0000 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 17 (quincy) 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:election_strategy: 1 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:2: [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] mon.c 2024-03-31T16:34:33.112 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-31T16:34:33.113 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-31T16:34:33.128 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8cbda8ce-b993-4141-a43e-650fa7bfe1da... 2024-03-31T16:34:33.128 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-31T16:34:33.170 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-31T16:34:33.218 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-03-31T16:34:33.218 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-03-31T16:34:33.218 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-31T16:34:33.218 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-03-31T16:34:33.218 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.218 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-31T16:34:33.219 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-03-31T16:34:33.220 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.221 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.120,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]" 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on skipped message = False 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 8cbda8ce-b993-4141-a43e-650fa7bfe1da 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-03-31T16:34:33.222 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-03-31T16:34:33.223 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-03-31T16:34:33.224 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-03-31T16:34:33.225 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: debug client = 20 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-03-31T16:34:33.226 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-31T16:34:33.227 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: mon down mkfs grace = 300 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: mon op complaint time = 120 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-31T16:34:33.228 INFO:teuthology.orchestra.run.smithi120.stdout: client mount timeout = 600 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout: debug client = 20 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = "" 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout: rados mon op timeout = 900 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout: rados osd op timeout = 900 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d] 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout:[mds] 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds = 20 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds balancer = 20 2024-03-31T16:34:33.229 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug frag = True 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug scatterstat = True 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi120.stdout: mds op complaint time = 180 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi120.stdout: mds verify scatter = True 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi120.stdout: rados mon op timeout = 900 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi120.stdout: rados osd op timeout = 900 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi203.stdout:[global] 2024-03-31T16:34:33.230 INFO:teuthology.orchestra.run.smithi203.stdout: chdir = "" 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: auth supported = cephx 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: filestore xattr use omap = true 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: mon clock drift allowed = 1.000 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: osd crush chooseleaf type = 0 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: auth debug = true 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on old message = true 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on bug = true 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.231 INFO:teuthology.orchestra.run.smithi203.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon pg warn max object skew = 0 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: # disable pg_autoscaler by default for new pools 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default size = 2 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow primary affinity = true 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow pg remap = true 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on legacy crush tunables = false 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on crush straw calc version zero = false 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on no sortbitwise = false 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on osd down out interval zero = false 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on too few osds = false 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-31T16:34:33.232 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: mon_allow_pool_size_one = true 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: osd default data pool replay window = 5 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: mon allow pool delete = true 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: mon cluster log file level = debug 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: debug asserts on shutdown = true 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: mon health detail to clog = false 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: mon host = "172.21.15.120,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]" 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on skipped message = False 2024-03-31T16:34:33.233 INFO:teuthology.orchestra.run.smithi203.stdout: fsid = 8cbda8ce-b993-4141-a43e-650fa7bfe1da 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout:[osd] 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd journal size = 100 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub load threshold = 5.0 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub max interval = 600 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd mclock profile = high_recovery_ops 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd recover clone overlap = true 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd recovery max chunk = 1048576 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug shutdown = true 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug op order = true 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify stray on activate = true 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug trim objects = true 2024-03-31T16:34:33.234 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: osd open classes on start = true 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug pg log writeout = true 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: osd deep scrub update digest min age = 30 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: osd map max advance = 10 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: journal zero on create = true 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: filestore ondisk finisher threads = 3 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: filestore apply finisher threads = 3 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: bdev debug aio = true 2024-03-31T16:34:33.235 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug misdirected ops = true 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: bdev async discard = True 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: bdev enable discard = True 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore allocator = bitmap 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore block size = 96636764160 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore fsck on mount = True 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluefs = 1/20 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluestore = 1/20 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: debug osd = 20 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: debug rocksdb = 4/10 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd backfillfull_ratio = 0.85 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd full ratio = 0.9 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd nearfull ratio = 0.8 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: osd failsafe full ratio = 0.95 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: osd objectstore = bluestore 2024-03-31T16:34:33.236 INFO:teuthology.orchestra.run.smithi203.stdout: osd op complaint time = 180 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr] 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug mgr = 20 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: mgr/telemetry/nag = false 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug client = 20 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout:[mon] 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug paxos = 20 2024-03-31T16:34:33.237 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: mon data avail warn = 5 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: mon mgr mkfs grace = 240 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd reporter subtree level = osd 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd prime pg temp = true 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: auth mon ticket ttl = 660 # 11m 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: auth service ticket ttl = 240 # 4m 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: # don't complain about insecure global_id in the test suite 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.238 INFO:teuthology.orchestra.run.smithi203.stdout: # 1m isn't quite enough 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: mon_down_mkfs_grace = 2m 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_filestore_osds = false 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: mon down mkfs grace = 300 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: mon op complaint time = 120 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout:[client] 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: rgw cache enabled = true 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable ops log = true 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable usage log = true 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: client mount timeout = 600 2024-03-31T16:34:33.239 INFO:teuthology.orchestra.run.smithi203.stdout: debug client = 20 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = "" 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: rados mon op timeout = 900 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: rados osd op timeout = 900 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.a] 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.b] 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.c] 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.a] 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.c] 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.b] 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.d] 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout:[mds] 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: debug mds = 20 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: debug mds balancer = 20 2024-03-31T16:34:33.240 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-03-31T16:34:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: mds debug frag = True 2024-03-31T16:34:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: mds debug scatterstat = True 2024-03-31T16:34:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: mds op complaint time = 180 2024-03-31T16:34:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: mds verify scatter = True 2024-03-31T16:34:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: osd op complaint time = 180 2024-03-31T16:34:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: rados mon op timeout = 900 2024-03-31T16:34:33.241 INFO:teuthology.orchestra.run.smithi203.stdout: rados osd op timeout = 900 2024-03-31T16:34:33.242 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-31T16:34:33.242 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-31T16:34:33.339 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-31T16:34:33.339 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:33.339 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-31T16:34:33.354 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:33.354 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-31T16:34:33.409 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-03-31T16:34:33.409 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:33.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-31T16:34:33.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-31T16:34:33.488 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:34:33.488 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:33.543 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi203.front.sepia.ceph.com 2024-03-31T16:34:33.543 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:34:33.543 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-31T16:34:33.543 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-31T16:34:33.585 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:34:33.585 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:33.642 INFO:tasks.ceph:Setting up mon nodes... 2024-03-31T16:34:33.669 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-31T16:34:33.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-31T16:34:33.724 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-31T16:34:33.726 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-31T16:34:33.789 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-31T16:34:33.792 INFO:tasks.ceph:Setting up mds nodes... 2024-03-31T16:34:33.792 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-31T16:34:33.847 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-31T16:34:33.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-31T16:34:33.875 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-31T16:34:33.969 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-31T16:34:33.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-31T16:34:33.998 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-31T16:34:34.054 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-31T16:34:34.056 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-31T16:34:34.083 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-31T16:34:34.178 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-31T16:34:34.180 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-31T16:34:34.207 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-31T16:34:34.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-31T16:34:34.249 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-31T16:34:34.265 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-31T16:34:34.347 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-31T16:34:34.362 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-31T16:34:34.404 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-31T16:34:34.420 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-31T16:34:34.502 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-31T16:34:34.518 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-31T16:34:34.518 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-31T16:34:34.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-31T16:34:34.544 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:34.544 INFO:tasks.ceph:role: osd.0 2024-03-31T16:34:34.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-03-31T16:34:34.545 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-31T16:34:34.618 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-31T16:34:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-31T16:34:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-31T16:34:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-31T16:34:34.618 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-31T16:34:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-03-31T16:34:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-31T16:34:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-31T16:34:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-31T16:34:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-31T16:34:35.122 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-03-31T16:34:35.124 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-03-31T16:34:35.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-31T16:34:35.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-31T16:34:35.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-31T16:34:35.367 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:35.367 INFO:tasks.ceph:role: osd.1 2024-03-31T16:34:35.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-03-31T16:34:35.367 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-31T16:34:35.442 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-31T16:34:35.443 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-31T16:34:35.892 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-03-31T16:34:35.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-03-31T16:34:35.894 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-31T16:34:35.993 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-31T16:34:36.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-31T16:34:36.093 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:36.093 INFO:tasks.ceph:role: osd.2 2024-03-31T16:34:36.093 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2024-03-31T16:34:36.094 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-31T16:34:36.168 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-31T16:34:36.168 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-31T16:34:36.168 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-31T16:34:36.168 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-31T16:34:36.168 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-31T16:34:36.169 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-03-31T16:34:36.169 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-31T16:34:36.169 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-31T16:34:36.169 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-31T16:34:36.169 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-31T16:34:36.663 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-03-31T16:34:36.665 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-03-31T16:34:36.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-31T16:34:36.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-31T16:34:36.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-31T16:34:36.907 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:36.908 INFO:tasks.ceph:role: osd.3 2024-03-31T16:34:36.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2024-03-31T16:34:36.908 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-31T16:34:36.982 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-31T16:34:36.983 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-31T16:34:37.503 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-03-31T16:34:37.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-03-31T16:34:37.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-31T16:34:37.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-31T16:34:37.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:37.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:37.785+0000 7ff088fac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-31T16:34:37.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:37.785+0000 7ff088fac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-31T16:34:37.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:37.785+0000 7ff088fac640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-31T16:34:37.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:37.785+0000 7ff088fac640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-31T16:34:37.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:37.785+0000 7ff088fac640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-31T16:34:37.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:37.786+0000 7ff088fac640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-31T16:34:40.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-31T16:34:40.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:40.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:40.764+0000 7f4fdd048640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-31T16:34:40.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:40.765+0000 7f4fdd048640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-31T16:34:40.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:40.765+0000 7f4fdd048640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-31T16:34:40.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:40.765+0000 7f4fdd048640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-31T16:34:40.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:40.765+0000 7f4fdd048640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-31T16:34:40.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:40.765+0000 7f4fdd048640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-31T16:34:43.618 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-31T16:34:43.647 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:43.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:43.730+0000 7f2212e10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-31T16:34:43.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:43.730+0000 7f2212e10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-31T16:34:43.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:43.730+0000 7f2212e10640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-31T16:34:43.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:43.730+0000 7f2212e10640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-31T16:34:43.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:43.730+0000 7f2212e10640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-31T16:34:43.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:43.731+0000 7f2212e10640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-31T16:34:46.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-31T16:34:46.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:46.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:46.706+0000 7f0913914640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-31T16:34:46.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:46.706+0000 7f0913914640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-31T16:34:46.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:46.706+0000 7f0913914640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-31T16:34:46.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:46.706+0000 7f0913914640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-31T16:34:46.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:46.706+0000 7f0913914640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-31T16:34:46.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:34:46.707+0000 7f0913914640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-31T16:34:49.568 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-31T16:34:49.598 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-31T16:34:49.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:49.630 INFO:tasks.ceph:role: osd.4 2024-03-31T16:34:49.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com 2024-03-31T16:34:49.631 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-31T16:34:49.709 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-31T16:34:50.222 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-03-31T16:34:50.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-03-31T16:34:50.225 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-31T16:34:50.350 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-31T16:34:50.387 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-31T16:34:50.456 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:50.456 INFO:tasks.ceph:role: osd.5 2024-03-31T16:34:50.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com 2024-03-31T16:34:50.456 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-31T16:34:50.532 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-31T16:34:50.533 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-31T16:34:50.987 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-03-31T16:34:50.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-03-31T16:34:50.987 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-31T16:34:51.076 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-31T16:34:51.108 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-31T16:34:51.177 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:51.177 INFO:tasks.ceph:role: osd.6 2024-03-31T16:34:51.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com 2024-03-31T16:34:51.177 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-31T16:34:51.251 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-31T16:34:51.252 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-31T16:34:51.742 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-03-31T16:34:51.743 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-03-31T16:34:51.744 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-31T16:34:51.892 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-31T16:34:51.923 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-31T16:34:51.990 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-31T16:34:51.990 INFO:tasks.ceph:role: osd.7 2024-03-31T16:34:51.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi203.front.sepia.ceph.com 2024-03-31T16:34:51.990 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-31T16:34:52.065 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-31T16:34:52.066 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-31T16:34:52.594 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-03-31T16:34:52.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-03-31T16:34:52.597 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-31T16:34:52.730 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-31T16:34:52.764 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:52.859 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:52.855+0000 7f071a521640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-31T16:34:52.859 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:52.855+0000 7f071a521640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-31T16:34:52.859 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:52.855+0000 7f071a521640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-31T16:34:52.859 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:52.855+0000 7f071a521640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-31T16:34:52.859 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:52.855+0000 7f071a521640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-31T16:34:52.859 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:52.856+0000 7f071a521640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-31T16:34:55.716 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-31T16:34:55.748 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:55.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:55.837+0000 7fd20e0c8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-31T16:34:55.842 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:55.838+0000 7fd20e0c8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-31T16:34:55.842 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:55.838+0000 7fd20e0c8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-31T16:34:55.842 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:55.838+0000 7fd20e0c8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-31T16:34:55.842 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:55.838+0000 7fd20e0c8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-31T16:34:55.842 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:55.838+0000 7fd20e0c8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-31T16:34:58.695 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-31T16:34:58.727 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:34:58.819 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:58.814+0000 7f7a2a611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-31T16:34:58.819 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:58.814+0000 7f7a2a611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-31T16:34:58.819 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:58.814+0000 7f7a2a611640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-31T16:34:58.819 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:58.814+0000 7f7a2a611640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-31T16:34:58.819 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:58.814+0000 7f7a2a611640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-31T16:34:58.819 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:34:58.815+0000 7f7a2a611640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-31T16:35:01.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:35:01.229 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:35:01.672 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-31T16:35:01.703 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:35:01.793 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:01.788+0000 7fb234804640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-31T16:35:01.793 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:01.789+0000 7fb234804640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-31T16:35:01.793 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:01.789+0000 7fb234804640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-31T16:35:01.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:01.789+0000 7fb234804640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-31T16:35:01.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:01.789+0000 7fb234804640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-31T16:35:01.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:01.789+0000 7fb234804640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-31T16:35:04.646 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-31T16:35:04.707 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-31T16:35:04.708 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:04.708 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-31T16:35:04.740 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:04.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-31T16:35:04.811 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:04.811 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-31T16:35:04.881 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:04.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-31T16:35:04.950 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:04.951 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-31T16:35:05.020 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:05.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-31T16:35:05.089 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:05.089 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-31T16:35:05.157 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.157 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-31T16:35:05.190 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.190 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-31T16:35:05.261 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.262 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-31T16:35:05.332 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.332 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-31T16:35:05.400 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.401 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-31T16:35:05.469 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.469 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-31T16:35:05.537 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.537 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-31T16:35:05.605 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:05.605 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-31T16:35:05.622 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:05.622 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-31T16:35:05.679 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.679 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-31T16:35:05.695 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:05.695 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-31T16:35:05.750 INFO:tasks.ceph:Adding keys to all mons... 2024-03-31T16:35:05.751 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-31T16:35:05.753 DEBUG:teuthology.orchestra.run.smithi203:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-31T16:35:05.794 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2024-03-31T16:35:05.794 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCZkAlmHrP4KhAA5ImEIJ5uCV5YTuxxPsLsIQ== 2024-03-31T16:35:05.794 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCZkAlmxexOMhAAxTUbZ7OmZjfYe4VqV7ohbw== 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCZkAlmTNmgORAAm5NQ2b9Txcppx7bD+giykw== 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCdkAlmhynYLhAAxmA5w/sU3IEvJ8b6ICchQw== 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCgkAlm7ESpLRAAXruKdYeQEqCsyWGtuj9FxQ== 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCjkAlmdBOeKxAAmOCDp3t3DWkECjn5CoA1Iw== 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-03-31T16:35:05.795 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCmkAlm8AYsKhAACJCojiW+hFv1X4VB5A6dTw== 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCZkAlmm5riLhAAjLr9oFjkdjVLXk1mhohfEQ== 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCakAlmJbEQAxAAGL+jqmbvGToTvNoI4Fm0Bw== 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d] 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCakAlmsKZvChAA5K5/JOjsF5BbG2AhAPLgtw== 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCskAlmZFL/MhAAFsoGo7npDE1JBMyealieXQ== 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCvkAlmTYb3MRAAO+Q3olp3y28msJJmk+ULIw== 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCykAlmYJ6hMBAARRs6KOWP243iHTOqL+rhFg== 2024-03-31T16:35:05.796 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQC1kAlmu5QZLxAACVpUUkSfAg+WQTRKokbFHg== 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCakAlm7s+2DhAAf4okmBd2QJxliS57iZYpYA== 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout:[client.2] 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCakAlm7gaDFBAA51xcpsXhxLPyiDSOnPEq9g== 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCakAlmvE3xFxAAITAIXc2BDoyf/yK5YNaesA== 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout:[client.3] 2024-03-31T16:35:05.797 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCakAlmwITKHRAAkk5mBqTz30JU9Sa74aVN5A== 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.y] 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCZkAlmHrP4KhAA5ImEIJ5uCV5YTuxxPsLsIQ== 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.a] 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCZkAlmxexOMhAAxTUbZ7OmZjfYe4VqV7ohbw== 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.c] 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCZkAlmTNmgORAAm5NQ2b9Txcppx7bD+giykw== 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.0] 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCdkAlmhynYLhAAxmA5w/sU3IEvJ8b6ICchQw== 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.1] 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCgkAlm7ESpLRAAXruKdYeQEqCsyWGtuj9FxQ== 2024-03-31T16:35:05.817 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.2] 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCjkAlmdBOeKxAAmOCDp3t3DWkECjn5CoA1Iw== 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.3] 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCmkAlm8AYsKhAACJCojiW+hFv1X4VB5A6dTw== 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.x] 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCZkAlmm5riLhAAjLr9oFjkdjVLXk1mhohfEQ== 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.b] 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCakAlmJbEQAxAAGL+jqmbvGToTvNoI4Fm0Bw== 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.d] 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCakAlmsKZvChAA5K5/JOjsF5BbG2AhAPLgtw== 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.4] 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCskAlmZFL/MhAAFsoGo7npDE1JBMyealieXQ== 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.5] 2024-03-31T16:35:05.818 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCvkAlmTYb3MRAAO+Q3olp3y28msJJmk+ULIw== 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.6] 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCykAlmYJ6hMBAARRs6KOWP243iHTOqL+rhFg== 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.7] 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQC1kAlmu5QZLxAACVpUUkSfAg+WQTRKokbFHg== 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout:[client.0] 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCakAlm7s+2DhAAf4okmBd2QJxliS57iZYpYA== 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout:[client.2] 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCakAlm7gaDFBAA51xcpsXhxLPyiDSOnPEq9g== 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout:[client.1] 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCakAlmvE3xFxAAITAIXc2BDoyf/yK5YNaesA== 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout:[client.3] 2024-03-31T16:35:05.819 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQCakAlmwITKHRAAkk5mBqTz30JU9Sa74aVN5A== 2024-03-31T16:35:05.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-31T16:35:05.841 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-31T16:35:05.912 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-31T16:35:05.915 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-31T16:35:05.971 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-31T16:35:05.973 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-31T16:35:06.028 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.031 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.085 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.139 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.191 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.193 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-31T16:35:06.247 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-31T16:35:06.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-31T16:35:06.301 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-31T16:35:06.357 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-31T16:35:06.360 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-31T16:35:06.415 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.417 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.469 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.472 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.526 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.578 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.580 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-31T16:35:06.632 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-31T16:35:06.635 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-31T16:35:06.689 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-31T16:35:06.693 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-31T16:35:06.751 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-31T16:35:06.753 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-31T16:35:06.808 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-31T16:35:06.811 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-31T16:35:06.865 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-31T16:35:06.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-31T16:35:06.892 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-31T16:35:06.989 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-31T16:35:07.016 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-31T16:35:07.043 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-31T16:35:07.141 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-31T16:35:07.167 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-31T16:35:07.234 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-31T16:35:07.332 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-31T16:35:07.362 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:35:07.364 DEBUG:teuthology.orchestra.run.smithi203:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-31T16:35:07.417 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-31T16:35:07.417 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-31T16:35:07.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-31T16:35:07.419 INFO:tasks.ceph.mon.a:Started 2024-03-31T16:35:07.419 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-31T16:35:07.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-31T16:35:07.459 INFO:tasks.ceph.mon.b:Started 2024-03-31T16:35:07.460 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-31T16:35:07.460 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-31T16:35:07.462 INFO:tasks.ceph.mon.c:Started 2024-03-31T16:35:07.462 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-31T16:35:07.462 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-31T16:35:07.462 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-31T16:35:07.464 INFO:tasks.ceph.mgr.y:Started 2024-03-31T16:35:07.465 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-31T16:35:07.465 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-31T16:35:07.466 INFO:tasks.ceph.mgr.x:Started 2024-03-31T16:35:07.467 INFO:tasks.ceph:Setting crush tunables to default 2024-03-31T16:35:07.467 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2024-03-31T16:35:07.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.563+0000 7ff6f0f5f640 1 Processor -- start 2024-03-31T16:35:07.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.563+0000 7ff6f0f5f640 1 -- start start 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6f0f5f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 0x7ff6ec0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6f0f5f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 0x7ff6ec0d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6f0f5f640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6ec0cf6c0 con 0x7ff6ec15f6e0 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6f0f5f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff6ec0cf9a0 con 0x7ff6ec0d2110 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6f0f5f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ec0cfc80 con 0x7ff6ec0d0e70 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6ead9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 0x7ff6ec0d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6ead9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 0x7ff6ec0d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33740/0 (socket says 172.21.15.120:33740) 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6ead9d640 1 -- 172.21.15.120:0/832145463 learned_addr learned my addr 172.21.15.120:0/832145463 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.564+0000 7ff6ea59c640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 0x7ff6ec0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.565+0000 7ff6ead9d640 1 -- 172.21.15.120:0/832145463 >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 msgr2=0x7ff6ec0d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-31T16:35:07.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.565+0000 7ff6ead9d640 1 -- 172.21.15.120:0/832145463 >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 msgr2=0x7ff6ec0d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-31T16:35:07.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.565+0000 7ff6ead9d640 1 --2- 172.21.15.120:0/832145463 >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 0x7ff6ec0d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-31T16:35:07.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.565+0000 7ff6ea59c640 1 -- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 msgr2=0x7ff6ec0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-31T16:35:07.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.565+0000 7ff6ea59c640 1 -- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 msgr2=0x7ff6ec0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-31T16:35:07.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.565+0000 7ff6ea59c640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 0x7ff6ec0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-31T16:35:07.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.565+0000 7ff6ead9d640 1 --2- 172.21.15.120:0/832145463 >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 0x7ff6ec0d25a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T16:35:07.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.565+0000 7ff6ea59c640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 0x7ff6ec0cf050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-31T16:35:07.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.717+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163816637 0 0) 0x7ff6ec0cf6c0 con 0x7ff6ec15f6e0 2024-03-31T16:35:07.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.717+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d8003520 con 0x7ff6ec15f6e0 2024-03-31T16:35:07.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1849276843 0 0) 0x7ff6d8003520 con 0x7ff6ec15f6e0 2024-03-31T16:35:07.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 msgr2=0x7ff6ec0cf050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-31T16:35:07.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 0x7ff6ec0cf050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 msgr2=0x7ff6ec0d25a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 --2- 172.21.15.120:0/832145463 >> v2:172.21.15.120:3300/0 conn(0x7ff6ec0d2110 0x7ff6ec0d25a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec0cff60 con 0x7ff6ec15f6e0 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7ff6d4001670 con 0x7ff6ec15f6e0 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 >> v1:172.21.15.203:6789/0 conn(0x7ff6ec15f6e0 legacy=0x7ff6ec0d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d80039b0 0x7ff6d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 0x7ff6d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d8004d40 0x7ff6d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0cf9a0 con 0x7ff6d8004d40 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec0cfc80 con 0x7ff6d80039b0 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d800bb20 con 0x7ff6ec0d0e70 2024-03-31T16:35:07.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6ead9d640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d8004d40 0x7ff6d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6e1d9b640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 0x7ff6d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6ea59c640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d80039b0 0x7ff6d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6ead9d640 1 -- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 msgr2=0x7ff6d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6ead9d640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec0d0e70 0x7ff6d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6ead9d640 1 -- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d80039b0 msgr2=0x7ff6d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6ead9d640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d80039b0 0x7ff6d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.719+0000 7ff6ead9d640 1 -- 172.21.15.120:0/832145463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d8003520 con 0x7ff6d8004d40 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.720+0000 7ff6ead9d640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d8004d40 0x7ff6d80051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009cc0 tx=0x7ff6d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2860cbf9351dec server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.720+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4032070 con 0x7ff6d8004d40 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.720+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e402cb10 con 0x7ff6d8004d40 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.720+0000 7ff6e9d9b640 1 -- 172.21.15.120:0/832145463 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40098c0 con 0x7ff6d8004d40 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.721+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/832145463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d8004d40 msgr2=0x7ff6d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:07.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.721+0000 7ff6f0f5f640 1 --2- 172.21.15.120:0/832145463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d8004d40 0x7ff6d80051c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009cc0 tx=0x7ff6d8005830 comp rx=0 tx=0).stop 2024-03-31T16:35:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.721+0000 7ff6ead9d640 1 -- 172.21.15.120:0/832145463 reap_dead start 2024-03-31T16:35:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.721+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/832145463 shutdown_connections 2024-03-31T16:35:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.721+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/832145463 >> 172.21.15.120:0/832145463 conn(0x7ff6ec08bfb0 msgr2=0x7ff6ec0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.721+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/832145463 shutdown_connections 2024-03-31T16:35:07.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.721+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/832145463 wait complete. 2024-03-31T16:35:07.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.722+0000 7ff6f0f5f640 1 Processor -- start 2024-03-31T16:35:07.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6f0f5f640 1 -- start start 2024-03-31T16:35:07.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6f0f5f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d8004d40 0x7ff6ec06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6f0f5f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6ec0a14a0 0x7ff6ec0a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6f0f5f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec15b120 0x7ff6ec15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6f0f5f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec15e910 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6f0f5f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec15fb40 con 0x7ff6d8004d40 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6f0f5f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ec15ea90 con 0x7ff6ec15b120 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6e1d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6ec0a14a0 0x7ff6ec0a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6e1d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6ec0a14a0 0x7ff6ec0a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33750/0 (socket says 172.21.15.120:33750) 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6e1d9b640 1 -- 172.21.15.120:0/2372487518 learned_addr learned my addr 172.21.15.120:0/2372487518 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6ead9d640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec15b120 0x7ff6ec15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.723+0000 7ff6ea59c640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d8004d40 0x7ff6ec06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e1d9b640 1 -- 172.21.15.120:0/2372487518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec15b120 msgr2=0x7ff6ec15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e1d9b640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec15b120 0x7ff6ec15b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e1d9b640 1 -- 172.21.15.120:0/2372487518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d8004d40 msgr2=0x7ff6ec06d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e1d9b640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d8004d40 0x7ff6ec06d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e1d9b640 1 -- 172.21.15.120:0/2372487518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec15bac0 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e1d9b640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6ec0a14a0 0x7ff6ec0a1920 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400fae0 tx=0x7ff6d4001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e37fe640 1 -- 172.21.15.120:0/2372487518 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40052e0 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e37fe640 1 -- 172.21.15.120:0/2372487518 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4018070 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec0a1f90 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e37fe640 1 -- 172.21.15.120:0/2372487518 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400da30 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec0b33a0 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e37fe640 1 -- 172.21.15.120:0/2372487518 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff6d400dbd0 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.724+0000 7ff6e37fe640 1 -- 172.21.15.120:0/2372487518 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff6d401d550 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.725+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec068cd0 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.727+0000 7ff6e37fe640 1 -- 172.21.15.120:0/2372487518 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff6ec15bac0 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.793+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff6ec0d1b80 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.795+0000 7ff6e37fe640 1 -- 172.21.15.120:0/2372487518 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff6d40035f0 con 0x7ff6ec0a14a0 2024-03-31T16:35:07.799 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-03-31T16:35:07.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6ec0a14a0 msgr2=0x7ff6ec0a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:07.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6ec0a14a0 0x7ff6ec0a1920 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400fae0 tx=0x7ff6d4001690 comp rx=0 tx=0).stop 2024-03-31T16:35:07.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 shutdown_connections 2024-03-31T16:35:07.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6ec15b120 0x7ff6ec15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6ec0a14a0 0x7ff6ec0a1920 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 --2- 172.21.15.120:0/2372487518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d8004d40 0x7ff6ec06d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:07.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 >> 172.21.15.120:0/2372487518 conn(0x7ff6ec08bfb0 msgr2=0x7ff6ec0c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:07.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 shutdown_connections 2024-03-31T16:35:07.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:07.796+0000 7ff6f0f5f640 1 -- 172.21.15.120:0/2372487518 wait complete. 2024-03-31T16:35:07.811 INFO:tasks.ceph:check_enable_crimson: False 2024-03-31T16:35:07.811 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-31T16:35:07.811 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:07.811 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-31T16:35:07.838 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:07.838 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-31T16:35:07.905 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:07.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-31T16:35:07.972 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:07.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-31T16:35:08.039 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:08.039 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-31T16:35:08.067 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:08.067 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-31T16:35:08.134 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:08.134 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-31T16:35:08.187 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:08.183+0000 7f158a62e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T16:35:08.201 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:08.201 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-31T16:35:08.211 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:08.207+0000 7f6c20e2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-31T16:35:08.244 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:08.239+0000 7f158a62e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T16:35:08.263 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:08.259+0000 7f6c20e2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-31T16:35:08.268 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa 0 2024-03-31T16:35:08.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.404+0000 7febc4ed6640 1 Processor -- start 2024-03-31T16:35:08.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.404+0000 7febc4ed6640 1 -- start start 2024-03-31T16:35:08.410 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febc4ed6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc00b0670 0x7febc015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.410 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febc4ed6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7febc0070120 0x7febc006b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.410 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febc4ed6640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7febc006e770 0x7febc006bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.410 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febc4ed6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7febc00b63e0 con 0x7febc0070120 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febc4ed6640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7febc006c3f0 con 0x7febc006e770 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febc4ed6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7febc00b5b10 con 0x7febc00b0670 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbe59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc00b0670 0x7febc015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbed9d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7febc006e770 0x7febc006bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbe59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc00b0670 0x7febc015f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:33818/0 (socket says 172.21.15.203:33818) 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbe59c640 1 -- 172.21.15.203:0/2097925850 learned_addr learned my addr 172.21.15.203:0/2097925850 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbdd9b640 1 --2- 172.21.15.203:0/2097925850 >> v2:172.21.15.120:3300/0 conn(0x7febc0070120 0x7febc006b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbed9d640 1 -- 172.21.15.203:0/2097925850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc00b0670 msgr2=0x7febc015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbed9d640 1 --2- 172.21.15.203:0/2097925850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc00b0670 0x7febc015f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbed9d640 1 -- 172.21.15.203:0/2097925850 >> v2:172.21.15.120:3300/0 conn(0x7febc0070120 msgr2=0x7febc006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.405+0000 7febbed9d640 1 --2- 172.21.15.203:0/2097925850 >> v2:172.21.15.120:3300/0 conn(0x7febc0070120 0x7febc006b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.406+0000 7febbed9d640 1 -- 172.21.15.203:0/2097925850 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc015fdf0 con 0x7febc006e770 2024-03-31T16:35:08.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.406+0000 7febbe59c640 1 --2- 172.21.15.203:0/2097925850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc00b0670 0x7febc015f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:08.413 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.406+0000 7febbed9d640 1 --2- 172.21.15.203:0/2097925850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc006e770 0x7febc006bab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febc0072660 tx=0x7febb802be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c6b305910c4672 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:08.413 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.406+0000 7febbd59a640 1 -- 172.21.15.203:0/2097925850 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8039070 con 0x7febc006e770 2024-03-31T16:35:08.413 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.406+0000 7febbd59a640 1 -- 172.21.15.203:0/2097925850 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb802cbd0 con 0x7febc006e770 2024-03-31T16:35:08.413 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.406+0000 7febbd59a640 1 -- 172.21.15.203:0/2097925850 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8034440 con 0x7febc006e770 2024-03-31T16:35:08.413 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 -- 172.21.15.203:0/2097925850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc006e770 msgr2=0x7febc006bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.413 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 --2- 172.21.15.203:0/2097925850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc006e770 0x7febc006bab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febc0072660 tx=0x7febb802be20 comp rx=0 tx=0).stop 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 -- 172.21.15.203:0/2097925850 shutdown_connections 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 --2- 172.21.15.203:0/2097925850 >> v2:172.21.15.120:3300/0 conn(0x7febc0070120 0x7febc006b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 --2- 172.21.15.203:0/2097925850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc006e770 0x7febc006bab0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 --2- 172.21.15.203:0/2097925850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc00b0670 0x7febc015f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 -- 172.21.15.203:0/2097925850 >> 172.21.15.203:0/2097925850 conn(0x7febc00b65a0 msgr2=0x7febc00b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 -- 172.21.15.203:0/2097925850 shutdown_connections 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.407+0000 7febc4ed6640 1 -- 172.21.15.203:0/2097925850 wait complete. 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.408+0000 7febc4ed6640 1 Processor -- start 2024-03-31T16:35:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.408+0000 7febc4ed6640 1 -- start start 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febc4ed6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc006e770 0x7febc0151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febc4ed6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc0070120 0x7febc00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febc4ed6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc00b0670 0x7febc01511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febc4ed6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7febc00b6070 con 0x7febc00b0670 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febc4ed6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7febc00b5d90 con 0x7febc0070120 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febc4ed6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7febc00b0a50 con 0x7febc006e770 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbe59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc006e770 0x7febc0151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbe59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc006e770 0x7febc0151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:33832/0 (socket says 172.21.15.203:33832) 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbdd9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc0070120 0x7febc00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbe59c640 1 -- 172.21.15.203:0/1114287194 learned_addr learned my addr 172.21.15.203:0/1114287194 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbed9d640 1 --2- 172.21.15.203:0/1114287194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc00b0670 0x7febc01511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbe59c640 1 -- 172.21.15.203:0/1114287194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc0070120 msgr2=0x7febc00cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbe59c640 1 --2- 172.21.15.203:0/1114287194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc0070120 0x7febc00cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbe59c640 1 -- 172.21.15.203:0/1114287194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc00b0670 msgr2=0x7febc01511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.409+0000 7febbe59c640 1 --2- 172.21.15.203:0/1114287194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc00b0670 0x7febc01511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febbe59c640 1 -- 172.21.15.203:0/1114287194 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc0151700 con 0x7febc006e770 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febbe59c640 1 --2- 172.21.15.203:0/1114287194 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc006e770 0x7febc0151910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7febb400e9b0 tx=0x7febb400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febaeffd640 1 -- 172.21.15.203:0/1114287194 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4017070 con 0x7febc006e770 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febaeffd640 1 -- 172.21.15.203:0/1114287194 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb400c9a0 con 0x7febc006e770 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc00cf130 con 0x7febc006e770 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febaeffd640 1 -- 172.21.15.203:0/1114287194 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb400cd50 con 0x7febc006e770 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7febc00cf6b0 con 0x7febc006e770 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febaeffd640 1 -- 172.21.15.203:0/1114287194 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7febb401a070 con 0x7febc006e770 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.410+0000 7febaeffd640 1 -- 172.21.15.203:0/1114287194 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7febb4013470 con 0x7febc006e770 2024-03-31T16:35:08.418 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.411+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc0068cd0 con 0x7febc006e770 2024-03-31T16:35:08.419 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.413+0000 7febaeffd640 1 -- 172.21.15.203:0/1114287194 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7febb4005990 con 0x7febc006e770 2024-03-31T16:35:08.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.484+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa", "id": 0} v 0) -- 0x7febc006b700 con 0x7febc006e770 2024-03-31T16:35:08.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.487+0000 7febaeffd640 1 -- 172.21.15.203:0/1114287194 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7febb4005b70 con 0x7febc006e770 2024-03-31T16:35:08.492 INFO:teuthology.orchestra.run.smithi203.stdout:0 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc006e770 msgr2=0x7febc0151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 --2- 172.21.15.203:0/1114287194 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc006e770 0x7febc0151910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7febb400e9b0 tx=0x7febb400ee70 comp rx=0 tx=0).stop 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 shutdown_connections 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 --2- 172.21.15.203:0/1114287194 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febc00b0670 0x7febc01511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 --2- 172.21.15.203:0/1114287194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7febc0070120 0x7febc00cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 --2- 172.21.15.203:0/1114287194 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7febc006e770 0x7febc0151910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 >> 172.21.15.203:0/1114287194 conn(0x7febc00b65a0 msgr2=0x7febc00b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 shutdown_connections 2024-03-31T16:35:08.493 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.488+0000 7febc4ed6640 1 -- 172.21.15.203:0/1114287194 wait complete. 2024-03-31T16:35:08.503 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 19d8fd82-e322-48f0-bf0a-30e178c1bc70 1 2024-03-31T16:35:08.604 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.600+0000 7f7a68bf6640 1 Processor -- start 2024-03-31T16:35:08.605 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.600+0000 7f7a68bf6640 1 -- start start 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a68bf6640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7a640d43d0 0x7f7a640d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a68bf6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a640cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a68bf6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a640d4d20 con 0x7f7a6415e860 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a68bf6640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7a640cf220 con 0x7f7a640d43d0 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a68bf6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6406dfa0 con 0x7f7a640cf6b0 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a62d9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a640cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a5bfff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7a640d43d0 0x7f7a640d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a62d9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a640cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:33836/0 (socket says 172.21.15.203:33836) 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a6259c640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f7a6415e860 0x7f7a6406d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52430/0 (socket says 172.21.15.203:52430) 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a5bfff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7a640d43d0 0x7f7a640d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:39618/0 (socket says 172.21.15.203:39618) 2024-03-31T16:35:08.607 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a62d9d640 1 -- 172.21.15.203:0/4261953424 learned_addr learned my addr 172.21.15.203:0/4261953424 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a5bfff640 1 -- 172.21.15.203:0/4261953424 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 msgr2=0x7f7a640cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a5bfff640 1 --2- 172.21.15.203:0/4261953424 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a640cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a5bfff640 1 -- 172.21.15.203:0/4261953424 >> v1:172.21.15.203:6789/0 conn(0x7f7a6415e860 legacy=0x7f7a6406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a5bfff640 1 -- 172.21.15.203:0/4261953424 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6406e240 con 0x7f7a640d43d0 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a61d9b640 1 -- 172.21.15.203:0/4261953424 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679260518 0 0) 0x7f7a54001110 con 0x7f7a6415e860 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.601+0000 7f7a62d9d640 1 --2- 172.21.15.203:0/4261953424 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a640cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.602+0000 7f7a5bfff640 1 --2- 172.21.15.203:0/4261953424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640d47e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097a0 tx=0x7f7a4c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb3f5f640e3a585 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.602+0000 7f7a61d9b640 1 -- 172.21.15.203:0/4261953424 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c035020 con 0x7f7a640d43d0 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.602+0000 7f7a61d9b640 1 -- 172.21.15.203:0/4261953424 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c031830 con 0x7f7a640d43d0 2024-03-31T16:35:08.608 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.602+0000 7f7a61d9b640 1 -- 172.21.15.203:0/4261953424 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c031c00 con 0x7f7a640d43d0 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.603+0000 7f7a68bf6640 1 -- 172.21.15.203:0/4261953424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 msgr2=0x7f7a640d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.603+0000 7f7a68bf6640 1 --2- 172.21.15.203:0/4261953424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640d47e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097a0 tx=0x7f7a4c02b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.603+0000 7f7a68bf6640 1 -- 172.21.15.203:0/4261953424 shutdown_connections 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.603+0000 7f7a68bf6640 1 --2- 172.21.15.203:0/4261953424 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a640cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.603+0000 7f7a68bf6640 1 --2- 172.21.15.203:0/4261953424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640d47e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.603+0000 7f7a68bf6640 1 -- 172.21.15.203:0/4261953424 >> 172.21.15.203:0/4261953424 conn(0x7f7a6409d7d0 msgr2=0x7f7a6408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.603+0000 7f7a68bf6640 1 -- 172.21.15.203:0/4261953424 shutdown_connections 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.603+0000 7f7a68bf6640 1 -- 172.21.15.203:0/4261953424 wait complete. 2024-03-31T16:35:08.612 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.604+0000 7f7a68bf6640 1 Processor -- start 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.604+0000 7f7a68bf6640 1 -- start start 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a68bf6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a6415d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a68bf6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a68bf6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6415e860 0x7f7a641f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a68bf6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6406dc00 con 0x7f7a6415e860 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a68bf6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a640d2c50 con 0x7f7a640d43d0 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a68bf6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6406dd80 con 0x7f7a640cf6b0 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a6259c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a6415d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a5bfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a5bfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:39622/0 (socket says 172.21.15.203:39622) 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a5bfff640 1 -- 172.21.15.203:0/2264481126 learned_addr learned my addr 172.21.15.203:0/2264481126 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a62d9d640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6415e860 0x7f7a641f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.613 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a6259c640 1 -- 172.21.15.203:0/2264481126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 msgr2=0x7f7a640cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a6259c640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a6259c640 1 -- 172.21.15.203:0/2264481126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6415e860 msgr2=0x7f7a641f76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a6259c640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6415e860 0x7f7a641f76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a6259c640 1 -- 172.21.15.203:0/2264481126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a640c9090 con 0x7f7a640cf6b0 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a5bfff640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a62d9d640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6415e860 0x7f7a641f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.605+0000 7f7a6259c640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a6415d500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400c3e0 tx=0x7f7a5400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.606+0000 7f7a5affd640 1 -- 172.21.15.203:0/2264481126 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a540074e0 con 0x7f7a640cf6b0 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.606+0000 7f7a5affd640 1 -- 172.21.15.203:0/2264481126 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a540047e0 con 0x7f7a640cf6b0 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.606+0000 7f7a5affd640 1 -- 172.21.15.203:0/2264481126 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54004bd0 con 0x7f7a640cf6b0 2024-03-31T16:35:08.614 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.606+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a640c9370 con 0x7f7a640cf6b0 2024-03-31T16:35:08.615 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.606+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a640c9930 con 0x7f7a640cf6b0 2024-03-31T16:35:08.615 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.606+0000 7f7a5affd640 1 -- 172.21.15.203:0/2264481126 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7a5401a020 con 0x7f7a640cf6b0 2024-03-31T16:35:08.615 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.606+0000 7f7a5affd640 1 -- 172.21.15.203:0/2264481126 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f7a5401ca90 con 0x7f7a640cf6b0 2024-03-31T16:35:08.615 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.607+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a640685c0 con 0x7f7a640cf6b0 2024-03-31T16:35:08.615 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.610+0000 7f7a5affd640 1 -- 172.21.15.203:0/2264481126 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7a54021070 con 0x7f7a640cf6b0 2024-03-31T16:35:08.686 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.682+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "19d8fd82-e322-48f0-bf0a-30e178c1bc70", "id": 1} v 0) -- 0x7f7a6406b570 con 0x7f7a640cf6b0 2024-03-31T16:35:08.690 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.685+0000 7f7a5affd640 1 -- 172.21.15.203:0/2264481126 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19d8fd82-e322-48f0-bf0a-30e178c1bc70", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f7a640d4d20 con 0x7f7a640cf6b0 2024-03-31T16:35:08.690 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 msgr2=0x7f7a6415d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a6415d500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400c3e0 tx=0x7f7a5400c8a0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 shutdown_connections 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a6415e860 0x7f7a641f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a640d43d0 0x7f7a640cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 --2- 172.21.15.203:0/2264481126 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a640cf6b0 0x7f7a6415d500 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 >> 172.21.15.203:0/2264481126 conn(0x7f7a6409d7d0 msgr2=0x7f7a640b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 shutdown_connections 2024-03-31T16:35:08.691 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.686+0000 7f7a68bf6640 1 -- 172.21.15.203:0/2264481126 wait complete. 2024-03-31T16:35:08.701 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new a45d7996-2f81-4a76-b1e1-05d72b6c8be6 2 2024-03-31T16:35:08.794 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:08.790+0000 7f6c20e2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T16:35:08.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.800+0000 7f6c58d74640 1 Processor -- start 2024-03-31T16:35:08.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.800+0000 7f6c58d74640 1 -- start start 2024-03-31T16:35:08.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c58d74640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6c5415e7b0 0x7f6c540b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c58d74640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c540d01a0 con 0x7f6c540d1d70 2024-03-31T16:35:08.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c58d74640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c540d0480 con 0x7f6c540c7810 2024-03-31T16:35:08.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c58d74640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f6c540d1240 con 0x7f6c5415e7b0 2024-03-31T16:35:08.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c52d9d640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f6c540c7810 0x7f6c5406ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52436/0 (socket says 172.21.15.203:52436) 2024-03-31T16:35:08.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c52d9d640 1 -- 172.21.15.203:0/1615217261 learned_addr learned my addr 172.21.15.203:0/1615217261 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-03-31T16:35:08.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c5259c640 1 --2- 172.21.15.203:0/1615217261 >> v2:172.21.15.120:3300/0 conn(0x7f6c5415e7b0 0x7f6c540b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c51d9b640 1 -- 172.21.15.203:0/1615217261 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536523769 0 0) 0x7f6c540d0480 con 0x7f6c540c7810 2024-03-31T16:35:08.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.801+0000 7f6c51d9b640 1 -- 172.21.15.203:0/1615217261 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c40003520 con 0x7f6c540c7810 2024-03-31T16:35:08.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.802+0000 7f6c5259c640 1 -- 172.21.15.203:0/1615217261 >> v1:172.21.15.203:6789/0 conn(0x7f6c540c7810 legacy=0x7f6c5406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.802+0000 7f6c5259c640 1 -- 172.21.15.203:0/1615217261 >> v1:172.21.15.120:6789/0 conn(0x7f6c540d1d70 legacy=0x7f6c540c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.802+0000 7f6c5259c640 1 -- 172.21.15.203:0/1615217261 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c540d0760 con 0x7f6c5415e7b0 2024-03-31T16:35:08.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.802+0000 7f6c51d9b640 1 -- 172.21.15.203:0/1615217261 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132554090 0 0) 0x7f6c540d01a0 con 0x7f6c540d1d70 2024-03-31T16:35:08.808 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.802+0000 7f6c5259c640 1 --2- 172.21.15.203:0/1615217261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c5415e7b0 0x7f6c540b4980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c440097a0 tx=0x7f6c4402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b42a81c3d4bedd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:08.808 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c51d9b640 1 -- 172.21.15.203:0/1615217261 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44034070 con 0x7f6c5415e7b0 2024-03-31T16:35:08.808 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c51d9b640 1 -- 172.21.15.203:0/1615217261 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c44030610 con 0x7f6c5415e7b0 2024-03-31T16:35:08.808 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c51d9b640 1 -- 172.21.15.203:0/1615217261 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c440309e0 con 0x7f6c5415e7b0 2024-03-31T16:35:08.808 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c58d74640 1 -- 172.21.15.203:0/1615217261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c5415e7b0 msgr2=0x7f6c540b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.809 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c58d74640 1 --2- 172.21.15.203:0/1615217261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c5415e7b0 0x7f6c540b4980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c440097a0 tx=0x7f6c4402b960 comp rx=0 tx=0).stop 2024-03-31T16:35:08.809 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c58d74640 1 -- 172.21.15.203:0/1615217261 shutdown_connections 2024-03-31T16:35:08.809 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c58d74640 1 --2- 172.21.15.203:0/1615217261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c5415e7b0 0x7f6c540b4980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.809 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c58d74640 1 -- 172.21.15.203:0/1615217261 >> 172.21.15.203:0/1615217261 conn(0x7f6c540b3e90 msgr2=0x7f6c540b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:08.809 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c58d74640 1 -- 172.21.15.203:0/1615217261 shutdown_connections 2024-03-31T16:35:08.809 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.803+0000 7f6c58d74640 1 -- 172.21.15.203:0/1615217261 wait complete. 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.804+0000 7f6c58d74640 1 Processor -- start 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c58d74640 1 -- start start 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c58d74640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c540c7810 0x7f6c5414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c58d74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c540d1d70 0x7f6c54161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c58d74640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5415e7b0 0x7f6c54161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c58d74640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6c540cfe30 con 0x7f6c540d1d70 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c58d74640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c540d0d20 con 0x7f6c5415e7b0 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c58d74640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5406d140 con 0x7f6c540c7810 2024-03-31T16:35:08.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c5259c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c540c7810 0x7f6c5414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c52d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5415e7b0 0x7f6c54161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c5259c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c540c7810 0x7f6c5414ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:33852/0 (socket says 172.21.15.203:33852) 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c5259c640 1 -- 172.21.15.203:0/862587130 learned_addr learned my addr 172.21.15.203:0/862587130 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.805+0000 7f6c4bfff640 1 --2- 172.21.15.203:0/862587130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c540d1d70 0x7f6c54161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c5259c640 1 -- 172.21.15.203:0/862587130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5415e7b0 msgr2=0x7f6c54161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c5259c640 1 --2- 172.21.15.203:0/862587130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5415e7b0 0x7f6c54161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c5259c640 1 -- 172.21.15.203:0/862587130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c540d1d70 msgr2=0x7f6c54161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c5259c640 1 --2- 172.21.15.203:0/862587130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c540d1d70 0x7f6c54161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c5259c640 1 -- 172.21.15.203:0/862587130 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c541606e0 con 0x7f6c540c7810 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c5259c640 1 --2- 172.21.15.203:0/862587130 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c540c7810 0x7f6c5414ccc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000c00 tx=0x7f6c440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c4affd640 1 -- 172.21.15.203:0/862587130 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44049070 con 0x7f6c540c7810 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c4affd640 1 -- 172.21.15.203:0/862587130 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4403a890 con 0x7f6c540c7810 2024-03-31T16:35:08.813 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5415f640 con 0x7f6c540c7810 2024-03-31T16:35:08.814 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c4affd640 1 -- 172.21.15.203:0/862587130 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44034040 con 0x7f6c540c7810 2024-03-31T16:35:08.814 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5415fc00 con 0x7f6c540c7810 2024-03-31T16:35:08.814 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c4affd640 1 -- 172.21.15.203:0/862587130 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c4404c070 con 0x7f6c540c7810 2024-03-31T16:35:08.814 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.806+0000 7f6c4affd640 1 -- 172.21.15.203:0/862587130 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f6c44044840 con 0x7f6c540c7810 2024-03-31T16:35:08.814 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.807+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c54068cd0 con 0x7f6c540c7810 2024-03-31T16:35:08.815 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.811+0000 7f6c4affd640 1 -- 172.21.15.203:0/862587130 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6c4403f070 con 0x7f6c540c7810 2024-03-31T16:35:08.826 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:08.822+0000 7f158a62e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-31T16:35:08.848 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:08.844+0000 7f6c20e2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T16:35:08.881 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:08.877+0000 7f158a62e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-31T16:35:08.886 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.882+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a45d7996-2f81-4a76-b1e1-05d72b6c8be6", "id": 2} v 0) -- 0x7f6c54158d50 con 0x7f6c540c7810 2024-03-31T16:35:08.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.887+0000 7f6c4affd640 1 -- 172.21.15.203:0/862587130 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a45d7996-2f81-4a76-b1e1-05d72b6c8be6", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6c4403ac80 con 0x7f6c540c7810 2024-03-31T16:35:08.892 INFO:teuthology.orchestra.run.smithi203.stdout:2 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c540c7810 msgr2=0x7f6c5414ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 --2- 172.21.15.203:0/862587130 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c540c7810 0x7f6c5414ccc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000c00 tx=0x7f6c440046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 shutdown_connections 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 --2- 172.21.15.203:0/862587130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5415e7b0 0x7f6c54161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 --2- 172.21.15.203:0/862587130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c540d1d70 0x7f6c54161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 --2- 172.21.15.203:0/862587130 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c540c7810 0x7f6c5414ccc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 >> 172.21.15.203:0/862587130 conn(0x7f6c540b3e90 msgr2=0x7f6c54071000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 shutdown_connections 2024-03-31T16:35:08.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:08.888+0000 7f6c58d74640 1 -- 172.21.15.203:0/862587130 wait complete. 2024-03-31T16:35:08.894 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:08.888+0000 7f6c20e2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T16:35:08.903 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new c60e3363-59ef-41a9-a258-63463dee5b3f 3 2024-03-31T16:35:08.930 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:08.925+0000 7f158a62e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-31T16:35:08.946 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:08.941+0000 7f6c20e2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T16:35:08.986 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:08.982+0000 7f158a62e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-31T16:35:08.988 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:08.984+0000 7f6c20e2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T16:35:09.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.000+0000 7f9af3d15640 1 Processor -- start 2024-03-31T16:35:09.005 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.000+0000 7f9af3d15640 1 -- start start 2024-03-31T16:35:09.007 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af3d15640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b260 0x7f9aec0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.007 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af3d15640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aec15ff50 con 0x7f9aec15b640 2024-03-31T16:35:09.007 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af3d15640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aec15f340 con 0x7f9aec0b06b0 2024-03-31T16:35:09.007 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af3d15640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9aec15f620 con 0x7f9aec15b260 2024-03-31T16:35:09.007 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af1ab1640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b260 0x7f9aec0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af22b2640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f9aec0b06b0 0x7f9aec0aeb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52450/0 (socket says 172.21.15.203:52450) 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af22b2640 1 -- 172.21.15.203:0/3561690390 learned_addr learned my addr 172.21.15.203:0/3561690390 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af0aaf640 1 -- 172.21.15.203:0/3561690390 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821408550 0 0) 0x7f9aec15f340 con 0x7f9aec0b06b0 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af0aaf640 1 -- 172.21.15.203:0/3561690390 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad8003520 con 0x7f9aec0b06b0 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af1ab1640 1 -- 172.21.15.203:0/3561690390 >> v1:172.21.15.203:6789/0 conn(0x7f9aec0b06b0 legacy=0x7f9aec0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af1ab1640 1 -- 172.21.15.203:0/3561690390 >> v1:172.21.15.120:6789/0 conn(0x7f9aec15b640 legacy=0x7f9aec0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.001+0000 7f9af1ab1640 1 -- 172.21.15.203:0/3561690390 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec15f900 con 0x7f9aec15b260 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.002+0000 7f9af1ab1640 1 --2- 172.21.15.203:0/3561690390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b260 0x7f9aec0b40b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0097d0 tx=0x7f9adc02db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c963ca6a4796970 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.002+0000 7f9af0aaf640 1 -- 172.21.15.203:0/3561690390 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc02f900 con 0x7f9aec15b260 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.002+0000 7f9af0aaf640 1 -- 172.21.15.203:0/3561690390 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc02faa0 con 0x7f9aec15b260 2024-03-31T16:35:09.008 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.002+0000 7f9af0aaf640 1 -- 172.21.15.203:0/3561690390 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc037420 con 0x7f9aec15b260 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.003+0000 7f9af3d15640 1 -- 172.21.15.203:0/3561690390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b260 msgr2=0x7f9aec0b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.003+0000 7f9af3d15640 1 --2- 172.21.15.203:0/3561690390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b260 0x7f9aec0b40b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0097d0 tx=0x7f9adc02db40 comp rx=0 tx=0).stop 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.003+0000 7f9af3d15640 1 -- 172.21.15.203:0/3561690390 shutdown_connections 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.003+0000 7f9af3d15640 1 --2- 172.21.15.203:0/3561690390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b260 0x7f9aec0b40b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.003+0000 7f9af3d15640 1 -- 172.21.15.203:0/3561690390 >> 172.21.15.203:0/3561690390 conn(0x7f9aec0b65a0 msgr2=0x7f9aec0b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.003+0000 7f9af3d15640 1 -- 172.21.15.203:0/3561690390 shutdown_connections 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.003+0000 7f9af3d15640 1 -- 172.21.15.203:0/3561690390 wait complete. 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.004+0000 7f9af3d15640 1 Processor -- start 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.004+0000 7f9af3d15640 1 -- start start 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af3d15640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aec0b06b0 0x7f9aec15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af3d15640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9aec15b260 0x7f9aec06f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af3d15640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b640 0x7f9aec06fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af3d15640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec06e770 con 0x7f9aec0b06b0 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af3d15640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9aec15f010 con 0x7f9aec15b260 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af3d15640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9aec0b45f0 con 0x7f9aec15b640 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af22b2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b640 0x7f9aec06fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af12b0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9aec15b260 0x7f9aec06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af22b2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b640 0x7f9aec06fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:33874/0 (socket says 172.21.15.203:33874) 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af22b2640 1 -- 172.21.15.203:0/1299696614 learned_addr learned my addr 172.21.15.203:0/1299696614 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af1ab1640 1 --2- 172.21.15.203:0/1299696614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aec0b06b0 0x7f9aec15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af22b2640 1 -- 172.21.15.203:0/1299696614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9aec15b260 msgr2=0x7f9aec06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af22b2640 1 --2- 172.21.15.203:0/1299696614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9aec15b260 0x7f9aec06f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.013 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af22b2640 1 -- 172.21.15.203:0/1299696614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aec0b06b0 msgr2=0x7f9aec15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af22b2640 1 --2- 172.21.15.203:0/1299696614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aec0b06b0 0x7f9aec15a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.005+0000 7f9af22b2640 1 -- 172.21.15.203:0/1299696614 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aec148830 con 0x7f9aec15b640 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.006+0000 7f9af22b2640 1 --2- 172.21.15.203:0/1299696614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b640 0x7f9aec06fb90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400cb40 tx=0x7f9ae400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.006+0000 7f9ae27fc640 1 -- 172.21.15.203:0/1299696614 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4017070 con 0x7f9aec15b640 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.006+0000 7f9ae27fc640 1 -- 172.21.15.203:0/1299696614 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae400aca0 con 0x7f9aec15b640 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.006+0000 7f9ae27fc640 1 -- 172.21.15.203:0/1299696614 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4012620 con 0x7f9aec15b640 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.006+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aec1f8480 con 0x7f9aec15b640 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.006+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aec148db0 con 0x7f9aec15b640 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.006+0000 7f9ae27fc640 1 -- 172.21.15.203:0/1299696614 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ae401a070 con 0x7f9aec15b640 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.006+0000 7f9ae27fc640 1 -- 172.21.15.203:0/1299696614 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9ae4007500 con 0x7f9aec15b640 2024-03-31T16:35:09.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.007+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aec068cd0 con 0x7f9aec15b640 2024-03-31T16:35:09.015 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.009+0000 7f9ae27fc640 1 -- 172.21.15.203:0/1299696614 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9ae4021070 con 0x7f9aec15b640 2024-03-31T16:35:09.031 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:09.027+0000 7f158a62e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-31T16:35:09.085 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.081+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c60e3363-59ef-41a9-a258-63463dee5b3f", "id": 3} v 0) -- 0x7f9aec0afc40 con 0x7f9aec15b640 2024-03-31T16:35:09.091 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.086+0000 7f9ae27fc640 1 -- 172.21.15.203:0/1299696614 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c60e3363-59ef-41a9-a258-63463dee5b3f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9ae4007070 con 0x7f9aec15b640 2024-03-31T16:35:09.091 INFO:teuthology.orchestra.run.smithi203.stdout:3 2024-03-31T16:35:09.092 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b640 msgr2=0x7f9aec06fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.092 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 --2- 172.21.15.203:0/1299696614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b640 0x7f9aec06fb90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400cb40 tx=0x7f9ae400a060 comp rx=0 tx=0).stop 2024-03-31T16:35:09.092 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 shutdown_connections 2024-03-31T16:35:09.092 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 --2- 172.21.15.203:0/1299696614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9aec15b640 0x7f9aec06fb90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.092 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 --2- 172.21.15.203:0/1299696614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9aec15b260 0x7f9aec06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.092 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 --2- 172.21.15.203:0/1299696614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9aec0b06b0 0x7f9aec15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.092 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 >> 172.21.15.203:0/1299696614 conn(0x7f9aec0b65a0 msgr2=0x7f9aec0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.092 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 shutdown_connections 2024-03-31T16:35:09.093 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.087+0000 7f9af3d15640 1 -- 172.21.15.203:0/1299696614 wait complete. 2024-03-31T16:35:09.102 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 63882813-03d3-4d45-a6c9-e7dd0f2cd774 4 2024-03-31T16:35:09.103 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.098+0000 7f6c20e2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T16:35:09.152 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:09.147+0000 7f158a62e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-31T16:35:09.170 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.166+0000 7f6c20e2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T16:35:09.214 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.210+0000 7f6c20e2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T16:35:09.225 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:09.221+0000 7f158a62e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-31T16:35:09.243 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.239+0000 7fee4bd2b640 1 Processor -- start 2024-03-31T16:35:09.243 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.239+0000 7fee4bd2b640 1 -- start start 2024-03-31T16:35:09.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee4bd2b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fee44160a30 0x7fee4406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee4bd2b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fee44145d60 0x7fee4406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee4bd2b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee440b5ed0 con 0x7fee441457e0 2024-03-31T16:35:09.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee4bd2b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fee44145bc0 con 0x7fee44145d60 2024-03-31T16:35:09.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee4bd2b640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fee440afca0 con 0x7fee44160a30 2024-03-31T16:35:09.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee492c6640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fee44160a30 0x7fee4406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee492c6640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fee44160a30 0x7fee4406b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:39660/0 (socket says 172.21.15.203:39660) 2024-03-31T16:35:09.245 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee492c6640 1 -- 172.21.15.203:0/1855132800 learned_addr learned my addr 172.21.15.203:0/1855132800 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:09.246 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee4a2c8640 1 --2- 172.21.15.203:0/1855132800 >> v2:172.21.15.120:3300/0 conn(0x7fee44145d60 0x7fee4406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.246 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee492c6640 1 -- 172.21.15.203:0/1855132800 >> v2:172.21.15.120:3300/0 conn(0x7fee44145d60 msgr2=0x7fee4406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:09.246 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee492c6640 1 --2- 172.21.15.203:0/1855132800 >> v2:172.21.15.120:3300/0 conn(0x7fee44145d60 0x7fee4406bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.246 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee492c6640 1 -- 172.21.15.203:0/1855132800 >> v1:172.21.15.120:6789/0 conn(0x7fee441457e0 legacy=0x7fee440b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.246 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.240+0000 7fee492c6640 1 -- 172.21.15.203:0/1855132800 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee440b61b0 con 0x7fee44160a30 2024-03-31T16:35:09.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.241+0000 7fee492c6640 1 --2- 172.21.15.203:0/1855132800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee4406b570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fee4415ff80 tx=0x7fee4002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94f83cae17058aa server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.241+0000 7fee48ac5640 1 -- 172.21.15.203:0/1855132800 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40035020 con 0x7fee44160a30 2024-03-31T16:35:09.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.241+0000 7fee48ac5640 1 -- 172.21.15.203:0/1855132800 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40031870 con 0x7fee44160a30 2024-03-31T16:35:09.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.241+0000 7fee48ac5640 1 -- 172.21.15.203:0/1855132800 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40031c40 con 0x7fee44160a30 2024-03-31T16:35:09.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.242+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1855132800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 msgr2=0x7fee4406b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.247 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.242+0000 7fee4bd2b640 1 --2- 172.21.15.203:0/1855132800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee4406b570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fee4415ff80 tx=0x7fee4002b910 comp rx=0 tx=0).stop 2024-03-31T16:35:09.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.242+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1855132800 shutdown_connections 2024-03-31T16:35:09.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.242+0000 7fee4bd2b640 1 --2- 172.21.15.203:0/1855132800 >> v2:172.21.15.120:3300/0 conn(0x7fee44145d60 0x7fee4406bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.242+0000 7fee4bd2b640 1 --2- 172.21.15.203:0/1855132800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee4406b570 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.242+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1855132800 >> 172.21.15.203:0/1855132800 conn(0x7fee440b65a0 msgr2=0x7fee440b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.242+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1855132800 shutdown_connections 2024-03-31T16:35:09.248 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.242+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1855132800 wait complete. 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.243+0000 7fee4bd2b640 1 Processor -- start 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.243+0000 7fee4bd2b640 1 -- start start 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4bd2b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee441457e0 0x7fee4415f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4bd2b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee44145d60 0x7fee4415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4bd2b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee44140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4bd2b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fee440af9f0 con 0x7fee441457e0 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4bd2b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee440af870 con 0x7fee44160a30 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4bd2b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fee440ae1e0 con 0x7fee44145d60 2024-03-31T16:35:09.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee44140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee492c6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee44145d60 0x7fee4415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee44140b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:39674/0 (socket says 172.21.15.203:39674) 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 -- 172.21.15.203:0/1652138379 learned_addr learned my addr 172.21.15.203:0/1652138379 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee49ac7640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee441457e0 0x7fee4415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 -- 172.21.15.203:0/1652138379 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee44145d60 msgr2=0x7fee4415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee44145d60 0x7fee4415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 -- 172.21.15.203:0/1652138379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee441457e0 msgr2=0x7fee4415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee441457e0 0x7fee4415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 -- 172.21.15.203:0/1652138379 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4415e2a0 con 0x7fee44160a30 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee492c6640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee44145d60 0x7fee4415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:09.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee49ac7640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee441457e0 0x7fee4415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.244+0000 7fee4a2c8640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee44140b60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee3c007e40 tx=0x7fee3c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.245+0000 7fee3a7fc640 1 -- 172.21.15.203:0/1652138379 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c014620 con 0x7fee44160a30 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.245+0000 7fee3a7fc640 1 -- 172.21.15.203:0/1652138379 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3c019070 con 0x7fee44160a30 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.245+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4415e580 con 0x7fee44160a30 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.245+0000 7fee3a7fc640 1 -- 172.21.15.203:0/1652138379 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3c014a20 con 0x7fee44160a30 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.245+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4415eb40 con 0x7fee44160a30 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.245+0000 7fee3a7fc640 1 -- 172.21.15.203:0/1652138379 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee3c014bc0 con 0x7fee44160a30 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.245+0000 7fee3a7fc640 1 -- 172.21.15.203:0/1652138379 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fee3c01e970 con 0x7fee44160a30 2024-03-31T16:35:09.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.246+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee44068cd0 con 0x7fee44160a30 2024-03-31T16:35:09.255 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.248+0000 7fee3a7fc640 1 -- 172.21.15.203:0/1652138379 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fee3c01e460 con 0x7fee44160a30 2024-03-31T16:35:09.266 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.262+0000 7f6c20e2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T16:35:09.274 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:09.270+0000 7f158a62e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-31T16:35:09.312 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.308+0000 7f6c20e2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T16:35:09.325 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.320+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "63882813-03d3-4d45-a6c9-e7dd0f2cd774", "id": 4} v 0) -- 0x7fee44142e30 con 0x7fee44160a30 2024-03-31T16:35:09.328 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:09.324+0000 7f158a62e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-31T16:35:09.329 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.325+0000 7fee3a7fc640 1 -- 172.21.15.203:0/1652138379 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63882813-03d3-4d45-a6c9-e7dd0f2cd774", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fee3c01e640 con 0x7fee44160a30 2024-03-31T16:35:09.330 INFO:teuthology.orchestra.run.smithi203.stdout:4 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 msgr2=0x7fee44140b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee44140b60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee3c007e40 tx=0x7fee3c00e4b0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 shutdown_connections 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee44160a30 0x7fee44140b60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee44145d60 0x7fee4415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 --2- 172.21.15.203:0/1652138379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee441457e0 0x7fee4415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 >> 172.21.15.203:0/1652138379 conn(0x7fee440b65a0 msgr2=0x7fee44141d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 shutdown_connections 2024-03-31T16:35:09.331 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.326+0000 7fee4bd2b640 1 -- 172.21.15.203:0/1652138379 wait complete. 2024-03-31T16:35:09.341 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 4d72f3d1-6df8-4f38-99ea-21d09becfc16 5 2024-03-31T16:35:09.377 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:09.372+0000 7f158a62e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-31T16:35:09.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.474+0000 7f34782f2640 1 Processor -- start 2024-03-31T16:35:09.479 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.474+0000 7f34782f2640 1 -- start start 2024-03-31T16:35:09.487 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f34782f2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f34700d1d70 0x7f34700b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.487 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f34782f2640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34700d01a0 con 0x7f34700c7810 2024-03-31T16:35:09.487 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f34782f2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34700d0480 con 0x7f347015e7b0 2024-03-31T16:35:09.487 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f34782f2640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f34700d1240 con 0x7f34700d1d70 2024-03-31T16:35:09.487 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f347688f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f34700d1d70 0x7f34700b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.487 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f347608e640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f347015e7b0 0x7f34700c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52458/0 (socket says 172.21.15.203:52458) 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f347608e640 1 -- 172.21.15.203:0/306317108 learned_addr learned my addr 172.21.15.203:0/306317108 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f347688f640 1 -- 172.21.15.203:0/306317108 >> v1:172.21.15.203:6789/0 conn(0x7f347015e7b0 legacy=0x7f34700c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f347688f640 1 -- 172.21.15.203:0/306317108 >> v1:172.21.15.120:6789/0 conn(0x7f34700c7810 legacy=0x7f347006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.475+0000 7f347688f640 1 -- 172.21.15.203:0/306317108 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34700d0760 con 0x7f34700d1d70 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.476+0000 7f347688f640 1 --2- 172.21.15.203:0/306317108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f34700d1d70 0x7f34700b4980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3468009dc0 tx=0x7f346802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=773bc06b0abe227a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.476+0000 7f347508c640 1 -- 172.21.15.203:0/306317108 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468039070 con 0x7f34700d1d70 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.476+0000 7f347508c640 1 -- 172.21.15.203:0/306317108 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346802ccd0 con 0x7f34700d1d70 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.476+0000 7f347508c640 1 -- 172.21.15.203:0/306317108 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468034660 con 0x7f34700d1d70 2024-03-31T16:35:09.488 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.476+0000 7f34782f2640 1 -- 172.21.15.203:0/306317108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f34700d1d70 msgr2=0x7f34700b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.489 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.476+0000 7f34782f2640 1 --2- 172.21.15.203:0/306317108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f34700d1d70 0x7f34700b4980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3468009dc0 tx=0x7f346802bf20 comp rx=0 tx=0).stop 2024-03-31T16:35:09.489 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.477+0000 7f34782f2640 1 -- 172.21.15.203:0/306317108 shutdown_connections 2024-03-31T16:35:09.489 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.477+0000 7f34782f2640 1 --2- 172.21.15.203:0/306317108 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f34700d1d70 0x7f34700b4980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.489 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.477+0000 7f34782f2640 1 -- 172.21.15.203:0/306317108 >> 172.21.15.203:0/306317108 conn(0x7f34700b3e90 msgr2=0x7f34700b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.477+0000 7f34782f2640 1 -- 172.21.15.203:0/306317108 shutdown_connections 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.477+0000 7f34782f2640 1 -- 172.21.15.203:0/306317108 wait complete. 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.478+0000 7f34782f2640 1 Processor -- start 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.478+0000 7f34782f2640 1 -- start start 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.478+0000 7f34782f2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34700c7810 0x7f34701488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.478+0000 7f34782f2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34700d1d70 0x7f347015fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.478+0000 7f34782f2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f347015e7b0 0x7f347014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.478+0000 7f34782f2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f34700cfe30 con 0x7f34700d1d70 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.478+0000 7f34782f2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f34700d0d20 con 0x7f34700c7810 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.478+0000 7f34782f2640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f347006d140 con 0x7f347015e7b0 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347608e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34700c7810 0x7f34701488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f347015e7b0 0x7f347014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.490 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f347015e7b0 0x7f347014af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:33904/0 (socket says 172.21.15.203:33904) 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 -- 172.21.15.203:0/3377949147 learned_addr learned my addr 172.21.15.203:0/3377949147 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347588d640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34700d1d70 0x7f347015fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 -- 172.21.15.203:0/3377949147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34700c7810 msgr2=0x7f34701488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34700c7810 0x7f34701488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 -- 172.21.15.203:0/3377949147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34700d1d70 msgr2=0x7f347015fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34700d1d70 0x7f347015fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 -- 172.21.15.203:0/3377949147 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3470160630 con 0x7f347015e7b0 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347608e640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34700c7810 0x7f34701488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f347688f640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f347015e7b0 0x7f347014af20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3468037040 tx=0x7f3468004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f3466ffd640 1 -- 172.21.15.203:0/3377949147 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468039050 con 0x7f347015e7b0 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f3466ffd640 1 -- 172.21.15.203:0/3377949147 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3468045070 con 0x7f347015e7b0 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3470160910 con 0x7f347015e7b0 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f3466ffd640 1 -- 172.21.15.203:0/3377949147 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346803e850 con 0x7f347015e7b0 2024-03-31T16:35:09.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3470160ed0 con 0x7f347015e7b0 2024-03-31T16:35:09.492 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f3466ffd640 1 -- 172.21.15.203:0/3377949147 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f346803e9f0 con 0x7f347015e7b0 2024-03-31T16:35:09.492 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.479+0000 7f3466ffd640 1 -- 172.21.15.203:0/3377949147 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f346804ab40 con 0x7f347015e7b0 2024-03-31T16:35:09.492 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.480+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3470068cd0 con 0x7f347015e7b0 2024-03-31T16:35:09.492 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.484+0000 7f3466ffd640 1 -- 172.21.15.203:0/3377949147 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f346803ee20 con 0x7f347015e7b0 2024-03-31T16:35:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.557+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4d72f3d1-6df8-4f38-99ea-21d09becfc16", "id": 5} v 0) -- 0x7f347006e3c0 con 0x7f347015e7b0 2024-03-31T16:35:09.566 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.562+0000 7f3466ffd640 1 -- 172.21.15.203:0/3377949147 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d72f3d1-6df8-4f38-99ea-21d09becfc16", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f346804a460 con 0x7f347015e7b0 2024-03-31T16:35:09.566 INFO:teuthology.orchestra.run.smithi203.stdout:5 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f347015e7b0 msgr2=0x7f347014af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f347015e7b0 0x7f347014af20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3468037040 tx=0x7f3468004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 shutdown_connections 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f347015e7b0 0x7f347014af20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34700d1d70 0x7f347015fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 --2- 172.21.15.203:0/3377949147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34700c7810 0x7f34701488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 >> 172.21.15.203:0/3377949147 conn(0x7f34700b3e90 msgr2=0x7f347015c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 shutdown_connections 2024-03-31T16:35:09.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.563+0000 7f34782f2640 1 -- 172.21.15.203:0/3377949147 wait complete. 2024-03-31T16:35:09.578 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724 6 2024-03-31T16:35:09.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.675+0000 7f20f9cb1640 1 Processor -- start 2024-03-31T16:35:09.680 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.675+0000 7f20f9cb1640 1 -- start start 2024-03-31T16:35:09.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f9cb1640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b640 0x7f20f40affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f9cb1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f20f40b04e0 0x7f20f40aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f9cb1640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f415ff50 con 0x7f20f415b260 2024-03-31T16:35:09.681 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f9cb1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f20f415f340 con 0x7f20f40b04e0 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f9cb1640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f20f415f620 con 0x7f20f415b640 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b640 0x7f20f40affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b640 0x7f20f40affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:33912/0 (socket says 172.21.15.203:33912) 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f2ffd640 1 -- 172.21.15.203:0/1301823913 learned_addr learned my addr 172.21.15.203:0/1301823913 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f37fe640 1 --1- 172.21.15.203:0/1301823913 >> v1:172.21.15.203:6789/0 conn(0x7f20f415b260 0x7f20f40b40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52464/0 (socket says 172.21.15.203:52464) 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.676+0000 7f20f3fff640 1 --2- 172.21.15.203:0/1301823913 >> v2:172.21.15.120:3300/0 conn(0x7f20f40b04e0 0x7f20f40aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.677+0000 7f20f27fc640 1 -- 172.21.15.203:0/1301823913 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848585326 0 0) 0x7f20f415ff50 con 0x7f20f415b260 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.677+0000 7f20f2ffd640 1 -- 172.21.15.203:0/1301823913 >> v2:172.21.15.120:3300/0 conn(0x7f20f40b04e0 msgr2=0x7f20f40aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.677+0000 7f20f2ffd640 1 --2- 172.21.15.203:0/1301823913 >> v2:172.21.15.120:3300/0 conn(0x7f20f40b04e0 0x7f20f40aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.677+0000 7f20f2ffd640 1 -- 172.21.15.203:0/1301823913 >> v1:172.21.15.203:6789/0 conn(0x7f20f415b260 legacy=0x7f20f40b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.682 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.677+0000 7f20f2ffd640 1 -- 172.21.15.203:0/1301823913 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f415f900 con 0x7f20f415b640 2024-03-31T16:35:09.683 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.679+0000 7f6c20e2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T16:35:09.684 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.678+0000 7f20f2ffd640 1 --2- 172.21.15.203:0/1301823913 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b640 0x7f20f40affa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88f447b1174ea430 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.678+0000 7f20f27fc640 1 -- 172.21.15.203:0/1301823913 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4034070 con 0x7f20f415b640 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.678+0000 7f20f27fc640 1 -- 172.21.15.203:0/1301823913 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e4030840 con 0x7f20f415b640 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.678+0000 7f20f27fc640 1 -- 172.21.15.203:0/1301823913 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4030c10 con 0x7f20f415b640 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.678+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1301823913 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b640 msgr2=0x7f20f40affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.678+0000 7f20f9cb1640 1 --2- 172.21.15.203:0/1301823913 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b640 0x7f20f40affa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e402b980 comp rx=0 tx=0).stop 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.679+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1301823913 shutdown_connections 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.679+0000 7f20f9cb1640 1 --2- 172.21.15.203:0/1301823913 >> v2:172.21.15.120:3300/0 conn(0x7f20f40b04e0 0x7f20f40aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.679+0000 7f20f9cb1640 1 --2- 172.21.15.203:0/1301823913 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b640 0x7f20f40affa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.679+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1301823913 >> 172.21.15.203:0/1301823913 conn(0x7f20f40b65a0 msgr2=0x7f20f40b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.679+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1301823913 shutdown_connections 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.679+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1301823913 wait complete. 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.680+0000 7f20f9cb1640 1 Processor -- start 2024-03-31T16:35:09.685 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.680+0000 7f20f9cb1640 1 -- start start 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f9cb1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20f40b04e0 0x7f20f415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f9cb1640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b260 0x7f20f41f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f9cb1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20f415b640 0x7f20f415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f9cb1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f20f406e770 con 0x7f20f415b640 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f9cb1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20f415f010 con 0x7f20f40b04e0 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f9cb1640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f20f40b47c0 con 0x7f20f415b260 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20f40b04e0 0x7f20f415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b260 0x7f20f41f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20f40b04e0 0x7f20f415d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:39682/0 (socket says 172.21.15.203:39682) 2024-03-31T16:35:09.688 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 -- 172.21.15.203:0/1433468282 learned_addr learned my addr 172.21.15.203:0/1433468282 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f3fff640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20f415b640 0x7f20f415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 -- 172.21.15.203:0/1433468282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b260 msgr2=0x7f20f41f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b260 0x7f20f41f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 -- 172.21.15.203:0/1433468282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20f415b640 msgr2=0x7f20f415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20f415b640 0x7f20f415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 -- 172.21.15.203:0/1433468282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f41f1aa0 con 0x7f20f40b04e0 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f2ffd640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b260 0x7f20f41f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f37fe640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20f40b04e0 0x7f20f415d9f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c4d0 tx=0x7f20e800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20dbfff640 1 -- 172.21.15.203:0/1433468282 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8018070 con 0x7f20f40b04e0 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20dbfff640 1 -- 172.21.15.203:0/1433468282 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e8007500 con 0x7f20f40b04e0 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20dbfff640 1 -- 172.21.15.203:0/1433468282 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8004a20 con 0x7f20f40b04e0 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f41f4610 con 0x7f20f40b04e0 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.681+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f41f4bd0 con 0x7f20f40b04e0 2024-03-31T16:35:09.689 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.682+0000 7f20dbfff640 1 -- 172.21.15.203:0/1433468282 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20e801b070 con 0x7f20f40b04e0 2024-03-31T16:35:09.690 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.682+0000 7f20dbfff640 1 -- 172.21.15.203:0/1433468282 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f20e80129f0 con 0x7f20f40b04e0 2024-03-31T16:35:09.690 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.682+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f4068cd0 con 0x7f20f40b04e0 2024-03-31T16:35:09.690 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.684+0000 7f20dbfff640 1 -- 172.21.15.203:0/1433468282 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f20e801d440 con 0x7f20f40b04e0 2024-03-31T16:35:09.762 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.758+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724", "id": 6} v 0) -- 0x7f20f41561e0 con 0x7f20f40b04e0 2024-03-31T16:35:09.770 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.766+0000 7f20dbfff640 1 -- 172.21.15.203:0/1433468282 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f20e801d7b0 con 0x7f20f40b04e0 2024-03-31T16:35:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:6 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20f40b04e0 msgr2=0x7f20f415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20f40b04e0 0x7f20f415d9f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c4d0 tx=0x7f20e800c990 comp rx=0 tx=0).stop 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 shutdown_connections 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f20f415b640 0x7f20f415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20f415b260 0x7f20f41f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 --2- 172.21.15.203:0/1433468282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20f40b04e0 0x7f20f415d9f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 >> 172.21.15.203:0/1433468282 conn(0x7f20f40b65a0 msgr2=0x7f20f4157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 shutdown_connections 2024-03-31T16:35:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.767+0000 7f20f9cb1640 1 -- 172.21.15.203:0/1433468282 wait complete. 2024-03-31T16:35:09.782 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new b8d1cc04-bd3a-461f-97a7-c7e868732600 7 2024-03-31T16:35:09.788 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:09.783+0000 7f158a62e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-31T16:35:09.817 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.813+0000 7f6c20e2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T16:35:09.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.878+0000 7fb95daeb640 1 Processor -- start 2024-03-31T16:35:09.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.878+0000 7fb95daeb640 1 -- start start 2024-03-31T16:35:09.884 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.879+0000 7fb95daeb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb958070120 0x7fb95806b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.884 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.879+0000 7fb95daeb640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb95806e770 0x7fb95806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.884 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.879+0000 7fb95daeb640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9580b5b10 con 0x7fb9580b0670 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.879+0000 7fb95daeb640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb9580b63e0 con 0x7fb958070120 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.879+0000 7fb95daeb640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb95806c3f0 con 0x7fb95806e770 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.879+0000 7fb957fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb95806e770 0x7fb95806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.879+0000 7fb957fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb95806e770 0x7fb95806bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:39684/0 (socket says 172.21.15.203:39684) 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.879+0000 7fb957fff640 1 -- 172.21.15.203:0/1809269654 learned_addr learned my addr 172.21.15.203:0/1809269654 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.880+0000 7fb94ffff640 1 --2- 172.21.15.203:0/1809269654 >> v2:172.21.15.120:3300/0 conn(0x7fb958070120 0x7fb95806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.880+0000 7fb957fff640 1 -- 172.21.15.203:0/1809269654 >> v2:172.21.15.120:3300/0 conn(0x7fb958070120 msgr2=0x7fb95806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.880+0000 7fb957fff640 1 --2- 172.21.15.203:0/1809269654 >> v2:172.21.15.120:3300/0 conn(0x7fb958070120 0x7fb95806b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.880+0000 7fb957fff640 1 -- 172.21.15.203:0/1809269654 >> v1:172.21.15.120:6789/0 conn(0x7fb9580b0670 legacy=0x7fb95815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:09.885 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.880+0000 7fb957fff640 1 -- 172.21.15.203:0/1809269654 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9580705e0 con 0x7fb95806e770 2024-03-31T16:35:09.886 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.880+0000 7fb957fff640 1 --2- 172.21.15.203:0/1809269654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb95806bab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb95806c650 tx=0x7fb95002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b7f055bb2a4480 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.886 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb956ffd640 1 -- 172.21.15.203:0/1809269654 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95002ca80 con 0x7fb95806e770 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb956ffd640 1 -- 172.21.15.203:0/1809269654 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95002cc20 con 0x7fb95806e770 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb956ffd640 1 -- 172.21.15.203:0/1809269654 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9500343f0 con 0x7fb95806e770 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb95daeb640 1 -- 172.21.15.203:0/1809269654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 msgr2=0x7fb95806bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb95daeb640 1 --2- 172.21.15.203:0/1809269654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb95806bab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb95806c650 tx=0x7fb95002bee0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb95daeb640 1 -- 172.21.15.203:0/1809269654 shutdown_connections 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb95daeb640 1 --2- 172.21.15.203:0/1809269654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb95806bab0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb95daeb640 1 --2- 172.21.15.203:0/1809269654 >> v2:172.21.15.120:3300/0 conn(0x7fb958070120 0x7fb95806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb95daeb640 1 -- 172.21.15.203:0/1809269654 >> 172.21.15.203:0/1809269654 conn(0x7fb9580b65a0 msgr2=0x7fb9580b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb95daeb640 1 -- 172.21.15.203:0/1809269654 shutdown_connections 2024-03-31T16:35:09.887 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.881+0000 7fb95daeb640 1 -- 172.21.15.203:0/1809269654 wait complete. 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb95daeb640 1 Processor -- start 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb95daeb640 1 -- start start 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb95daeb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb9581318a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb95daeb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb958070120 0x7fb9580cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb95daeb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580b0670 0x7fb9581407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb95daeb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb9580b0a50 con 0x7fb958070120 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb95daeb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb9580b6070 con 0x7fb95806e770 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb95daeb640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb958168450 con 0x7fb9580b0670 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb9581318a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb957fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580b0670 0x7fb9581407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.890 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb9581318a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:39696/0 (socket says 172.21.15.203:39696) 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb9577fe640 1 -- 172.21.15.203:0/1104421754 learned_addr learned my addr 172.21.15.203:0/1104421754 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.883+0000 7fb94ffff640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb958070120 0x7fb9580cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb9577fe640 1 -- 172.21.15.203:0/1104421754 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580b0670 msgr2=0x7fb9581407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb9577fe640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580b0670 0x7fb9581407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb9577fe640 1 -- 172.21.15.203:0/1104421754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb958070120 msgr2=0x7fb9580cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb9577fe640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb958070120 0x7fb9580cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb9577fe640 1 -- 172.21.15.203:0/1104421754 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9580d0ab0 con 0x7fb95806e770 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb957fff640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580b0670 0x7fb9581407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb9577fe640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb9581318a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb94800b3f0 tx=0x7fb94800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb954ff9640 1 -- 172.21.15.203:0/1104421754 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948015020 con 0x7fb95806e770 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb954ff9640 1 -- 172.21.15.203:0/1104421754 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb948011830 con 0x7fb95806e770 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9580d0830 con 0x7fb95806e770 2024-03-31T16:35:09.891 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb954ff9640 1 -- 172.21.15.203:0/1104421754 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948011c20 con 0x7fb95806e770 2024-03-31T16:35:09.892 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9581402d0 con 0x7fb95806e770 2024-03-31T16:35:09.892 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb954ff9640 1 -- 172.21.15.203:0/1104421754 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb948018020 con 0x7fb95806e770 2024-03-31T16:35:09.892 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.884+0000 7fb954ff9640 1 -- 172.21.15.203:0/1104421754 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fb94801aa60 con 0x7fb95806e770 2024-03-31T16:35:09.892 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.885+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb958068cd0 con 0x7fb95806e770 2024-03-31T16:35:09.893 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.889+0000 7fb954ff9640 1 -- 172.21.15.203:0/1104421754 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb94801f030 con 0x7fb95806e770 2024-03-31T16:35:09.930 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:09.926+0000 7f158a62e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-31T16:35:09.949 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.945+0000 7f6c20e2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T16:35:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.961+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b8d1cc04-bd3a-461f-97a7-c7e868732600", "id": 7} v 0) -- 0x7fb958145750 con 0x7fb95806e770 2024-03-31T16:35:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.969+0000 7fb954ff9640 1 -- 172.21.15.203:0/1104421754 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8d1cc04-bd3a-461f-97a7-c7e868732600", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fb9580d0830 con 0x7fb95806e770 2024-03-31T16:35:09.974 INFO:teuthology.orchestra.run.smithi203.stdout:7 2024-03-31T16:35:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 msgr2=0x7fb9581318a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb9581318a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb94800b3f0 tx=0x7fb94800b8b0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 shutdown_connections 2024-03-31T16:35:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580b0670 0x7fb9581407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb958070120 0x7fb9580cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 --2- 172.21.15.203:0/1104421754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806e770 0x7fb9581318a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 >> 172.21.15.203:0/1104421754 conn(0x7fb9580b65a0 msgr2=0x7fb95806eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 shutdown_connections 2024-03-31T16:35:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:09.970+0000 7fb95daeb640 1 -- 172.21.15.203:0/1104421754 wait complete. 2024-03-31T16:35:09.985 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-31T16:35:09.986 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-31T16:35:09.987 INFO:tasks.ceph.osd.0:Started 2024-03-31T16:35:09.988 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-31T16:35:09.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-31T16:35:09.991 INFO:tasks.ceph.osd.1:Started 2024-03-31T16:35:09.992 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-31T16:35:09.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-31T16:35:09.994 INFO:tasks.ceph.osd.2:Started 2024-03-31T16:35:09.994 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-31T16:35:09.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-31T16:35:09.996 INFO:tasks.ceph.osd.3:Started 2024-03-31T16:35:09.996 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-31T16:35:09.996 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-31T16:35:09.997 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:09.991+0000 7f6c20e2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T16:35:10.027 INFO:tasks.ceph.osd.4:Started 2024-03-31T16:35:10.028 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-31T16:35:10.028 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-31T16:35:10.030 INFO:tasks.ceph.osd.5:Started 2024-03-31T16:35:10.031 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-31T16:35:10.031 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-31T16:35:10.033 INFO:tasks.ceph.osd.6:Started 2024-03-31T16:35:10.033 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-31T16:35:10.033 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-31T16:35:10.035 INFO:tasks.ceph.osd.7:Started 2024-03-31T16:35:10.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:10.045 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:10.041+0000 7f158a62e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-31T16:35:10.100 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:10.095+0000 7f158a62e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-31T16:35:10.129 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:10.125+0000 7f6c20e2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T16:35:10.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.147+0000 7f24dc477640 1 Processor -- start 2024-03-31T16:35:10.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.147+0000 7f24dc477640 1 -- start start 2024-03-31T16:35:10.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.148+0000 7f24dc477640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d415e860 0x7f24d406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:10.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.148+0000 7f24dc477640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d406dfa0 con 0x7f24d406da30 2024-03-31T16:35:10.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.148+0000 7f24dc477640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d406e240 con 0x7f24d40d4ae0 2024-03-31T16:35:10.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.148+0000 7f24dc477640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f24d40cf220 con 0x7f24d415e860 2024-03-31T16:35:10.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.148+0000 7f24d9a12640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f24d406da30 0x7f24d40d43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47520/0 (socket says 172.21.15.120:47520) 2024-03-31T16:35:10.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.148+0000 7f24d9a12640 1 -- 172.21.15.120:0/1342614876 learned_addr learned my addr 172.21.15.120:0/1342614876 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:10.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.148+0000 7f24da213640 1 --2- 172.21.15.120:0/1342614876 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d415e860 0x7f24d406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.149+0000 7f24d9211640 1 -- 172.21.15.120:0/1342614876 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3350295007 0 0) 0x7f24d406dfa0 con 0x7f24d406da30 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.149+0000 7f24d9211640 1 -- 172.21.15.120:0/1342614876 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24c0003520 con 0x7f24d406da30 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.149+0000 7f24d9211640 1 -- 172.21.15.120:0/1342614876 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823507665 0 0) 0x7f24d406e240 con 0x7f24d40d4ae0 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.149+0000 7f24d9211640 1 -- 172.21.15.120:0/1342614876 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d406dfa0 con 0x7f24d40d4ae0 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.149+0000 7f24da213640 1 -- 172.21.15.120:0/1342614876 >> v1:172.21.15.203:6789/0 conn(0x7f24d40d4ae0 legacy=0x7f24d40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.149+0000 7f24da213640 1 -- 172.21.15.120:0/1342614876 >> v1:172.21.15.120:6789/0 conn(0x7f24d406da30 legacy=0x7f24d40d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.149+0000 7f24da213640 1 -- 172.21.15.120:0/1342614876 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d406e520 con 0x7f24d415e860 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.150+0000 7f24da213640 1 --2- 172.21.15.120:0/1342614876 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d415e860 0x7f24d406d4f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0097d0 tx=0x7f24cc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f8fe2af20cf0af server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.150+0000 7f24d9211640 1 -- 172.21.15.120:0/1342614876 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc035020 con 0x7f24d415e860 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.150+0000 7f24d9211640 1 -- 172.21.15.120:0/1342614876 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc031890 con 0x7f24d415e860 2024-03-31T16:35:10.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.150+0000 7f24d9211640 1 -- 172.21.15.120:0/1342614876 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc031c40 con 0x7f24d415e860 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.150+0000 7f24dc477640 1 -- 172.21.15.120:0/1342614876 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d415e860 msgr2=0x7f24d406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.150+0000 7f24dc477640 1 --2- 172.21.15.120:0/1342614876 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d415e860 0x7f24d406d4f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0097d0 tx=0x7f24cc02b930 comp rx=0 tx=0).stop 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.150+0000 7f24dc477640 1 -- 172.21.15.120:0/1342614876 shutdown_connections 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.150+0000 7f24dc477640 1 --2- 172.21.15.120:0/1342614876 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d415e860 0x7f24d406d4f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.151+0000 7f24dc477640 1 -- 172.21.15.120:0/1342614876 >> 172.21.15.120:0/1342614876 conn(0x7f24d409d7d0 msgr2=0x7f24d408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.151+0000 7f24dc477640 1 -- 172.21.15.120:0/1342614876 shutdown_connections 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.151+0000 7f24dc477640 1 -- 172.21.15.120:0/1342614876 wait complete. 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.152+0000 7f24dc477640 1 Processor -- start 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.152+0000 7f24dc477640 1 -- start start 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.152+0000 7f24dc477640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d406da30 0x7f24d40cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:10.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.152+0000 7f24dc477640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d40d4ae0 0x7f24d40b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.152+0000 7f24dc477640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24d415e860 0x7f24d414faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.152+0000 7f24dc477640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f24d40cef30 con 0x7f24d415e860 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.152+0000 7f24dc477640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f24d40cedb0 con 0x7f24d40d4ae0 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.152+0000 7f24dc477640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f24d40cfdc0 con 0x7f24d406da30 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24d415e860 0x7f24d414faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24d415e860 0x7f24d414faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33816/0 (socket says 172.21.15.120:33816) 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 -- 172.21.15.120:0/3119464688 learned_addr learned my addr 172.21.15.120:0/3119464688 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24d9a12640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d40d4ae0 0x7f24d40b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24da213640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d406da30 0x7f24d40cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 -- 172.21.15.120:0/3119464688 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d406da30 msgr2=0x7f24d40cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d406da30 0x7f24d40cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 -- 172.21.15.120:0/3119464688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d40d4ae0 msgr2=0x7f24d40b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d40d4ae0 0x7f24d40b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:10.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 -- 172.21.15.120:0/3119464688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d414ffe0 con 0x7f24d415e860 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24daa14640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24d415e860 0x7f24d414faa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24d000c7a0 tx=0x7f24d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24caffd640 1 -- 172.21.15.120:0/3119464688 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0003b70 con 0x7f24d415e860 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24caffd640 1 -- 172.21.15.120:0/3119464688 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0003d10 con 0x7f24d415e860 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d40b81e0 con 0x7f24d415e860 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24caffd640 1 -- 172.21.15.120:0/3119464688 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d000aa90 con 0x7f24d415e860 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d40b87a0 con 0x7f24d415e860 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24caffd640 1 -- 172.21.15.120:0/3119464688 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f24d000ac30 con 0x7f24d415e860 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.153+0000 7f24caffd640 1 -- 172.21.15.120:0/3119464688 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f24d0012d20 con 0x7f24d415e860 2024-03-31T16:35:10.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.154+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d40685c0 con 0x7f24d415e860 2024-03-31T16:35:10.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.158+0000 7f24caffd640 1 -- 172.21.15.120:0/3119464688 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f24d414ffe0 con 0x7f24d415e860 2024-03-31T16:35:10.218 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:10.214+0000 7f158a62e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-31T16:35:10.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.219+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24d41f4380 con 0x7f24d415e860 2024-03-31T16:35:10.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.220+0000 7f24caffd640 1 -- 172.21.15.120:0/3119464688 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f24d0012650 con 0x7f24d415e860 2024-03-31T16:35:10.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:10.224 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":10,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:09.963957+0000","last_up_change":"0.000000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:10.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24d415e860 msgr2=0x7f24d414faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:10.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24d415e860 0x7f24d414faa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24d000c7a0 tx=0x7f24d000cc60 comp rx=0 tx=0).stop 2024-03-31T16:35:10.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 shutdown_connections 2024-03-31T16:35:10.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24d415e860 0x7f24d414faa0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:10.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24d40d4ae0 0x7f24d40b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:10.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 --2- 172.21.15.120:0/3119464688 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24d406da30 0x7f24d40cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:10.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 >> 172.21.15.120:0/3119464688 conn(0x7f24d409d7d0 msgr2=0x7f24d40d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:10.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 shutdown_connections 2024-03-31T16:35:10.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:10.221+0000 7f24dc477640 1 -- 172.21.15.120:0/3119464688 wait complete. 2024-03-31T16:35:10.230 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:10.226+0000 7f6c20e2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T16:35:10.236 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-31T16:35:10.236 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-31T16:35:10.311 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:10.306+0000 7f158a62e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-31T16:35:10.387 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:10.383+0000 7f6c20e2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T16:35:10.429 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:10.425+0000 7f6c20e2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T16:35:10.468 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:10.464+0000 7f158a62e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-31T16:35:10.511 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:10.506+0000 7f158a62e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-31T16:35:10.584 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:10.579+0000 7f6c20e2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T16:35:10.590 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T16:35:10.586+0000 7fd015811640 -1 Falling back to public interface 2024-03-31T16:35:10.594 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T16:35:10.590+0000 7f67f880f640 -1 Falling back to public interface 2024-03-31T16:35:10.611 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T16:35:10.607+0000 7f422259e640 -1 Falling back to public interface 2024-03-31T16:35:10.612 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T16:35:10.608+0000 7effe500e640 -1 Falling back to public interface 2024-03-31T16:35:10.640 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T16:35:10.635+0000 7fca0e316640 -1 Falling back to public interface 2024-03-31T16:35:10.641 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T16:35:10.637+0000 7f4dc41e1640 -1 Falling back to public interface 2024-03-31T16:35:10.661 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T16:35:10.657+0000 7fb494d73640 -1 Falling back to public interface 2024-03-31T16:35:10.668 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:10.664+0000 7f158a62e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-31T16:35:10.671 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T16:35:10.667+0000 7f7fa7906640 -1 Falling back to public interface 2024-03-31T16:35:11.042 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:11.132 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.128+0000 7fd24131c640 1 Processor -- start 2024-03-31T16:35:11.132 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.128+0000 7fd24131c640 1 -- start start 2024-03-31T16:35:11.135 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.128+0000 7fd24131c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd23c15fa60 0x7fd23c0d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:11.135 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.128+0000 7fd24131c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c0d2f40 0x7fd23c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:11.135 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.128+0000 7fd24131c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23c0d0b60 con 0x7fd23c15e960 2024-03-31T16:35:11.135 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.128+0000 7fd24131c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fd23c0d0e40 con 0x7fd23c15fa60 2024-03-31T16:35:11.135 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.128+0000 7fd24131c640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c0d1120 con 0x7fd23c0d2f40 2024-03-31T16:35:11.135 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd23a7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd23c15fa60 0x7fd23c0d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd23affd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd23c15e960 0x7fd23c0d4d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:47536/0 (socket says 172.21.15.120:47536) 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd23affd640 1 -- 172.21.15.120:0/1427615102 learned_addr learned my addr 172.21.15.120:0/1427615102 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd23b7fe640 1 --2- 172.21.15.120:0/1427615102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c0d2f40 0x7fd23c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd23a7fc640 1 -- 172.21.15.120:0/1427615102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c0d2f40 msgr2=0x7fd23c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd23a7fc640 1 --2- 172.21.15.120:0/1427615102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c0d2f40 0x7fd23c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd23a7fc640 1 -- 172.21.15.120:0/1427615102 >> v1:172.21.15.120:6789/0 conn(0x7fd23c15e960 legacy=0x7fd23c0d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd239ffb640 1 -- 172.21.15.120:0/1427615102 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 622676715 0 0) 0x7fd23c0d0b60 con 0x7fd23c15e960 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.129+0000 7fd23a7fc640 1 -- 172.21.15.120:0/1427615102 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c0d1400 con 0x7fd23c15fa60 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.130+0000 7fd23a7fc640 1 --2- 172.21.15.120:0/1427615102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c0d2a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd230009790 tx=0x7fd23002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fc5a32e71bdda0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.130+0000 7fd239ffb640 1 -- 172.21.15.120:0/1427615102 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230031770 con 0x7fd23c15fa60 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.130+0000 7fd239ffb640 1 -- 172.21.15.120:0/1427615102 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd230037070 con 0x7fd23c15fa60 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.130+0000 7fd239ffb640 1 -- 172.21.15.120:0/1427615102 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230031b30 con 0x7fd23c15fa60 2024-03-31T16:35:11.136 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.130+0000 7fd24131c640 1 -- 172.21.15.120:0/1427615102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 msgr2=0x7fd23c0d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:11.137 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.130+0000 7fd24131c640 1 --2- 172.21.15.120:0/1427615102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c0d2a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd230009790 tx=0x7fd23002b810 comp rx=0 tx=0).stop 2024-03-31T16:35:11.137 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.131+0000 7fd24131c640 1 -- 172.21.15.120:0/1427615102 shutdown_connections 2024-03-31T16:35:11.137 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.131+0000 7fd24131c640 1 --2- 172.21.15.120:0/1427615102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c0d2f40 0x7fd23c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.137 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.131+0000 7fd24131c640 1 --2- 172.21.15.120:0/1427615102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c0d2a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.137 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.131+0000 7fd24131c640 1 -- 172.21.15.120:0/1427615102 >> 172.21.15.120:0/1427615102 conn(0x7fd23c08bff0 msgr2=0x7fd23c0d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:11.137 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.131+0000 7fd24131c640 1 -- 172.21.15.120:0/1427615102 shutdown_connections 2024-03-31T16:35:11.137 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.131+0000 7fd24131c640 1 -- 172.21.15.120:0/1427615102 wait complete. 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.132+0000 7fd24131c640 1 Processor -- start 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.132+0000 7fd24131c640 1 -- start start 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd24131c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd23c0d2f40 0x7fd23c0c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd24131c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c15e960 0x7fd23c15d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd24131c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c1f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd24131c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0cf8b0 con 0x7fd23c15fa60 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd24131c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd23c0cf730 con 0x7fd23c0d2f40 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd24131c640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c0cfa30 con 0x7fd23c15e960 2024-03-31T16:35:11.140 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c1f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c1f7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33824/0 (socket says 172.21.15.120:33824) 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23a7fc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c15e960 0x7fd23c15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 -- 172.21.15.120:0/1156915409 learned_addr learned my addr 172.21.15.120:0/1156915409 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23affd640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd23c0d2f40 0x7fd23c0c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 -- 172.21.15.120:0/1156915409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c15e960 msgr2=0x7fd23c15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c15e960 0x7fd23c15d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 -- 172.21.15.120:0/1156915409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd23c0d2f40 msgr2=0x7fd23c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd23c0d2f40 0x7fd23c0c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 -- 172.21.15.120:0/1156915409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c1f8d50 con 0x7fd23c15fa60 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23a7fc640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c15e960 0x7fd23c15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd23b7fe640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c1f7f00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd234007e40 tx=0x7fd23400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd2237fe640 1 -- 172.21.15.120:0/1156915409 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234014620 con 0x7fd23c15fa60 2024-03-31T16:35:11.141 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd2237fe640 1 -- 172.21.15.120:0/1156915409 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd234019070 con 0x7fd23c15fa60 2024-03-31T16:35:11.142 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c1f8a70 con 0x7fd23c15fa60 2024-03-31T16:35:11.142 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.133+0000 7fd2237fe640 1 -- 172.21.15.120:0/1156915409 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234014a20 con 0x7fd23c15fa60 2024-03-31T16:35:11.142 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.134+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c0b73c0 con 0x7fd23c15fa60 2024-03-31T16:35:11.142 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.134+0000 7fd2237fe640 1 -- 172.21.15.120:0/1156915409 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd234014bc0 con 0x7fd23c15fa60 2024-03-31T16:35:11.142 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.134+0000 7fd2237fe640 1 -- 172.21.15.120:0/1156915409 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd23401db20 con 0x7fd23c15fa60 2024-03-31T16:35:11.142 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.134+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c0d16e0 con 0x7fd23c15fa60 2024-03-31T16:35:11.142 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.137+0000 7fd2237fe640 1 -- 172.21.15.120:0/1156915409 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd23c0d16e0 con 0x7fd23c15fa60 2024-03-31T16:35:11.204 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.199+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd23c04f8b0 con 0x7fd23c15fa60 2024-03-31T16:35:11.204 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.200+0000 7fd2237fe640 1 -- 172.21.15.120:0/1156915409 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd23401dd70 con 0x7fd23c15fa60 2024-03-31T16:35:11.205 INFO:teuthology.misc.health.smithi120.stdout: 2024-03-31T16:35:11.205 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":10,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:09.963957+0000","last_up_change":"0.000000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 msgr2=0x7fd23c1f7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c1f7f00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd234007e40 tx=0x7fd23400e4b0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 shutdown_connections 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23c15fa60 0x7fd23c1f7f00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd23c15e960 0x7fd23c15d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 --2- 172.21.15.120:0/1156915409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd23c0d2f40 0x7fd23c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 >> 172.21.15.120:0/1156915409 conn(0x7fd23c08bff0 msgr2=0x7fd23c0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 shutdown_connections 2024-03-31T16:35:11.206 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:11.201+0000 7fd24131c640 1 -- 172.21.15.120:0/1156915409 wait complete. 2024-03-31T16:35:11.215 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-31T16:35:11.409 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:11.404+0000 7f6c20e2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T16:35:11.682 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:11.678+0000 7f6c20e2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T16:35:11.734 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:11.730+0000 7f6c20e2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T16:35:11.767 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:11.763+0000 7f158a62e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-31T16:35:11.849 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:11.845+0000 7f6c20e2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T16:35:12.051 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:12.047+0000 7f158a62e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-31T16:35:12.103 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:12.099+0000 7f158a62e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-31T16:35:12.216 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-03-31T16:35:12.212+0000 7f158a62e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-31T16:35:12.864 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:12.860+0000 7f6bc139a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-31T16:35:12.865 INFO:tasks.ceph.mgr.y.smithi120.stderr:2024-03-31T16:35:12.860+0000 7f6bc139a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-31T16:35:14.065 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T16:35:14.061+0000 7fd015811640 -1 osd.1 0 log_to_monitors true 2024-03-31T16:35:14.107 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T16:35:14.102+0000 7fca0e316640 -1 osd.4 0 log_to_monitors true 2024-03-31T16:35:14.107 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T16:35:14.103+0000 7f422259e640 -1 osd.3 0 log_to_monitors true 2024-03-31T16:35:14.108 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T16:35:14.104+0000 7f67f880f640 -1 osd.0 0 log_to_monitors true 2024-03-31T16:35:14.126 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T16:35:14.121+0000 7effe500e640 -1 osd.2 0 log_to_monitors true 2024-03-31T16:35:14.135 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T16:35:14.131+0000 7f4dc41e1640 -1 osd.5 0 log_to_monitors true 2024-03-31T16:35:14.190 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T16:35:14.186+0000 7f7fa7906640 -1 osd.6 0 log_to_monitors true 2024-03-31T16:35:14.197 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T16:35:14.192+0000 7fb494d73640 -1 osd.7 0 log_to_monitors true 2024-03-31T16:35:17.844 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T16:35:17.841+0000 7fd011204640 -1 osd.1 0 waiting for initial osdmap 2024-03-31T16:35:17.860 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T16:35:17.857+0000 7fd009024640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T16:35:17.893 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T16:35:17.890+0000 7f421e534640 -1 osd.3 0 waiting for initial osdmap 2024-03-31T16:35:17.906 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T16:35:17.903+0000 7f4216354640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T16:35:17.923 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T16:35:17.920+0000 7effe08c6640 -1 osd.2 0 waiting for initial osdmap 2024-03-31T16:35:17.937 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T16:35:17.934+0000 7effd86e6640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T16:35:17.941 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T16:35:17.936+0000 7f4dc0177640 -1 osd.5 0 waiting for initial osdmap 2024-03-31T16:35:17.951 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T16:35:17.947+0000 7fca0aac0640 -1 osd.4 0 waiting for initial osdmap 2024-03-31T16:35:17.953 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T16:35:17.949+0000 7f4db7f97640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T16:35:17.963 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T16:35:17.960+0000 7f67f4227640 -1 osd.0 0 waiting for initial osdmap 2024-03-31T16:35:17.966 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T16:35:17.962+0000 7fca020cc640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T16:35:17.969 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T16:35:17.964+0000 7fb490d09640 -1 osd.7 0 waiting for initial osdmap 2024-03-31T16:35:17.983 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T16:35:17.980+0000 7f67ec047640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T16:35:17.985 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T16:35:17.981+0000 7fb488b29640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T16:35:17.987 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T16:35:17.983+0000 7f7fa389c640 -1 osd.6 0 waiting for initial osdmap 2024-03-31T16:35:17.999 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T16:35:17.995+0000 7f7f9b6bc640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-31T16:35:18.022 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:18.111 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.107+0000 7f53f2adc640 1 Processor -- start 2024-03-31T16:35:18.111 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53f2adc640 1 -- start start 2024-03-31T16:35:18.112 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53f2adc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f53ec06fcd0 0x7f53ec070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:18.112 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53f2adc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f53ec162390 0x7f53ec1627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:18.112 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53f2adc640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ec0b0700 con 0x7f53ec0cced0 2024-03-31T16:35:18.112 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53f2adc640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f53ec072fe0 con 0x7f53ec06fcd0 2024-03-31T16:35:18.112 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53f2adc640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f53ec073230 con 0x7f53ec162390 2024-03-31T16:35:18.112 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53ebfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f53ec06fcd0 0x7f53ec070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:18.113 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53ebfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f53ec06fcd0 0x7f53ec070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38020/0 (socket says 172.21.15.120:38020) 2024-03-31T16:35:18.113 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53f0878640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f53ec0cced0 0x7f53ec0ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40030/0 (socket says 172.21.15.120:40030) 2024-03-31T16:35:18.113 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.108+0000 7f53ebfff640 1 -- 172.21.15.120:0/727375937 learned_addr learned my addr 172.21.15.120:0/727375937 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:18.113 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.109+0000 7f53ebfff640 1 -- 172.21.15.120:0/727375937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f53ec162390 msgr2=0x7f53ec1627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:18.113 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.109+0000 7f53ebfff640 1 --2- 172.21.15.120:0/727375937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f53ec162390 0x7f53ec1627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.113 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.109+0000 7f53ebfff640 1 -- 172.21.15.120:0/727375937 >> v1:172.21.15.120:6789/0 conn(0x7f53ec0cced0 legacy=0x7f53ec0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:18.113 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.109+0000 7f53eb7fe640 1 -- 172.21.15.120:0/727375937 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9320195 0 0) 0x7f53ec0b0700 con 0x7f53ec0cced0 2024-03-31T16:35:18.113 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.109+0000 7f53ebfff640 1 -- 172.21.15.120:0/727375937 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec073510 con 0x7f53ec06fcd0 2024-03-31T16:35:18.115 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.109+0000 7f53ebfff640 1 --2- 172.21.15.120:0/727375937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec06fcd0 0x7f53ec070160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009870 tx=0x7f53d402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0b20c542fe500c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:18.115 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53eb7fe640 1 -- 172.21.15.120:0/727375937 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4035020 con 0x7f53ec06fcd0 2024-03-31T16:35:18.115 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53eb7fe640 1 -- 172.21.15.120:0/727375937 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d4031640 con 0x7f53ec06fcd0 2024-03-31T16:35:18.115 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53eb7fe640 1 -- 172.21.15.120:0/727375937 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d402d040 con 0x7f53ec06fcd0 2024-03-31T16:35:18.115 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53f2adc640 1 -- 172.21.15.120:0/727375937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec06fcd0 msgr2=0x7f53ec070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:18.115 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53f2adc640 1 --2- 172.21.15.120:0/727375937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec06fcd0 0x7f53ec070160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53d4009870 tx=0x7f53d402b8f0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.115 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53f2adc640 1 -- 172.21.15.120:0/727375937 shutdown_connections 2024-03-31T16:35:18.116 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53f2adc640 1 --2- 172.21.15.120:0/727375937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f53ec162390 0x7f53ec1627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.116 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53f2adc640 1 --2- 172.21.15.120:0/727375937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec06fcd0 0x7f53ec070160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.116 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53f2adc640 1 -- 172.21.15.120:0/727375937 >> 172.21.15.120:0/727375937 conn(0x7f53ec0b2cf0 msgr2=0x7f53ec0b3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:18.116 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53f2adc640 1 -- 172.21.15.120:0/727375937 shutdown_connections 2024-03-31T16:35:18.116 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.110+0000 7f53f2adc640 1 -- 172.21.15.120:0/727375937 wait complete. 2024-03-31T16:35:18.116 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.111+0000 7f53f2adc640 1 Processor -- start 2024-03-31T16:35:18.116 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.111+0000 7f53f2adc640 1 -- start start 2024-03-31T16:35:18.119 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53f2adc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f53ec06fcd0 0x7f53ec0c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:18.119 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53f2adc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec0cced0 0x7f53ec1f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:18.119 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53f2adc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53ec162390 0x7f53ec15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:18.119 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53f2adc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec0cd2b0 con 0x7f53ec0cced0 2024-03-31T16:35:18.119 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53f2adc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec0cdc90 con 0x7f53ec162390 2024-03-31T16:35:18.119 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53f2adc640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f53ec0ce8c0 con 0x7f53ec06fcd0 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53ebfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec0cced0 0x7f53ec1f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53ebfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec0cced0 0x7f53ec1f8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38032/0 (socket says 172.21.15.120:38032) 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.112+0000 7f53ebfff640 1 -- 172.21.15.120:0/403524363 learned_addr learned my addr 172.21.15.120:0/403524363 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53ebfff640 1 -- 172.21.15.120:0/403524363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f53ec06fcd0 msgr2=0x7f53ec0c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53ebfff640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f53ec06fcd0 0x7f53ec0c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53ebfff640 1 -- 172.21.15.120:0/403524363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53ec162390 msgr2=0x7f53ec15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53ebfff640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53ec162390 0x7f53ec15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53ebfff640 1 -- 172.21.15.120:0/403524363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec0b5b00 con 0x7f53ec0cced0 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53ebfff640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec0cced0 0x7f53ec1f8340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53d4000c00 tx=0x7f53d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53e97fa640 1 -- 172.21.15.120:0/403524363 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d403ac60 con 0x7f53ec0cced0 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53e97fa640 1 -- 172.21.15.120:0/403524363 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d403ae20 con 0x7f53ec0cced0 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53e97fa640 1 -- 172.21.15.120:0/403524363 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4044630 con 0x7f53ec0cced0 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ec0b5de0 con 0x7f53ec0cced0 2024-03-31T16:35:18.120 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.113+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ec0b57f0 con 0x7f53ec0cced0 2024-03-31T16:35:18.121 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.114+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ec06c2c0 con 0x7f53ec0cced0 2024-03-31T16:35:18.121 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.114+0000 7f53e97fa640 1 -- 172.21.15.120:0/403524363 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f53d4038020 con 0x7f53ec0cced0 2024-03-31T16:35:18.121 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.115+0000 7f53e97fa640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f53cc06c890 0x7f53cc06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:18.121 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.115+0000 7f53f0878640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f53cc06c890 0x7f53cc06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:18.121 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.115+0000 7f53e97fa640 1 -- 172.21.15.120:0/403524363 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f53d40aca10 con 0x7f53ec0cced0 2024-03-31T16:35:18.121 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.115+0000 7f53f0878640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f53cc06c890 0x7f53cc06ed50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f53e4007fd0 tx=0x7f53e4007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:18.126 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.120+0000 7f53e97fa640 1 -- 172.21.15.120:0/403524363 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f53ec06c2c0 con 0x7f53ec0cced0 2024-03-31T16:35:18.297 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.293+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53ec06f010 con 0x7f53ec0cced0 2024-03-31T16:35:18.297 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.294+0000 7f53e97fa640 1 -- 172.21.15.120:0/403524363 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f53ec06f010 con 0x7f53ec0cced0 2024-03-31T16:35:18.297 INFO:teuthology.misc.health.smithi120.stdout: 2024-03-31T16:35:18.298 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":12,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:15.862547+0000","last_up_change":"0.000000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:18.299 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f53cc06c890 msgr2=0x7f53cc06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f53cc06c890 0x7f53cc06ed50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f53e4007fd0 tx=0x7f53e4007ce0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec0cced0 msgr2=0x7f53ec1f8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec0cced0 0x7f53ec1f8340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53d4000c00 tx=0x7f53d40046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 shutdown_connections 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f53cc06c890 0x7f53cc06ed50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53ec162390 0x7f53ec15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f53ec0cced0 0x7f53ec1f8340 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 --2- 172.21.15.120:0/403524363 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f53ec06fcd0 0x7f53ec0c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 >> 172.21.15.120:0/403524363 conn(0x7f53ec0b2cf0 msgr2=0x7f53ec0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:18.300 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 shutdown_connections 2024-03-31T16:35:18.301 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:18.296+0000 7f53f2adc640 1 -- 172.21.15.120:0/403524363 wait complete. 2024-03-31T16:35:18.309 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-31T16:35:25.114 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:25.214 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.209+0000 7fd87bc4a640 1 Processor -- start 2024-03-31T16:35:25.214 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.210+0000 7fd87bc4a640 1 -- start start 2024-03-31T16:35:25.215 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.210+0000 7fd87bc4a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd87415f340 0x7fd8740d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.215 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.210+0000 7fd87bc4a640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd87415f720 0x7fd8740d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.215 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd87bc4a640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8740d1730 con 0x7fd8740d12e0 2024-03-31T16:35:25.215 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd87bc4a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fd87406c5b0 con 0x7fd87415f340 2024-03-31T16:35:25.215 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd87bc4a640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd8740d2780 con 0x7fd87415f720 2024-03-31T16:35:25.215 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd8799e6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd87415f340 0x7fd8740d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.216 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd8799e6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd87415f340 0x7fd8740d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55958/0 (socket says 172.21.15.120:55958) 2024-03-31T16:35:25.216 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd8799e6640 1 -- 172.21.15.120:0/1940533913 learned_addr learned my addr 172.21.15.120:0/1940533913 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:25.216 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd8791e5640 1 --2- 172.21.15.120:0/1940533913 >> v2:172.21.15.203:3300/0 conn(0x7fd87415f720 0x7fd8740d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.216 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd8799e6640 1 -- 172.21.15.120:0/1940533913 >> v2:172.21.15.203:3300/0 conn(0x7fd87415f720 msgr2=0x7fd8740d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:25.216 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd8799e6640 1 --2- 172.21.15.120:0/1940533913 >> v2:172.21.15.203:3300/0 conn(0x7fd87415f720 0x7fd8740d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.216 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd8799e6640 1 -- 172.21.15.120:0/1940533913 >> v1:172.21.15.203:6789/0 conn(0x7fd8740d12e0 legacy=0x7fd874162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:25.216 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.211+0000 7fd8799e6640 1 -- 172.21.15.120:0/1940533913 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8740d2a60 con 0x7fd87415f340 2024-03-31T16:35:25.217 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.212+0000 7fd8799e6640 1 --2- 172.21.15.120:0/1940533913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740d2080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd870009870 tx=0x7fd87002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ad17179edb67ef server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.217 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.212+0000 7fd8789e4640 1 -- 172.21.15.120:0/1940533913 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870035020 con 0x7fd87415f340 2024-03-31T16:35:25.217 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.212+0000 7fd8789e4640 1 -- 172.21.15.120:0/1940533913 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd870031870 con 0x7fd87415f340 2024-03-31T16:35:25.217 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.212+0000 7fd8789e4640 1 -- 172.21.15.120:0/1940533913 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870031c40 con 0x7fd87415f340 2024-03-31T16:35:25.217 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.212+0000 7fd87bc4a640 1 -- 172.21.15.120:0/1940533913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 msgr2=0x7fd8740d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.217 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.212+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/1940533913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740d2080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd870009870 tx=0x7fd87002b910 comp rx=0 tx=0).stop 2024-03-31T16:35:25.217 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.213+0000 7fd87bc4a640 1 -- 172.21.15.120:0/1940533913 shutdown_connections 2024-03-31T16:35:25.217 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.213+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/1940533913 >> v2:172.21.15.203:3300/0 conn(0x7fd87415f720 0x7fd8740d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.218 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.213+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/1940533913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740d2080 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.218 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.213+0000 7fd87bc4a640 1 -- 172.21.15.120:0/1940533913 >> 172.21.15.120:0/1940533913 conn(0x7fd87409d7a0 msgr2=0x7fd8740d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:25.218 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.213+0000 7fd87bc4a640 1 -- 172.21.15.120:0/1940533913 shutdown_connections 2024-03-31T16:35:25.218 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.213+0000 7fd87bc4a640 1 -- 172.21.15.120:0/1940533913 wait complete. 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.214+0000 7fd87bc4a640 1 Processor -- start 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.214+0000 7fd87bc4a640 1 -- start start 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87bc4a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8740d12e0 0x7fd87415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87bc4a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87bc4a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd87415f720 0x7fd8741f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87bc4a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd8740d3300 con 0x7fd87415f340 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87bc4a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8740d3020 con 0x7fd8740d12e0 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87bc4a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd87415fb90 con 0x7fd87415f720 2024-03-31T16:35:25.220 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55968/0 (socket says 172.21.15.120:55968) 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 -- 172.21.15.120:0/14388909 learned_addr learned my addr 172.21.15.120:0/14388909 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8799e6640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8740d12e0 0x7fd87415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 -- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd87415f720 msgr2=0x7fd8741f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87a1e7640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd87415f720 0x7fd8741f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd87415f720 0x7fd8741f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 -- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8740d12e0 msgr2=0x7fd87415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8740d12e0 0x7fd87415bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 -- 172.21.15.120:0/14388909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8741f55e0 con 0x7fd87415f340 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8799e6640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8740d12e0 0x7fd87415bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd8791e5640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740b4710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd86400d800 tx=0x7fd86400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd86a7fc640 1 -- 172.21.15.120:0/14388909 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86400b660 con 0x7fd87415f340 2024-03-31T16:35:25.221 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd86a7fc640 1 -- 172.21.15.120:0/14388909 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd864019070 con 0x7fd87415f340 2024-03-31T16:35:25.222 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8741f58c0 con 0x7fd87415f340 2024-03-31T16:35:25.222 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd86a7fc640 1 -- 172.21.15.120:0/14388909 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86400ba20 con 0x7fd87415f340 2024-03-31T16:35:25.222 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.215+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8740b41f0 con 0x7fd87415f340 2024-03-31T16:35:25.223 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.216+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8740b33c0 con 0x7fd87415f340 2024-03-31T16:35:25.223 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.217+0000 7fd86a7fc640 1 -- 172.21.15.120:0/14388909 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd86400bbc0 con 0x7fd87415f340 2024-03-31T16:35:25.223 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.217+0000 7fd86a7fc640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd85806c8f0 0x7fd85806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.223 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.217+0000 7fd8799e6640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd85806c8f0 0x7fd85806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.223 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.217+0000 7fd86a7fc640 1 -- 172.21.15.120:0/14388909 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd86408bba0 con 0x7fd87415f340 2024-03-31T16:35:25.223 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.218+0000 7fd8799e6640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd85806c8f0 0x7fd85806edb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd870036000 tx=0x7fd870008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.226 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.222+0000 7fd86a7fc640 1 -- 172.21.15.120:0/14388909 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd8740b33c0 con 0x7fd87415f340 2024-03-31T16:35:25.403 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.399+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd87404f8b0 con 0x7fd87415f340 2024-03-31T16:35:25.404 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.400+0000 7fd86a7fc640 1 -- 172.21.15.120:0/14388909 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7fd86401c360 con 0x7fd87415f340 2024-03-31T16:35:25.404 INFO:teuthology.misc.health.smithi120.stdout: 2024-03-31T16:35:25.404 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":16,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:21.999323+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:25.406 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd85806c8f0 msgr2=0x7fd85806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.406 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd85806c8f0 0x7fd85806edb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd870036000 tx=0x7fd870008030 comp rx=0 tx=0).stop 2024-03-31T16:35:25.406 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 msgr2=0x7fd8740b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.406 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740b4710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd86400d800 tx=0x7fd86400dcc0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.406 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 shutdown_connections 2024-03-31T16:35:25.406 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd85806c8f0 0x7fd85806edb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.406 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd87415f720 0x7fd8741f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.407 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd87415f340 0x7fd8740b4710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.407 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 --2- 172.21.15.120:0/14388909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8740d12e0 0x7fd87415bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.407 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.401+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 >> 172.21.15.120:0/14388909 conn(0x7fd87409d7a0 msgr2=0x7fd8740b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:25.407 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.402+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 shutdown_connections 2024-03-31T16:35:25.407 INFO:teuthology.misc.health.smithi120.stderr:2024-03-31T16:35:25.402+0000 7fd87bc4a640 1 -- 172.21.15.120:0/14388909 wait complete. 2024-03-31T16:35:25.416 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-31T16:35:25.416 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-31T16:35:25.416 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-31T16:35:25.416 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-31T16:35:25.418 INFO:tasks.ceph.mds.a:Started 2024-03-31T16:35:25.419 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-31T16:35:25.419 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-31T16:35:25.421 INFO:tasks.ceph.mds.c:Started 2024-03-31T16:35:25.421 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-31T16:35:25.421 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-31T16:35:25.424 INFO:tasks.ceph.mds.b:Started 2024-03-31T16:35:25.424 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-31T16:35:25.424 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-31T16:35:25.426 INFO:tasks.ceph.mds.d:Started 2024-03-31T16:35:25.426 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-31T16:35:25.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:25.495 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-03-31T16:35:25.495 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-03-31T16:35:25.510 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-03-31T16:35:25.510 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-03-31T16:35:25.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.528+0000 7f594cbb5640 1 Processor -- start 2024-03-31T16:35:25.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.528+0000 7f594cbb5640 1 -- start start 2024-03-31T16:35:25.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594cbb5640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f59481457e0 0x7f59480b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594cbb5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59480b5ed0 con 0x7f594806bc80 2024-03-31T16:35:25.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594cbb5640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59480b61b0 con 0x7f59480b4580 2024-03-31T16:35:25.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594cbb5640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5948145bc0 con 0x7f59481457e0 2024-03-31T16:35:25.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f5946d9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f594806bc80 0x7f59480b0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45450/0 (socket says 172.21.15.120:45450) 2024-03-31T16:35:25.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f5946d9d640 1 -- 172.21.15.120:0/454008344 learned_addr learned my addr 172.21.15.120:0/454008344 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594659c640 1 --2- 172.21.15.120:0/454008344 >> v2:172.21.15.203:3300/0 conn(0x7f59481457e0 0x7f59480b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578343610 0 0) 0x7f59480b5ed0 con 0x7f594806bc80 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5930003520 con 0x7f594806bc80 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1782025858 0 0) 0x7f5930003520 con 0x7f594806bc80 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 >> v2:172.21.15.203:3300/0 conn(0x7f59481457e0 msgr2=0x7f59480b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 --2- 172.21.15.120:0/454008344 >> v2:172.21.15.203:3300/0 conn(0x7f59481457e0 0x7f59480b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 >> v1:172.21.15.203:6789/0 conn(0x7f59480b4580 legacy=0x7f594806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59480af870 con 0x7f594806bc80 2024-03-31T16:35:25.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7f59400019f0 con 0x7f594806bc80 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 >> v1:172.21.15.120:6789/0 conn(0x7f594806bc80 legacy=0x7f59480b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5930003a00 0x7f5930003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5930004800 0x7f5930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930005210 0x7f593000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5948145bc0 con 0x7f5930004800 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f593000c160 con 0x7f5930003a00 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f593000c360 con 0x7f5930005210 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.529+0000 7f5945d9b640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5930004800 0x7f5930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.530+0000 7f5946d9d640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930005210 0x7f593000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.530+0000 7f5945d9b640 1 -- 172.21.15.120:0/454008344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930005210 msgr2=0x7f593000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.530+0000 7f5945d9b640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930005210 0x7f593000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.530+0000 7f5945d9b640 1 -- 172.21.15.120:0/454008344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5930003a00 msgr2=0x7f5930003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.530+0000 7f5945d9b640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5930003a00 0x7f5930003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.530+0000 7f5945d9b640 1 -- 172.21.15.120:0/454008344 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5930003520 con 0x7f5930004800 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.530+0000 7f5946d9d640 1 -- 172.21.15.120:0/454008344 reap_dead start 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.530+0000 7f5945d9b640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5930004800 0x7f5930004c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59480b4980 tx=0x7f5930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4079aeb1e7929c8a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c001370 con 0x7f5930004800 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593c0052d0 con 0x7f5930004800 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594559a640 1 -- 172.21.15.120:0/454008344 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c003830 con 0x7f5930004800 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594cbb5640 1 -- 172.21.15.120:0/454008344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5930004800 msgr2=0x7f5930004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594cbb5640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5930004800 0x7f5930004c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59480b4980 tx=0x7f5930005830 comp rx=0 tx=0).stop 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594cbb5640 1 -- 172.21.15.120:0/454008344 shutdown_connections 2024-03-31T16:35:25.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594cbb5640 1 --2- 172.21.15.120:0/454008344 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5930004800 0x7f5930004c80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594cbb5640 1 -- 172.21.15.120:0/454008344 >> 172.21.15.120:0/454008344 conn(0x7f59480b65a0 msgr2=0x7f59480b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:25.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594cbb5640 1 -- 172.21.15.120:0/454008344 shutdown_connections 2024-03-31T16:35:25.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.531+0000 7f594cbb5640 1 -- 172.21.15.120:0/454008344 wait complete. 2024-03-31T16:35:25.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f594cbb5640 1 Processor -- start 2024-03-31T16:35:25.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f594cbb5640 1 -- start start 2024-03-31T16:35:25.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f594cbb5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930004800 0x7f594815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f594cbb5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f594813aa70 0x7f594813cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f594cbb5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f594815b560 0x7f594813d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f594cbb5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5948160a30 con 0x7f594813aa70 2024-03-31T16:35:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f594cbb5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f59480afca0 con 0x7f594815b560 2024-03-31T16:35:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f594cbb5640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5948160bb0 con 0x7f5930004800 2024-03-31T16:35:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f5945d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f594813aa70 0x7f594813cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f5945d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f594813aa70 0x7f594813cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56006/0 (socket says 172.21.15.120:56006) 2024-03-31T16:35:25.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.533+0000 7f5945d9b640 1 -- 172.21.15.120:0/530225698 learned_addr learned my addr 172.21.15.120:0/530225698 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:25.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5946d9d640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f594815b560 0x7f594813d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f594659c640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930004800 0x7f594815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5945d9b640 1 -- 172.21.15.120:0/530225698 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930004800 msgr2=0x7f594815ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5945d9b640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930004800 0x7f594815ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5945d9b640 1 -- 172.21.15.120:0/530225698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f594815b560 msgr2=0x7f594813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5945d9b640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f594815b560 0x7f594813d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5945d9b640 1 -- 172.21.15.120:0/530225698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594813afc0 con 0x7f594813aa70 2024-03-31T16:35:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5945d9b640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f594813aa70 0x7f594813cd70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f593c005040 tx=0x7f593c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5936ffd640 1 -- 172.21.15.120:0/530225698 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c007a30 con 0x7f594813aa70 2024-03-31T16:35:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5936ffd640 1 -- 172.21.15.120:0/530225698 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593c042070 con 0x7f594813aa70 2024-03-31T16:35:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f5936ffd640 1 -- 172.21.15.120:0/530225698 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c001370 con 0x7f594813aa70 2024-03-31T16:35:25.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594813b2a0 con 0x7f594813aa70 2024-03-31T16:35:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.534+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594813b860 con 0x7f594813aa70 2024-03-31T16:35:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.535+0000 7f5936ffd640 1 -- 172.21.15.120:0/530225698 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f593c03b040 con 0x7f594813aa70 2024-03-31T16:35:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.536+0000 7f5936ffd640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f592806c920 0x7f592806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.536+0000 7f5936ffd640 1 -- 172.21.15.120:0/530225698 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f593c0acd90 con 0x7f594813aa70 2024-03-31T16:35:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.536+0000 7f594659c640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f592806c920 0x7f592806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.536+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5948068cd0 con 0x7f594813aa70 2024-03-31T16:35:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.536+0000 7f594659c640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f592806c920 0x7f592806ede0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5938009ad0 tx=0x7f5938008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.541+0000 7f5936ffd640 1 -- 172.21.15.120:0/530225698 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f593c0313a0 con 0x7f594813aa70 2024-03-31T16:35:25.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.717+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59480d1700 con 0x7f594813aa70 2024-03-31T16:35:25.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.718+0000 7f5936ffd640 1 -- 172.21.15.120:0/530225698 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7f593c07b5a0 con 0x7f594813aa70 2024-03-31T16:35:25.722 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:25.723 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:21.999323+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:25.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f592806c920 msgr2=0x7f592806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f592806c920 0x7f592806ede0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5938009ad0 tx=0x7f5938008040 comp rx=0 tx=0).stop 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f594813aa70 msgr2=0x7f594813cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f594813aa70 0x7f594813cd70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f593c005040 tx=0x7f593c001120 comp rx=0 tx=0).stop 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 shutdown_connections 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f592806c920 0x7f592806ede0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f594815b560 0x7f594813d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f594813aa70 0x7f594813cd70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 --2- 172.21.15.120:0/530225698 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5930004800 0x7f594815ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 >> 172.21.15.120:0/530225698 conn(0x7f59480b65a0 msgr2=0x7f59480b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 shutdown_connections 2024-03-31T16:35:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.720+0000 7f594cbb5640 1 -- 172.21.15.120:0/530225698 wait complete. 2024-03-31T16:35:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:35:25.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:35:25.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.834+0000 7ff798d2b640 1 Processor -- start 2024-03-31T16:35:25.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.834+0000 7ff798d2b640 1 -- start start 2024-03-31T16:35:25.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff798d2b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7940d4760 0x7ff794169550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff798d2b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7940ceef0 con 0x7ff79415e6d0 2024-03-31T16:35:25.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff798d2b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff79415eab0 con 0x7ff7940d0cb0 2024-03-31T16:35:25.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff798d2b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff7940d1220 con 0x7ff7940d4760 2024-03-31T16:35:25.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff79259c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff79415e6d0 0x7ff7940d21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45454/0 (socket says 172.21.15.120:45454) 2024-03-31T16:35:25.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff79259c640 1 -- 172.21.15.120:0/3488434641 learned_addr learned my addr 172.21.15.120:0/3488434641 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:25.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff792d9d640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7940d4760 0x7ff794169550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256833670 0 0) 0x7ff7940ceef0 con 0x7ff79415e6d0 2024-03-31T16:35:25.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff780003520 con 0x7ff79415e6d0 2024-03-31T16:35:25.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1221896604 0 0) 0x7ff780003520 con 0x7ff79415e6d0 2024-03-31T16:35:25.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7940d4760 msgr2=0x7ff794169550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:25.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7940d4760 0x7ff794169550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 >> v1:172.21.15.203:6789/0 conn(0x7ff7940d0cb0 legacy=0x7ff7940d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7940d1500 con 0x7ff79415e6d0 2024-03-31T16:35:25.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7ff784001670 con 0x7ff79415e6d0 2024-03-31T16:35:25.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 >> v1:172.21.15.120:6789/0 conn(0x7ff79415e6d0 legacy=0x7ff7940d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7800039e0 0x7ff780003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff780004800 0x7ff780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7940d4760 0x7ff7800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff7940d1220 con 0x7ff780004800 2024-03-31T16:35:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff78000baa0 con 0x7ff7800039e0 2024-03-31T16:35:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.835+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff78000bca0 con 0x7ff7940d4760 2024-03-31T16:35:25.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff78bfff640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff780004800 0x7ff780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff79259c640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7800039e0 0x7ff780003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff792d9d640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7940d4760 0x7ff7800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff78bfff640 1 -- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7940d4760 msgr2=0x7ff7800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff78bfff640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7940d4760 0x7ff7800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff78bfff640 1 -- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7800039e0 msgr2=0x7ff780003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff78bfff640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7800039e0 0x7ff780003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff78bfff640 1 -- 172.21.15.120:0/3488434641 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff780003520 con 0x7ff780004800 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.836+0000 7ff78bfff640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff780004800 0x7ff780004c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff77c007fd0 tx=0x7ff780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865dbe0f4f5cf2b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c0013c0 con 0x7ff780004800 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77c0052d0 con 0x7ff780004800 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff791d9b640 1 -- 172.21.15.120:0/3488434641 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c003640 con 0x7ff780004800 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff798d2b640 1 -- 172.21.15.120:0/3488434641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff780004800 msgr2=0x7ff780004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff798d2b640 1 --2- 172.21.15.120:0/3488434641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff780004800 0x7ff780004c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff77c007fd0 tx=0x7ff780005830 comp rx=0 tx=0).stop 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff792d9d640 1 -- 172.21.15.120:0/3488434641 reap_dead start 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff798d2b640 1 -- 172.21.15.120:0/3488434641 shutdown_connections 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff798d2b640 1 -- 172.21.15.120:0/3488434641 >> 172.21.15.120:0/3488434641 conn(0x7ff79409d7b0 msgr2=0x7ff79408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff798d2b640 1 -- 172.21.15.120:0/3488434641 shutdown_connections 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.837+0000 7ff798d2b640 1 -- 172.21.15.120:0/3488434641 wait complete. 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.838+0000 7ff798d2b640 1 Processor -- start 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff798d2b640 1 -- start start 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff798d2b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff780004800 0x7ff79415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff798d2b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7940ccf80 0x7ff7940c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff798d2b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7940c84c0 0x7ff7940c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff798d2b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff79406c890 con 0x7ff7940c84c0 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff798d2b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff7940d1ac0 con 0x7ff7940ccf80 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff798d2b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff79406ca10 con 0x7ff780004800 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff792d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7940c84c0 0x7ff7940c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff792d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7940c84c0 0x7ff7940c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56024/0 (socket says 172.21.15.120:56024) 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff792d9d640 1 -- 172.21.15.120:0/1673823735 learned_addr learned my addr 172.21.15.120:0/1673823735 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff78bfff640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7940ccf80 0x7ff7940c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.839+0000 7ff79259c640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff780004800 0x7ff79415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff792d9d640 1 -- 172.21.15.120:0/1673823735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff780004800 msgr2=0x7ff79415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff792d9d640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff780004800 0x7ff79415a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff792d9d640 1 -- 172.21.15.120:0/1673823735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7940ccf80 msgr2=0x7ff7940c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff792d9d640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7940ccf80 0x7ff7940c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff792d9d640 1 -- 172.21.15.120:0/1673823735 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7940ce000 con 0x7ff7940c84c0 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff792d9d640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7940c84c0 0x7ff7940c8950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff79408c700 tx=0x7ff78c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff78affd640 1 -- 172.21.15.120:0/1673823735 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c015430 con 0x7ff7940c84c0 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff78affd640 1 -- 172.21.15.120:0/1673823735 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c01d070 con 0x7ff7940c84c0 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7940cd480 con 0x7ff7940c84c0 2024-03-31T16:35:25.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff78affd640 1 -- 172.21.15.120:0/1673823735 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c015830 con 0x7ff7940c84c0 2024-03-31T16:35:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.840+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7940cda40 con 0x7ff7940c84c0 2024-03-31T16:35:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.841+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7940685c0 con 0x7ff7940c84c0 2024-03-31T16:35:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.841+0000 7ff78affd640 1 -- 172.21.15.120:0/1673823735 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff78c0159d0 con 0x7ff7940c84c0 2024-03-31T16:35:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.842+0000 7ff78affd640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c920 0x7ff77406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.842+0000 7ff78affd640 1 -- 172.21.15.120:0/1673823735 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff78c08c0d0 con 0x7ff7940c84c0 2024-03-31T16:35:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.842+0000 7ff79259c640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c920 0x7ff77406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.842+0000 7ff79259c640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c920 0x7ff77406ede0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff79406e540 tx=0x7ff784009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:25.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:25.846+0000 7ff78affd640 1 -- 172.21.15.120:0/1673823735 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff78c010040 con 0x7ff7940c84c0 2024-03-31T16:35:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.019+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff79406c670 con 0x7ff7940c84c0 2024-03-31T16:35:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.020+0000 7ff78affd640 1 -- 172.21.15.120:0/1673823735 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7ff78c05a850 con 0x7ff7940c84c0 2024-03-31T16:35:26.024 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:35:26.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.021+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c920 msgr2=0x7ff77406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.021+0000 7ff798d2b640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c920 0x7ff77406ede0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff79406e540 tx=0x7ff784009040 comp rx=0 tx=0).stop 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.021+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7940c84c0 msgr2=0x7ff7940c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.021+0000 7ff798d2b640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7940c84c0 0x7ff7940c8950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff79408c700 tx=0x7ff78c00f580 comp rx=0 tx=0).stop 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.021+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 shutdown_connections 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.021+0000 7ff798d2b640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c920 0x7ff77406ede0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.022+0000 7ff798d2b640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7940c84c0 0x7ff7940c8950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.022+0000 7ff798d2b640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7940ccf80 0x7ff7940c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.022+0000 7ff798d2b640 1 --2- 172.21.15.120:0/1673823735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff780004800 0x7ff79415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.022+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 >> 172.21.15.120:0/1673823735 conn(0x7ff79409d7b0 msgr2=0x7ff79406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.022+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 shutdown_connections 2024-03-31T16:35:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.022+0000 7ff798d2b640 1 -- 172.21.15.120:0/1673823735 wait complete. 2024-03-31T16:35:26.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:35:26.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.137+0000 7f203be47640 1 Processor -- start 2024-03-31T16:35:26.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.137+0000 7f203be47640 1 -- start start 2024-03-31T16:35:26.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.137+0000 7f203be47640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f203415e590 0x7f20340d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:26.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.137+0000 7f203be47640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20340b47d0 0x7f203406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:26.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f203be47640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2034071060 con 0x7f203406cbc0 2024-03-31T16:35:26.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f203be47640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f203406cff0 con 0x7f203415e590 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f203be47640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2034071340 con 0x7f20340b47d0 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f2039be3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f203415e590 0x7f20340d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f203a3e4640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f203406cbc0 0x7f2034162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45464/0 (socket says 172.21.15.120:45464) 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f203a3e4640 1 -- 172.21.15.120:0/3078171176 learned_addr learned my addr 172.21.15.120:0/3078171176 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f20393e2640 1 --2- 172.21.15.120:0/3078171176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20340b47d0 0x7f203406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f2039be3640 1 -- 172.21.15.120:0/3078171176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20340b47d0 msgr2=0x7f203406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f2039be3640 1 --2- 172.21.15.120:0/3078171176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20340b47d0 0x7f203406c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f2039be3640 1 -- 172.21.15.120:0/3078171176 >> v1:172.21.15.120:6789/0 conn(0x7f203406cbc0 legacy=0x7f2034162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f2039be3640 1 -- 172.21.15.120:0/3078171176 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2034071620 con 0x7f203415e590 2024-03-31T16:35:26.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.138+0000 7f2038be1640 1 -- 172.21.15.120:0/3078171176 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335471205 0 0) 0x7f2034071060 con 0x7f203406cbc0 2024-03-31T16:35:26.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f2039be3640 1 --2- 172.21.15.120:0/3078171176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340d1560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f20240097a0 tx=0x7f202402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5db6996587a649 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f2038be1640 1 -- 172.21.15.120:0/3078171176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024035020 con 0x7f203415e590 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f2038be1640 1 -- 172.21.15.120:0/3078171176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2024031830 con 0x7f203415e590 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f2038be1640 1 -- 172.21.15.120:0/3078171176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024031c00 con 0x7f203415e590 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f203be47640 1 -- 172.21.15.120:0/3078171176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 msgr2=0x7f20340d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f203be47640 1 --2- 172.21.15.120:0/3078171176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340d1560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f20240097a0 tx=0x7f202402b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f203be47640 1 -- 172.21.15.120:0/3078171176 shutdown_connections 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f203be47640 1 --2- 172.21.15.120:0/3078171176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20340b47d0 0x7f203406c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.139+0000 7f203be47640 1 --2- 172.21.15.120:0/3078171176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340d1560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.140+0000 7f203be47640 1 -- 172.21.15.120:0/3078171176 >> 172.21.15.120:0/3078171176 conn(0x7f20340d2240 msgr2=0x7f20340d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.140+0000 7f203be47640 1 -- 172.21.15.120:0/3078171176 shutdown_connections 2024-03-31T16:35:26.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.140+0000 7f203be47640 1 -- 172.21.15.120:0/3078171176 wait complete. 2024-03-31T16:35:26.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203be47640 1 Processor -- start 2024-03-31T16:35:26.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203be47640 1 -- start start 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203be47640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f203406cbc0 0x7f20340b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203be47640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20340b47d0 0x7f20340c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203be47640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203be47640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f20340b4c30 con 0x7f203415e590 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203be47640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2034071be0 con 0x7f20340b47d0 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203be47640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f203415e970 con 0x7f203406cbc0 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.141+0000 7f203a3e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203a3e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56034/0 (socket says 172.21.15.120:56034) 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203a3e4640 1 -- 172.21.15.120:0/264697073 learned_addr learned my addr 172.21.15.120:0/264697073 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203a3e4640 1 -- 172.21.15.120:0/264697073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f203406cbc0 msgr2=0x7f20340b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203a3e4640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f203406cbc0 0x7f20340b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203a3e4640 1 -- 172.21.15.120:0/264697073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20340b47d0 msgr2=0x7f20340c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f20393e2640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20340b47d0 0x7f20340c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:26.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203a3e4640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20340b47d0 0x7f20340c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203a3e4640 1 -- 172.21.15.120:0/264697073 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203415f6c0 con 0x7f203415e590 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203a3e4640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340cafa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c7d0 tx=0x7f202c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f202a7fc640 1 -- 172.21.15.120:0/264697073 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c018070 con 0x7f203415e590 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f202a7fc640 1 -- 172.21.15.120:0/264697073 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c00a640 con 0x7f203415e590 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203415f9a0 con 0x7f203415e590 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f202a7fc640 1 -- 172.21.15.120:0/264697073 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c00aa70 con 0x7f203415e590 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.142+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203415ff60 con 0x7f203415e590 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.143+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20340685c0 con 0x7f203415e590 2024-03-31T16:35:26.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.144+0000 7f202a7fc640 1 -- 172.21.15.120:0/264697073 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f202c01b070 con 0x7f203415e590 2024-03-31T16:35:26.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.144+0000 7f202a7fc640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f201806c8f0 0x7f201806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:26.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.144+0000 7f2039be3640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f201806c8f0 0x7f201806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:26.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.144+0000 7f202a7fc640 1 -- 172.21.15.120:0/264697073 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f202c08ae60 con 0x7f203415e590 2024-03-31T16:35:26.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.144+0000 7f2039be3640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f201806c8f0 0x7f201806edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2024036000 tx=0x7f2024030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.148+0000 7f202a7fc640 1 -- 172.21.15.120:0/264697073 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f202c0595e0 con 0x7f203415e590 2024-03-31T16:35:26.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.360+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f203415dd40 con 0x7f203415e590 2024-03-31T16:35:26.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.360+0000 7f202a7fc640 1 -- 172.21.15.120:0/264697073 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f202c058ee0 con 0x7f203415e590 2024-03-31T16:35:26.365 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:26.365 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-31T16:35:26.365 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 2 2024-03-31T16:35:26.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f201806c8f0 msgr2=0x7f201806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:26.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f201806c8f0 0x7f201806edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2024036000 tx=0x7f2024030000 comp rx=0 tx=0).stop 2024-03-31T16:35:26.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 msgr2=0x7f20340cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:26.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340cafa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c7d0 tx=0x7f202c00cc90 comp rx=0 tx=0).stop 2024-03-31T16:35:26.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 shutdown_connections 2024-03-31T16:35:26.368 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f201806c8f0 0x7f201806edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f203415e590 0x7f20340cafa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20340b47d0 0x7f20340c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 --2- 172.21.15.120:0/264697073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f203406cbc0 0x7f20340b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:26.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 >> 172.21.15.120:0/264697073 conn(0x7f20340d2240 msgr2=0x7f20340cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:26.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 shutdown_connections 2024-03-31T16:35:26.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:26.362+0000 7f203be47640 1 -- 172.21.15.120:0/264697073 wait complete. 2024-03-31T16:35:28.378 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:35:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.484+0000 7ff7979ba640 1 Processor -- start 2024-03-31T16:35:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.484+0000 7ff7979ba640 1 -- start start 2024-03-31T16:35:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.485+0000 7ff7979ba640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7900d1bf0 0x7ff79015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.485+0000 7ff7979ba640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff79015edc0 con 0x7ff790070170 2024-03-31T16:35:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.485+0000 7ff7979ba640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7900b5e60 con 0x7ff7900705f0 2024-03-31T16:35:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.485+0000 7ff7979ba640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff7900d1fd0 con 0x7ff7900d1bf0 2024-03-31T16:35:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.485+0000 7ff795756640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7900d1bf0 0x7ff79015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.485+0000 7ff794f55640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff790070170 0x7ff79006b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45474/0 (socket says 172.21.15.120:45474) 2024-03-31T16:35:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.485+0000 7ff794f55640 1 -- 172.21.15.120:0/3024190689 learned_addr learned my addr 172.21.15.120:0/3024190689 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:28.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.486+0000 7ff795756640 1 -- 172.21.15.120:0/3024190689 >> v1:172.21.15.203:6789/0 conn(0x7ff7900705f0 legacy=0x7ff79006e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:28.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.486+0000 7ff795756640 1 -- 172.21.15.120:0/3024190689 >> v1:172.21.15.120:6789/0 conn(0x7ff790070170 legacy=0x7ff79006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.486+0000 7ff795756640 1 -- 172.21.15.120:0/3024190689 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7900b6140 con 0x7ff7900d1bf0 2024-03-31T16:35:28.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.486+0000 7ff787fff640 1 -- 172.21.15.120:0/3024190689 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080220062 0 0) 0x7ff79015edc0 con 0x7ff790070170 2024-03-31T16:35:28.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.486+0000 7ff795756640 1 --2- 172.21.15.120:0/3024190689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900d1bf0 0x7ff79015f5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009d90 tx=0x7ff78c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe7531ff06ad94e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:28.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.486+0000 7ff787fff640 1 -- 172.21.15.120:0/3024190689 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c039070 con 0x7ff7900d1bf0 2024-03-31T16:35:28.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff787fff640 1 -- 172.21.15.120:0/3024190689 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78c02cc60 con 0x7ff7900d1bf0 2024-03-31T16:35:28.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff787fff640 1 -- 172.21.15.120:0/3024190689 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c034660 con 0x7ff7900d1bf0 2024-03-31T16:35:28.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff7979ba640 1 -- 172.21.15.120:0/3024190689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900d1bf0 msgr2=0x7ff79015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff7979ba640 1 --2- 172.21.15.120:0/3024190689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900d1bf0 0x7ff79015f5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009d90 tx=0x7ff78c02beb0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff7979ba640 1 -- 172.21.15.120:0/3024190689 shutdown_connections 2024-03-31T16:35:28.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff7979ba640 1 --2- 172.21.15.120:0/3024190689 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900d1bf0 0x7ff79015f5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff7979ba640 1 -- 172.21.15.120:0/3024190689 >> 172.21.15.120:0/3024190689 conn(0x7ff7900b6560 msgr2=0x7ff7900b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:28.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff7979ba640 1 -- 172.21.15.120:0/3024190689 shutdown_connections 2024-03-31T16:35:28.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.487+0000 7ff7979ba640 1 -- 172.21.15.120:0/3024190689 wait complete. 2024-03-31T16:35:28.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.488+0000 7ff7979ba640 1 Processor -- start 2024-03-31T16:35:28.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.488+0000 7ff7979ba640 1 -- start start 2024-03-31T16:35:28.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff7979ba640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff790070170 0x7ff790145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff7979ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900705f0 0x7ff7901e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff7979ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7900d1bf0 0x7ff7901e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff7979ba640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff79015fae0 con 0x7ff7900705f0 2024-03-31T16:35:28.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff7979ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff79015eb80 con 0x7ff7900d1bf0 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff7979ba640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff7900b5b10 con 0x7ff790070170 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff794f55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900705f0 0x7ff7901e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff794f55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900705f0 0x7ff7901e6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56038/0 (socket says 172.21.15.120:56038) 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff794f55640 1 -- 172.21.15.120:0/1706446456 learned_addr learned my addr 172.21.15.120:0/1706446456 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff795f57640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7900d1bf0 0x7ff7901e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff795756640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff790070170 0x7ff790145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff794f55640 1 -- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff790070170 msgr2=0x7ff790145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff794f55640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff790070170 0x7ff790145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff794f55640 1 -- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7900d1bf0 msgr2=0x7ff7901e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff794f55640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7900d1bf0 0x7ff7901e73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.489+0000 7ff794f55640 1 -- 172.21.15.120:0/1706446456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7900b2580 con 0x7ff7900705f0 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.490+0000 7ff795756640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff790070170 0x7ff790145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.490+0000 7ff794f55640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900705f0 0x7ff7901e6e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c3f0 tx=0x7ff78000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.490+0000 7ff785ffb640 1 -- 172.21.15.120:0/1706446456 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7800074e0 con 0x7ff7900705f0 2024-03-31T16:35:28.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.490+0000 7ff785ffb640 1 -- 172.21.15.120:0/1706446456 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7800047e0 con 0x7ff7900705f0 2024-03-31T16:35:28.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.490+0000 7ff785ffb640 1 -- 172.21.15.120:0/1706446456 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780004c10 con 0x7ff7900705f0 2024-03-31T16:35:28.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.490+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff790156ae0 con 0x7ff7900705f0 2024-03-31T16:35:28.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.490+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7901570a0 con 0x7ff7900705f0 2024-03-31T16:35:28.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.491+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7900685c0 con 0x7ff7900705f0 2024-03-31T16:35:28.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.491+0000 7ff785ffb640 1 -- 172.21.15.120:0/1706446456 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff780011070 con 0x7ff7900705f0 2024-03-31T16:35:28.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.492+0000 7ff785ffb640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c8f0 0x7ff77406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.492+0000 7ff795756640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c8f0 0x7ff77406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.492+0000 7ff785ffb640 1 -- 172.21.15.120:0/1706446456 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff78008b3d0 con 0x7ff7900705f0 2024-03-31T16:35:28.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.492+0000 7ff795756640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c8f0 0x7ff77406edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff78c036000 tx=0x7ff78c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:28.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.496+0000 7ff785ffb640 1 -- 172.21.15.120:0/1706446456 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff780059be0 con 0x7ff7900705f0 2024-03-31T16:35:28.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.710+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7900afad0 con 0x7ff7900705f0 2024-03-31T16:35:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.711+0000 7ff785ffb640 1 -- 172.21.15.120:0/1706446456 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7ff7800594e0 con 0x7ff7900705f0 2024-03-31T16:35:28.715 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:28.715 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-31T16:35:28.716 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 3 2024-03-31T16:35:28.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c8f0 msgr2=0x7ff77406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c8f0 0x7ff77406edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff78c036000 tx=0x7ff78c030000 comp rx=0 tx=0).stop 2024-03-31T16:35:28.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900705f0 msgr2=0x7ff7901e6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900705f0 0x7ff7901e6e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c3f0 tx=0x7ff78000c8b0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 shutdown_connections 2024-03-31T16:35:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff77406c8f0 0x7ff77406edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7900d1bf0 0x7ff7901e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7900705f0 0x7ff7901e6e60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 --2- 172.21.15.120:0/1706446456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff790070170 0x7ff790145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 >> 172.21.15.120:0/1706446456 conn(0x7ff7900b6560 msgr2=0x7ff7900b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 shutdown_connections 2024-03-31T16:35:28.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.713+0000 7ff7979ba640 1 -- 172.21.15.120:0/1706446456 wait complete. 2024-03-31T16:35:28.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.823+0000 7f7b2b23a640 1 Processor -- start 2024-03-31T16:35:28.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.823+0000 7f7b2b23a640 1 -- start start 2024-03-31T16:35:28.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.823+0000 7f7b2b23a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 0x7f7b240b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b2b23a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b24158580 0x7f7b241589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b2b23a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2415ede0 con 0x7f7b240b4650 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b2b23a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f7b24141b30 con 0x7f7b24158580 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b2b23a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b24141d80 con 0x7f7b240b4a30 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b297d7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7b24158580 0x7f7b241589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b28fd6640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7b240b4650 0x7f7b2406c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45488/0 (socket says 172.21.15.120:45488) 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b28fd6640 1 -- 172.21.15.120:0/2045955631 learned_addr learned my addr 172.21.15.120:0/2045955631 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b23fff640 1 --2- 172.21.15.120:0/2045955631 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 0x7f7b240b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b297d7640 1 -- 172.21.15.120:0/2045955631 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 msgr2=0x7f7b240b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b297d7640 1 --2- 172.21.15.120:0/2045955631 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 0x7f7b240b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b297d7640 1 -- 172.21.15.120:0/2045955631 >> v1:172.21.15.120:6789/0 conn(0x7f7b240b4650 legacy=0x7f7b2406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b237fe640 1 -- 172.21.15.120:0/2045955631 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298146834 0 0) 0x7f7b2415ede0 con 0x7f7b240b4650 2024-03-31T16:35:28.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.824+0000 7f7b297d7640 1 -- 172.21.15.120:0/2045955631 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b24142060 con 0x7f7b24158580 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b297d7640 1 --2- 172.21.15.120:0/2045955631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b241589d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0097a0 tx=0x7f7b0c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9cbfd98f7f77da server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b237fe640 1 -- 172.21.15.120:0/2045955631 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c035020 con 0x7f7b24158580 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b237fe640 1 -- 172.21.15.120:0/2045955631 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c031830 con 0x7f7b24158580 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b237fe640 1 -- 172.21.15.120:0/2045955631 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c031c00 con 0x7f7b24158580 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b2b23a640 1 -- 172.21.15.120:0/2045955631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 msgr2=0x7f7b241589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/2045955631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b241589d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0097a0 tx=0x7f7b0c02b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b2b23a640 1 -- 172.21.15.120:0/2045955631 shutdown_connections 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/2045955631 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b241589d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/2045955631 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 0x7f7b240b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b2b23a640 1 -- 172.21.15.120:0/2045955631 >> 172.21.15.120:0/2045955631 conn(0x7f7b24067670 msgr2=0x7f7b24067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b2b23a640 1 -- 172.21.15.120:0/2045955631 shutdown_connections 2024-03-31T16:35:28.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.825+0000 7f7b2b23a640 1 -- 172.21.15.120:0/2045955631 wait complete. 2024-03-31T16:35:28.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b2b23a640 1 Processor -- start 2024-03-31T16:35:28.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b2b23a640 1 -- start start 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b2b23a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b240b4650 0x7f7b2413ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b2b23a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 0x7f7b2415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b2b23a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b2415db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b2b23a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24142900 con 0x7f7b24158580 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b2b23a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24142620 con 0x7f7b240b4650 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b2b23a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b24158f10 con 0x7f7b240b4a30 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.827+0000 7f7b297d7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b2415db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b297d7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b2415db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56052/0 (socket says 172.21.15.120:56052) 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b297d7640 1 -- 172.21.15.120:0/386596460 learned_addr learned my addr 172.21.15.120:0/386596460 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:28.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b28fd6640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b240b4650 0x7f7b2413ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b23fff640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 0x7f7b2415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b297d7640 1 -- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 msgr2=0x7f7b2415d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b297d7640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 0x7f7b2415d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b297d7640 1 -- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b240b4650 msgr2=0x7f7b2413ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b297d7640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b240b4650 0x7f7b2413ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b297d7640 1 -- 172.21.15.120:0/386596460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b240cce30 con 0x7f7b24158580 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b28fd6640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b240b4650 0x7f7b2413ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b297d7640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b2415db20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c034040 tx=0x7f7b0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b217fa640 1 -- 172.21.15.120:0/386596460 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c040070 con 0x7f7b24158580 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b217fa640 1 -- 172.21.15.120:0/386596460 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0398e0 con 0x7f7b24158580 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b240cd110 con 0x7f7b24158580 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b217fa640 1 -- 172.21.15.120:0/386596460 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c035040 con 0x7f7b24158580 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.828+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b240cd6d0 con 0x7f7b24158580 2024-03-31T16:35:28.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.829+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b24074f30 con 0x7f7b24158580 2024-03-31T16:35:28.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.829+0000 7f7b217fa640 1 -- 172.21.15.120:0/386596460 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b0c04b060 con 0x7f7b24158580 2024-03-31T16:35:28.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.830+0000 7f7b217fa640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7b0406c920 0x7f7b0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:28.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.830+0000 7f7b217fa640 1 -- 172.21.15.120:0/386596460 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7b0c0ad070 con 0x7f7b24158580 2024-03-31T16:35:28.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.830+0000 7f7b28fd6640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7b0406c920 0x7f7b0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:28.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.830+0000 7f7b28fd6640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7b0406c920 0x7f7b0406ede0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0012e0 tx=0x7f7b1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:28.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:28.834+0000 7f7b217fa640 1 -- 172.21.15.120:0/386596460 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7b0c07b7f0 con 0x7f7b24158580 2024-03-31T16:35:29.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.008+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b24143130 con 0x7f7b24158580 2024-03-31T16:35:29.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.009+0000 7f7b217fa640 1 -- 172.21.15.120:0/386596460 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7f7b0c07b0f0 con 0x7f7b24158580 2024-03-31T16:35:29.013 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:29.013 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:21.999323+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:29.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.010+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7b0406c920 msgr2=0x7f7b0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.010+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7b0406c920 0x7f7b0406ede0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0012e0 tx=0x7f7b1c009040 comp rx=0 tx=0).stop 2024-03-31T16:35:29.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.010+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 msgr2=0x7f7b2415db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.010+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b2415db20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c034040 tx=0x7f7b0c0046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.011+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 shutdown_connections 2024-03-31T16:35:29.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.011+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7b0406c920 0x7f7b0406ede0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.011+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7b24158580 0x7f7b2415db20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.011+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b240b4a30 0x7f7b2415d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.011+0000 7f7b2b23a640 1 --2- 172.21.15.120:0/386596460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b240b4650 0x7f7b2413ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.011+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 >> 172.21.15.120:0/386596460 conn(0x7f7b24067670 msgr2=0x7f7b2406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:29.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.011+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 shutdown_connections 2024-03-31T16:35:29.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.011+0000 7f7b2b23a640 1 -- 172.21.15.120:0/386596460 wait complete. 2024-03-31T16:35:29.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:35:29.026 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:35:29.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.125+0000 7ff2c9b5f640 1 Processor -- start 2024-03-31T16:35:29.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.125+0000 7ff2c9b5f640 1 -- start start 2024-03-31T16:35:29.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c9b5f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff2c4155550 0x7ff2c4155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c9b5f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c40b40b0 con 0x7ff2c415f800 2024-03-31T16:35:29.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c9b5f640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c40b4390 con 0x7ff2c40d0990 2024-03-31T16:35:29.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c9b5f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c40b4670 con 0x7ff2c4155550 2024-03-31T16:35:29.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c37fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff2c4155550 0x7ff2c4155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2bbfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff2c415f800 0x7ff2c40d0280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45496/0 (socket says 172.21.15.120:45496) 2024-03-31T16:35:29.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2bbfff640 1 -- 172.21.15.120:0/3870941112 learned_addr learned my addr 172.21.15.120:0/3870941112 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:29.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c37fe640 1 -- 172.21.15.120:0/3870941112 >> v1:172.21.15.203:6789/0 conn(0x7ff2c40d0990 legacy=0x7ff2c40aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:29.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c37fe640 1 -- 172.21.15.120:0/3870941112 >> v1:172.21.15.120:6789/0 conn(0x7ff2c415f800 legacy=0x7ff2c40d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c37fe640 1 -- 172.21.15.120:0/3870941112 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c40b4950 con 0x7ff2c4155550 2024-03-31T16:35:29.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.126+0000 7ff2c2ffd640 1 -- 172.21.15.120:0/3870941112 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235552628 0 0) 0x7ff2c40b40b0 con 0x7ff2c415f800 2024-03-31T16:35:29.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c37fe640 1 --2- 172.21.15.120:0/3870941112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c4155550 0x7ff2c4155930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40097a0 tx=0x7ff2b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19782ecedcb1d09d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c2ffd640 1 -- 172.21.15.120:0/3870941112 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4035020 con 0x7ff2c4155550 2024-03-31T16:35:29.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c2ffd640 1 -- 172.21.15.120:0/3870941112 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b4031830 con 0x7ff2c4155550 2024-03-31T16:35:29.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c2ffd640 1 -- 172.21.15.120:0/3870941112 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4031c00 con 0x7ff2c4155550 2024-03-31T16:35:29.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/3870941112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c4155550 msgr2=0x7ff2c4155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c9b5f640 1 --2- 172.21.15.120:0/3870941112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c4155550 0x7ff2c4155930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40097a0 tx=0x7ff2b402b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/3870941112 shutdown_connections 2024-03-31T16:35:29.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c9b5f640 1 --2- 172.21.15.120:0/3870941112 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c4155550 0x7ff2c4155930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/3870941112 >> 172.21.15.120:0/3870941112 conn(0x7ff2c406b750 msgr2=0x7ff2c406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:29.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.127+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/3870941112 shutdown_connections 2024-03-31T16:35:29.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.128+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/3870941112 wait complete. 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c9b5f640 1 Processor -- start 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c9b5f640 1 -- start start 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c9b5f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c40d0990 0x7ff2c41f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c9b5f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c4155550 0x7ff2c40ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c9b5f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c415f800 0x7ff2c40add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c9b5f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c415ba20 con 0x7ff2c40d0990 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c9b5f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c415fc80 con 0x7ff2c4155550 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c9b5f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c415bba0 con 0x7ff2c415f800 2024-03-31T16:35:29.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c40d0990 0x7ff2c41f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c40d0990 0x7ff2c41f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56074/0 (socket says 172.21.15.120:56074) 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.129+0000 7ff2c37fe640 1 -- 172.21.15.120:0/2331990350 learned_addr learned my addr 172.21.15.120:0/2331990350 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2bbfff640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c4155550 0x7ff2c40ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c3fff640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c415f800 0x7ff2c40add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c37fe640 1 -- 172.21.15.120:0/2331990350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c415f800 msgr2=0x7ff2c40add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c37fe640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c415f800 0x7ff2c40add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c37fe640 1 -- 172.21.15.120:0/2331990350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c4155550 msgr2=0x7ff2c40ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c37fe640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c4155550 0x7ff2c40ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c37fe640 1 -- 172.21.15.120:0/2331990350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c4151e20 con 0x7ff2c40d0990 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c37fe640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c40d0990 0x7ff2c41f43c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40098c0 tx=0x7ff2b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c0ff9640 1 -- 172.21.15.120:0/2331990350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4041070 con 0x7ff2c40d0990 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c0ff9640 1 -- 172.21.15.120:0/2331990350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b403aa30 con 0x7ff2c40d0990 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c4152100 con 0x7ff2c40d0990 2024-03-31T16:35:29.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c0ff9640 1 -- 172.21.15.120:0/2331990350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4035040 con 0x7ff2c40d0990 2024-03-31T16:35:29.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.130+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c40ceec0 con 0x7ff2c40d0990 2024-03-31T16:35:29.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.131+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c40ad8b0 con 0x7ff2c40d0990 2024-03-31T16:35:29.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.131+0000 7ff2c0ff9640 1 -- 172.21.15.120:0/2331990350 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2b4038020 con 0x7ff2c40d0990 2024-03-31T16:35:29.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.132+0000 7ff2c0ff9640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff2a406c8f0 0x7ff2a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.132+0000 7ff2c0ff9640 1 -- 172.21.15.120:0/2331990350 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff2b40ad2e0 con 0x7ff2c40d0990 2024-03-31T16:35:29.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.132+0000 7ff2bbfff640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff2a406c8f0 0x7ff2a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.132+0000 7ff2bbfff640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff2a406c8f0 0x7ff2a406edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40b2a60 tx=0x7ff2ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.136+0000 7ff2c0ff9640 1 -- 172.21.15.120:0/2331990350 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff2c40ad8b0 con 0x7ff2c40d0990 2024-03-31T16:35:29.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.313+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff2c4067db0 con 0x7ff2c40d0990 2024-03-31T16:35:29.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.313+0000 7ff2c0ff9640 1 -- 172.21.15.120:0/2331990350 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7ff2c4067db0 con 0x7ff2c40d0990 2024-03-31T16:35:29.318 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:35:29.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff2a406c8f0 msgr2=0x7ff2a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff2a406c8f0 0x7ff2a406edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40b2a60 tx=0x7ff2ac009040 comp rx=0 tx=0).stop 2024-03-31T16:35:29.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c40d0990 msgr2=0x7ff2c41f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c40d0990 0x7ff2c41f43c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40098c0 tx=0x7ff2b40046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 shutdown_connections 2024-03-31T16:35:29.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff2a406c8f0 0x7ff2a406edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2c415f800 0x7ff2c40add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2c4155550 0x7ff2c40ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 --2- 172.21.15.120:0/2331990350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff2c40d0990 0x7ff2c41f43c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 >> 172.21.15.120:0/2331990350 conn(0x7ff2c406b750 msgr2=0x7ff2c415d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:29.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 shutdown_connections 2024-03-31T16:35:29.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.316+0000 7ff2c9b5f640 1 -- 172.21.15.120:0/2331990350 wait complete. 2024-03-31T16:35:29.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-31T16:35:29.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.428+0000 7f3076da3640 1 Processor -- start 2024-03-31T16:35:29.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.428+0000 7f3076da3640 1 -- start start 2024-03-31T16:35:29.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.428+0000 7f3076da3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700c7810 0x7f30700b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.428+0000 7f3076da3640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f30700d1d70 0x7f307006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.428+0000 7f3076da3640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30700d01a0 con 0x7f307015e7b0 2024-03-31T16:35:29.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.428+0000 7f3076da3640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f30700d1240 con 0x7f30700d1d70 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.428+0000 7f3076da3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f30700d0480 con 0x7f30700c7810 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.429+0000 7f306ffff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700c7810 0x7f30700b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.429+0000 7f306ffff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700c7810 0x7f30700b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:43712/0 (socket says 172.21.15.120:43712) 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.429+0000 7f306ffff640 1 -- 172.21.15.120:0/3955529881 learned_addr learned my addr 172.21.15.120:0/3955529881 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.429+0000 7f3075340640 1 --2- 172.21.15.120:0/3955529881 >> v2:172.21.15.203:3300/0 conn(0x7f30700d1d70 0x7f307006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.429+0000 7f306ffff640 1 -- 172.21.15.120:0/3955529881 >> v2:172.21.15.203:3300/0 conn(0x7f30700d1d70 msgr2=0x7f307006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.429+0000 7f306ffff640 1 --2- 172.21.15.120:0/3955529881 >> v2:172.21.15.203:3300/0 conn(0x7f30700d1d70 0x7f307006ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.429+0000 7f306ffff640 1 -- 172.21.15.120:0/3955529881 >> v1:172.21.15.203:6789/0 conn(0x7f307015e7b0 legacy=0x7f30700c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.429+0000 7f306ffff640 1 -- 172.21.15.120:0/3955529881 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30700d0760 con 0x7f30700c7810 2024-03-31T16:35:29.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.430+0000 7f306ffff640 1 --2- 172.21.15.120:0/3955529881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700c7810 0x7f30700b4980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3058009870 tx=0x7f305802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87bf46af1e78525f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.430+0000 7f306f7fe640 1 -- 172.21.15.120:0/3955529881 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058034070 con 0x7f30700c7810 2024-03-31T16:35:29.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.430+0000 7f306f7fe640 1 -- 172.21.15.120:0/3955529881 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3058030840 con 0x7f30700c7810 2024-03-31T16:35:29.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.430+0000 7f306f7fe640 1 -- 172.21.15.120:0/3955529881 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058030c10 con 0x7f30700c7810 2024-03-31T16:35:29.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.431+0000 7f3076da3640 1 -- 172.21.15.120:0/3955529881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700c7810 msgr2=0x7f30700b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.431+0000 7f3076da3640 1 --2- 172.21.15.120:0/3955529881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700c7810 0x7f30700b4980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3058009870 tx=0x7f305802b980 comp rx=0 tx=0).stop 2024-03-31T16:35:29.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.431+0000 7f3076da3640 1 -- 172.21.15.120:0/3955529881 shutdown_connections 2024-03-31T16:35:29.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.431+0000 7f3076da3640 1 --2- 172.21.15.120:0/3955529881 >> v2:172.21.15.203:3300/0 conn(0x7f30700d1d70 0x7f307006ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.431+0000 7f3076da3640 1 --2- 172.21.15.120:0/3955529881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700c7810 0x7f30700b4980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.431+0000 7f3076da3640 1 -- 172.21.15.120:0/3955529881 >> 172.21.15.120:0/3955529881 conn(0x7f30700b3e90 msgr2=0x7f30700b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:29.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.431+0000 7f3076da3640 1 -- 172.21.15.120:0/3955529881 shutdown_connections 2024-03-31T16:35:29.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.431+0000 7f3076da3640 1 -- 172.21.15.120:0/3955529881 wait complete. 2024-03-31T16:35:29.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.432+0000 7f3076da3640 1 Processor -- start 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.432+0000 7f3076da3640 1 -- start start 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3076da3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30700c7810 0x7f3070144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3076da3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700d1d70 0x7f307015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3076da3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f307015e7b0 0x7f307015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3076da3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30700cfe30 con 0x7f30700c7810 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3076da3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f30700d0d20 con 0x7f307015e7b0 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3076da3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f307006cf70 con 0x7f30700d1d70 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30700c7810 0x7f3070144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30700c7810 0x7f3070144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56090/0 (socket says 172.21.15.120:56090) 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 -- 172.21.15.120:0/2448655051 learned_addr learned my addr 172.21.15.120:0/2448655051 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f306ffff640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700d1d70 0x7f307015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3075340640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f307015e7b0 0x7f307015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 -- 172.21.15.120:0/2448655051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700d1d70 msgr2=0x7f307015ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700d1d70 0x7f307015ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 -- 172.21.15.120:0/2448655051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f307015e7b0 msgr2=0x7f307015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f307015e7b0 0x7f307015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 -- 172.21.15.120:0/2448655051 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3070144cd0 con 0x7f30700c7810 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3074b3f640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30700c7810 0x7f3070144790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f306800c730 tx=0x7f306800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f306d7fa640 1 -- 172.21.15.120:0/2448655051 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068016020 con 0x7f30700c7810 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f306d7fa640 1 -- 172.21.15.120:0/2448655051 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3068006d50 con 0x7f30700c7810 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30700cb6a0 con 0x7f30700c7810 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f306d7fa640 1 -- 172.21.15.120:0/2448655051 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068003bb0 con 0x7f30700c7810 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.433+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30700cbc60 con 0x7f30700c7810 2024-03-31T16:35:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.435+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3070068cd0 con 0x7f30700c7810 2024-03-31T16:35:29.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.435+0000 7f306d7fa640 1 -- 172.21.15.120:0/2448655051 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f306800a850 con 0x7f30700c7810 2024-03-31T16:35:29.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.435+0000 7f306d7fa640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f305006c8f0 0x7f305006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.435+0000 7f306d7fa640 1 -- 172.21.15.120:0/2448655051 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f306808b270 con 0x7f30700c7810 2024-03-31T16:35:29.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.435+0000 7f306ffff640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f305006c8f0 0x7f305006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.436+0000 7f306ffff640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f305006c8f0 0x7f305006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3058036000 tx=0x7f3058008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.440+0000 7f306d7fa640 1 -- 172.21.15.120:0/2448655051 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3068020020 con 0x7f30700c7810 2024-03-31T16:35:29.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.617+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f30700c73a0 con 0x7f30700c7810 2024-03-31T16:35:29.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.618+0000 7f306d7fa640 1 -- 172.21.15.120:0/2448655051 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f3068059430 con 0x7f30700c7810 2024-03-31T16:35:29.622 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:29.622 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-03-31T16:35:29.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:35:29.623 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-03-31T16:35:29.623 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-03-31T16:35:29.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:35:29.623 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-03-31T16:35:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f305006c8f0 msgr2=0x7f305006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f305006c8f0 0x7f305006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3058036000 tx=0x7f3058008030 comp rx=0 tx=0).stop 2024-03-31T16:35:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30700c7810 msgr2=0x7f3070144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30700c7810 0x7f3070144790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f306800c730 tx=0x7f306800cbf0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 shutdown_connections 2024-03-31T16:35:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f305006c8f0 0x7f305006edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f307015e7b0 0x7f307015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f30700d1d70 0x7f307015ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 --2- 172.21.15.120:0/2448655051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30700c7810 0x7f3070144790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 >> 172.21.15.120:0/2448655051 conn(0x7f30700b3e90 msgr2=0x7f3070071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 shutdown_connections 2024-03-31T16:35:29.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.620+0000 7f3076da3640 1 -- 172.21.15.120:0/2448655051 wait complete. 2024-03-31T16:35:29.634 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-31T16:35:29.635 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-31T16:35:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.734+0000 7f92a4ef2640 1 Processor -- start 2024-03-31T16:35:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.734+0000 7f92a4ef2640 1 -- start start 2024-03-31T16:35:29.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f92a4ef2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f92a00cd0f0 0x7f92a00ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f92a4ef2640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a00cc050 con 0x7f92a006b570 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f92a4ef2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a00cc330 con 0x7f92a00b03e0 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f92a4ef2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f92a00cc610 con 0x7f92a00cd0f0 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f929ed9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f92a00cd0f0 0x7f92a00ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f929e59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f92a006b570 0x7f92a006b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45508/0 (socket says 172.21.15.120:45508) 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f929e59c640 1 -- 172.21.15.120:0/4184678343 learned_addr learned my addr 172.21.15.120:0/4184678343 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f929ed9d640 1 -- 172.21.15.120:0/4184678343 >> v1:172.21.15.203:6789/0 conn(0x7f92a00b03e0 legacy=0x7f92a00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f929ed9d640 1 -- 172.21.15.120:0/4184678343 >> v1:172.21.15.120:6789/0 conn(0x7f92a006b570 legacy=0x7f92a006b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f929ed9d640 1 -- 172.21.15.120:0/4184678343 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a00cc8f0 con 0x7f92a00cd0f0 2024-03-31T16:35:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.735+0000 7f929dd9b640 1 -- 172.21.15.120:0/4184678343 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922144544 0 0) 0x7f92a00cc050 con 0x7f92a006b570 2024-03-31T16:35:29.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.736+0000 7f929ed9d640 1 --2- 172.21.15.120:0/4184678343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a00cd0f0 0x7f92a00ae020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9298009d90 tx=0x7f929802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f65fa29e27e820f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.736+0000 7f929dd9b640 1 -- 172.21.15.120:0/4184678343 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298039070 con 0x7f92a00cd0f0 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.736+0000 7f929dd9b640 1 -- 172.21.15.120:0/4184678343 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929802cd00 con 0x7f92a00cd0f0 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.736+0000 7f929dd9b640 1 -- 172.21.15.120:0/4184678343 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298034660 con 0x7f92a00cd0f0 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.737+0000 7f92a4ef2640 1 -- 172.21.15.120:0/4184678343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a00cd0f0 msgr2=0x7f92a00ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.737+0000 7f92a4ef2640 1 --2- 172.21.15.120:0/4184678343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a00cd0f0 0x7f92a00ae020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9298009d90 tx=0x7f929802bf50 comp rx=0 tx=0).stop 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.737+0000 7f92a4ef2640 1 -- 172.21.15.120:0/4184678343 shutdown_connections 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.737+0000 7f92a4ef2640 1 --2- 172.21.15.120:0/4184678343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a00cd0f0 0x7f92a00ae020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.737+0000 7f92a4ef2640 1 -- 172.21.15.120:0/4184678343 >> 172.21.15.120:0/4184678343 conn(0x7f92a00b2d40 msgr2=0x7f92a00b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.737+0000 7f92a4ef2640 1 -- 172.21.15.120:0/4184678343 shutdown_connections 2024-03-31T16:35:29.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.737+0000 7f92a4ef2640 1 -- 172.21.15.120:0/4184678343 wait complete. 2024-03-31T16:35:29.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.738+0000 7f92a4ef2640 1 Processor -- start 2024-03-31T16:35:29.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.738+0000 7f92a4ef2640 1 -- start start 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f92a4ef2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a006b570 0x7f92a015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f92a4ef2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92a00b03e0 0x7f92a00b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f92a4ef2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92a00cd0f0 0x7f92a0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f92a4ef2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f92a015ec30 con 0x7f92a006b570 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f92a4ef2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92a015eab0 con 0x7f92a00b03e0 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f92a4ef2640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f92a00cd580 con 0x7f92a00cd0f0 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a006b570 0x7f92a015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a006b570 0x7f92a015a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56110/0 (socket says 172.21.15.120:56110) 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 -- 172.21.15.120:0/2421448786 learned_addr learned my addr 172.21.15.120:0/2421448786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f9297fff640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92a00b03e0 0x7f92a00b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929ed9d640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92a00cd0f0 0x7f92a0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 -- 172.21.15.120:0/2421448786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92a00cd0f0 msgr2=0x7f92a0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92a00cd0f0 0x7f92a0158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 -- 172.21.15.120:0/2421448786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92a00b03e0 msgr2=0x7f92a00b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92a00b03e0 0x7f92a00b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 -- 172.21.15.120:0/2421448786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a00c6e30 con 0x7f92a006b570 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f929e59c640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a006b570 0x7f92a015a340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f929000c4a0 tx=0x7f929000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f9296ffd640 1 -- 172.21.15.120:0/2421448786 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9290018070 con 0x7f92a006b570 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f9296ffd640 1 -- 172.21.15.120:0/2421448786 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92900074e0 con 0x7f92a006b570 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f9296ffd640 1 -- 172.21.15.120:0/2421448786 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9290004a20 con 0x7f92a006b570 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a00b6a00 con 0x7f92a006b570 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.739+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a00b59e0 con 0x7f92a006b570 2024-03-31T16:35:29.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.740+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a006e230 con 0x7f92a006b570 2024-03-31T16:35:29.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.741+0000 7f9296ffd640 1 -- 172.21.15.120:0/2421448786 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9290004bc0 con 0x7f92a006b570 2024-03-31T16:35:29.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.741+0000 7f9296ffd640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f928006c8f0 0x7f928006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:29.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.741+0000 7f9296ffd640 1 -- 172.21.15.120:0/2421448786 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f929008ab60 con 0x7f92a006b570 2024-03-31T16:35:29.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.741+0000 7f9297fff640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f928006c8f0 0x7f928006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:29.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.742+0000 7f9297fff640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f928006c8f0 0x7f928006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92a006ed20 tx=0x7f9288009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:29.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.746+0000 7f9296ffd640 1 -- 172.21.15.120:0/2421448786 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f92a006e230 con 0x7f92a006b570 2024-03-31T16:35:29.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:29.919+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f92a00cd9a0 con 0x7f92a006b570 2024-03-31T16:35:30.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.047+0000 7f9296ffd640 1 -- 172.21.15.120:0/2421448786 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f92a00c6e30 con 0x7f92a006b570 2024-03-31T16:35:30.052 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-03-31T16:35:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.049+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f928006c8f0 msgr2=0x7f928006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.049+0000 7f92a4ef2640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f928006c8f0 0x7f928006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f92a006ed20 tx=0x7f9288009040 comp rx=0 tx=0).stop 2024-03-31T16:35:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.049+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a006b570 msgr2=0x7f92a015a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.049+0000 7f92a4ef2640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a006b570 0x7f92a015a340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f929000c4a0 tx=0x7f929000c960 comp rx=0 tx=0).stop 2024-03-31T16:35:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.050+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 shutdown_connections 2024-03-31T16:35:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.050+0000 7f92a4ef2640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f928006c8f0 0x7f928006edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.050+0000 7f92a4ef2640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92a00cd0f0 0x7f92a0158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.050+0000 7f92a4ef2640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92a00b03e0 0x7f92a00b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.050+0000 7f92a4ef2640 1 --2- 172.21.15.120:0/2421448786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92a006b570 0x7f92a015a340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.050+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 >> 172.21.15.120:0/2421448786 conn(0x7f92a00b2d40 msgr2=0x7f92a006b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.050+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 shutdown_connections 2024-03-31T16:35:30.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.050+0000 7f92a4ef2640 1 -- 172.21.15.120:0/2421448786 wait complete. 2024-03-31T16:35:30.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-31T16:35:30.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.171+0000 7f66330d3640 1 Processor -- start 2024-03-31T16:35:30.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.171+0000 7f66330d3640 1 -- start start 2024-03-31T16:35:30.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.171+0000 7f66330d3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c0d1560 0x7f662c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:30.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.171+0000 7f66330d3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f662c06cbc0 0x7f662c0cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:30.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.171+0000 7f66330d3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662c071060 con 0x7f662c15e590 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.171+0000 7f66330d3640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f662c0d19a0 con 0x7f662c06cbc0 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.171+0000 7f66330d3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f662c06cff0 con 0x7f662c0d1560 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f6631670640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f662c06cbc0 0x7f662c0cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f6630e6f640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f662c15e590 0x7f662c0b47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45514/0 (socket says 172.21.15.120:45514) 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f6630e6f640 1 -- 172.21.15.120:0/2023105498 learned_addr learned my addr 172.21.15.120:0/2023105498 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f662bfff640 1 --2- 172.21.15.120:0/2023105498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c0d1560 0x7f662c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f6631670640 1 -- 172.21.15.120:0/2023105498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c0d1560 msgr2=0x7f662c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f6631670640 1 --2- 172.21.15.120:0/2023105498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c0d1560 0x7f662c06c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f6631670640 1 -- 172.21.15.120:0/2023105498 >> v1:172.21.15.120:6789/0 conn(0x7f662c15e590 legacy=0x7f662c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f662b7fe640 1 -- 172.21.15.120:0/2023105498 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088369463 0 0) 0x7f662c071060 con 0x7f662c15e590 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f6631670640 1 -- 172.21.15.120:0/2023105498 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c071340 con 0x7f662c06cbc0 2024-03-31T16:35:30.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.172+0000 7f662bfff640 1 --2- 172.21.15.120:0/2023105498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c0d1560 0x7f662c06c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f6631670640 1 --2- 172.21.15.120:0/2023105498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c06cbc0 0x7f662c0cfd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6624009d90 tx=0x7f662402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baae9720cdd05f38 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f662b7fe640 1 -- 172.21.15.120:0/2023105498 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624039070 con 0x7f662c06cbc0 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f662b7fe640 1 -- 172.21.15.120:0/2023105498 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662402cc50 con 0x7f662c06cbc0 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f662b7fe640 1 -- 172.21.15.120:0/2023105498 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624034440 con 0x7f662c06cbc0 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f66330d3640 1 -- 172.21.15.120:0/2023105498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c06cbc0 msgr2=0x7f662c0cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f66330d3640 1 --2- 172.21.15.120:0/2023105498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c06cbc0 0x7f662c0cfd80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6624009d90 tx=0x7f662402bea0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f66330d3640 1 -- 172.21.15.120:0/2023105498 shutdown_connections 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f66330d3640 1 --2- 172.21.15.120:0/2023105498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c06cbc0 0x7f662c0cfd80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f66330d3640 1 --2- 172.21.15.120:0/2023105498 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c0d1560 0x7f662c06c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f66330d3640 1 -- 172.21.15.120:0/2023105498 >> 172.21.15.120:0/2023105498 conn(0x7f662c0d2240 msgr2=0x7f662c0d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:30.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f66330d3640 1 -- 172.21.15.120:0/2023105498 shutdown_connections 2024-03-31T16:35:30.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.173+0000 7f66330d3640 1 -- 172.21.15.120:0/2023105498 wait complete. 2024-03-31T16:35:30.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.174+0000 7f66330d3640 1 Processor -- start 2024-03-31T16:35:30.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.174+0000 7f66330d3640 1 -- start start 2024-03-31T16:35:30.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f66330d3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f662c06cbc0 0x7f662c0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:30.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f66330d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c0d1560 0x7f662c1f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:30.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f66330d3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c15e590 0x7f662c14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f66330d3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f662c071be0 con 0x7f662c0d1560 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f66330d3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f662c071900 con 0x7f662c06cbc0 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f66330d3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f662c15e970 con 0x7f662c15e590 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f662bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c0d1560 0x7f662c1f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f662bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c0d1560 0x7f662c1f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56128/0 (socket says 172.21.15.120:56128) 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.175+0000 7f662bfff640 1 -- 172.21.15.120:0/680222579 learned_addr learned my addr 172.21.15.120:0/680222579 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f6631670640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c15e590 0x7f662c14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f662bfff640 1 -- 172.21.15.120:0/680222579 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c15e590 msgr2=0x7f662c14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f662bfff640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c15e590 0x7f662c14edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f662bfff640 1 -- 172.21.15.120:0/680222579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f662c06cbc0 msgr2=0x7f662c0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f662bfff640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f662c06cbc0 0x7f662c0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f662bfff640 1 -- 172.21.15.120:0/680222579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c1f5170 con 0x7f662c0d1560 2024-03-31T16:35:30.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f662bfff640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c0d1560 0x7f662c1f4c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f661800c7f0 tx=0x7f661800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:30.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f66297fa640 1 -- 172.21.15.120:0/680222579 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618015070 con 0x7f662c0d1560 2024-03-31T16:35:30.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f66297fa640 1 -- 172.21.15.120:0/680222579 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6618007a30 con 0x7f662c0d1560 2024-03-31T16:35:30.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662c0b3690 con 0x7f662c0d1560 2024-03-31T16:35:30.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f66297fa640 1 -- 172.21.15.120:0/680222579 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618007e00 con 0x7f662c0d1560 2024-03-31T16:35:30.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.176+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662c0b3c50 con 0x7f662c0d1560 2024-03-31T16:35:30.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.177+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662c0685c0 con 0x7f662c0d1560 2024-03-31T16:35:30.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.178+0000 7f66297fa640 1 -- 172.21.15.120:0/680222579 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6618018070 con 0x7f662c0d1560 2024-03-31T16:35:30.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.178+0000 7f66297fa640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:30.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.178+0000 7f66297fa640 1 -- 172.21.15.120:0/680222579 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f661808bc90 con 0x7f662c0d1560 2024-03-31T16:35:30.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.178+0000 7f6630e6f640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:30.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.178+0000 7f6630e6f640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f661006c8f0 0x7f661006edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6620007fd0 tx=0x7f6620007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:30.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.182+0000 7f66297fa640 1 -- 172.21.15.120:0/680222579 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f662c1f5170 con 0x7f662c0d1560 2024-03-31T16:35:30.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:30.360+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f662c0cdf20 con 0x7f662c0d1560 2024-03-31T16:35:31.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.054+0000 7f66297fa640 1 -- 172.21.15.120:0/680222579 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f661805a380 con 0x7f662c0d1560 2024-03-31T16:35:31.059 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-03-31T16:35:31.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f661006c8f0 msgr2=0x7f661006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:31.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f661006c8f0 0x7f661006edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6620007fd0 tx=0x7f6620007960 comp rx=0 tx=0).stop 2024-03-31T16:35:31.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c0d1560 msgr2=0x7f662c1f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:31.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c0d1560 0x7f662c1f4c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f661800c7f0 tx=0x7f661800cbf0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 shutdown_connections 2024-03-31T16:35:31.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f662c15e590 0x7f662c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f662c0d1560 0x7f662c1f4c30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 --2- 172.21.15.120:0/680222579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f662c06cbc0 0x7f662c0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 >> 172.21.15.120:0/680222579 conn(0x7f662c0d2240 msgr2=0x7f662c0ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:31.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 shutdown_connections 2024-03-31T16:35:31.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.057+0000 7f66330d3640 1 -- 172.21.15.120:0/680222579 wait complete. 2024-03-31T16:35:31.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-31T16:35:31.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.190+0000 7f9f445c8640 1 Processor -- start 2024-03-31T16:35:31.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.190+0000 7f9f445c8640 1 -- start start 2024-03-31T16:35:31.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.191+0000 7f9f445c8640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9f3c0d0e70 0x7f9f3c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.191+0000 7f9f445c8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c0cf6c0 con 0x7f9f3c0d2110 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.191+0000 7f9f445c8640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3c0cf9a0 con 0x7f9f3c15f6e0 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.191+0000 7f9f445c8640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9f3c0cfc80 con 0x7f9f3c0d0e70 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f42b65640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9f3c0d2110 0x7f9f3c0d25a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45528/0 (socket says 172.21.15.120:45528) 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f42b65640 1 -- 172.21.15.120:0/3373040454 learned_addr learned my addr 172.21.15.120:0/3373040454 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596687522 0 0) 0x7f9f3c0cf6c0 con 0x7f9f3c0d2110 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f28003520 con 0x7f9f3c0d2110 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f42364640 1 --2- 172.21.15.120:0/3373040454 >> v2:172.21.15.203:3300/0 conn(0x7f9f3c0d0e70 0x7f9f3c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2924513795 0 0) 0x7f9f28003520 con 0x7f9f3c0d2110 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 >> v2:172.21.15.203:3300/0 conn(0x7f9f3c0d0e70 msgr2=0x7f9f3c0cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 --2- 172.21.15.120:0/3373040454 >> v2:172.21.15.203:3300/0 conn(0x7f9f3c0d0e70 0x7f9f3c0cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 >> v1:172.21.15.203:6789/0 conn(0x7f9f3c15f6e0 legacy=0x7f9f3c0d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c0cff60 con 0x7f9f3c0d2110 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7f9f340019f0 con 0x7f9f3c0d2110 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 >> v1:172.21.15.120:6789/0 conn(0x7f9f3c0d2110 legacy=0x7f9f3c0d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f280039b0 0x7f9f28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280052e0 0x7f9f2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c0cfc80 con 0x7f9f28004800 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2800c1b0 con 0x7f9f280052e0 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2800c3b0 con 0x7f9f280039b0 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41b63640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f42b65640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280052e0 0x7f9f2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:31.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f42364640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f280039b0 0x7f9f28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41b63640 1 -- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f280039b0 msgr2=0x7f9f28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41b63640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f280039b0 0x7f9f28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41b63640 1 -- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280052e0 msgr2=0x7f9f2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41b63640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280052e0 0x7f9f2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f41b63640 1 -- 172.21.15.120:0/3373040454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f28003520 con 0x7f9f28004800 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f42b65640 1 -- 172.21.15.120:0/3373040454 reap_dead start 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.192+0000 7f9f42364640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f280039b0 0x7f9f28003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.193+0000 7f9f41b63640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f28004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9f38001720 tx=0x7f9f28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c20a996b87dd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.193+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38001370 con 0x7f9f28004800 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.193+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f380052d0 con 0x7f9f28004800 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.193+0000 7f9f41362640 1 -- 172.21.15.120:0/3373040454 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38003830 con 0x7f9f28004800 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.194+0000 7f9f445c8640 1 -- 172.21.15.120:0/3373040454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 msgr2=0x7f9f28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:31.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.194+0000 7f9f445c8640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f28004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9f38001720 tx=0x7f9f28005830 comp rx=0 tx=0).stop 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.194+0000 7f9f445c8640 1 -- 172.21.15.120:0/3373040454 shutdown_connections 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.194+0000 7f9f445c8640 1 --2- 172.21.15.120:0/3373040454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f28004c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.194+0000 7f9f445c8640 1 -- 172.21.15.120:0/3373040454 >> 172.21.15.120:0/3373040454 conn(0x7f9f3c08bfb0 msgr2=0x7f9f3c0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.194+0000 7f9f445c8640 1 -- 172.21.15.120:0/3373040454 shutdown_connections 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.194+0000 7f9f445c8640 1 -- 172.21.15.120:0/3373040454 wait complete. 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.195+0000 7f9f445c8640 1 Processor -- start 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.195+0000 7f9f445c8640 1 -- start start 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f445c8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f3c155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f445c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c155560 0x7f9f3c1e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f445c8640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f3c1e8610 0x7f9f3c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f445c8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c15e910 con 0x7f9f28004800 2024-03-31T16:35:31.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f445c8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c15fb40 con 0x7f9f3c155560 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f445c8640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3c15ea90 con 0x7f9f3c1e8610 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f3c155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f3c155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56140/0 (socket says 172.21.15.120:56140) 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 -- 172.21.15.120:0/2145615060 learned_addr learned my addr 172.21.15.120:0/2145615060 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f41b63640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c155560 0x7f9f3c1e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42b65640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f3c1e8610 0x7f9f3c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 -- 172.21.15.120:0/2145615060 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f3c1e8610 msgr2=0x7f9f3c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f3c1e8610 0x7f9f3c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 -- 172.21.15.120:0/2145615060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c155560 msgr2=0x7f9f3c1e80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c155560 0x7f9f3c1e80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 -- 172.21.15.120:0/2145615060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c1559e0 con 0x7f9f28004800 2024-03-31T16:35:31.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f42364640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f3c155020 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00f490 tx=0x7f9f2c00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f32ffd640 1 -- 172.21.15.120:0/2145615060 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c019070 con 0x7f9f28004800 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f32ffd640 1 -- 172.21.15.120:0/2145615060 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2c014870 con 0x7f9f28004800 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c0c89d0 con 0x7f9f28004800 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f32ffd640 1 -- 172.21.15.120:0/2145615060 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c014c60 con 0x7f9f28004800 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.196+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c0c8f90 con 0x7f9f28004800 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.197+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c068cd0 con 0x7f9f28004800 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.198+0000 7f9f32ffd640 1 -- 172.21.15.120:0/2145615060 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f2c01c070 con 0x7f9f28004800 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.198+0000 7f9f32ffd640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f2006c920 0x7f9f2006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.198+0000 7f9f41b63640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f2006c920 0x7f9f2006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.198+0000 7f9f32ffd640 1 -- 172.21.15.120:0/2145615060 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f9f2c08bd60 con 0x7f9f28004800 2024-03-31T16:35:31.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.199+0000 7f9f41b63640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f2006c920 0x7f9f2006ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f38033000 tx=0x7f9f38009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:31.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.203+0000 7f9f32ffd640 1 -- 172.21.15.120:0/2145615060 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9f3c1559e0 con 0x7f9f28004800 2024-03-31T16:35:31.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:35:31.408 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:35:31.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:31.418+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9f3c0ba0c0 con 0x7f9f28004800 2024-03-31T16:35:32.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.068+0000 7f9f32ffd640 1 -- 172.21.15.120:0/2145615060 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f9f2c059ba0 con 0x7f9f28004800 2024-03-31T16:35:32.073 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 2 and data pool 3 2024-03-31T16:35:32.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.073+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f2006c920 msgr2=0x7f9f2006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.073+0000 7f9f445c8640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f2006c920 0x7f9f2006ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f38033000 tx=0x7f9f38009030 comp rx=0 tx=0).stop 2024-03-31T16:35:32.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.073+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 msgr2=0x7f9f3c155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.073+0000 7f9f445c8640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f3c155020 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00f490 tx=0x7f9f2c00f890 comp rx=0 tx=0).stop 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.074+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 shutdown_connections 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.074+0000 7f9f445c8640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f2006c920 0x7f9f2006ede0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.074+0000 7f9f445c8640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f3c1e8610 0x7f9f3c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.074+0000 7f9f445c8640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c155560 0x7f9f3c1e80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.074+0000 7f9f445c8640 1 --2- 172.21.15.120:0/2145615060 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f28004800 0x7f9f3c155020 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00f490 tx=0x7f9f2c00f890 comp rx=0 tx=0).stop 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.074+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 >> 172.21.15.120:0/2145615060 conn(0x7f9f3c08bfb0 msgr2=0x7f9f3c15fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.074+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 shutdown_connections 2024-03-31T16:35:32.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.074+0000 7f9f445c8640 1 -- 172.21.15.120:0/2145615060 wait complete. 2024-03-31T16:35:32.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:32.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.192+0000 7f714af0e640 1 Processor -- start 2024-03-31T16:35:32.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.192+0000 7f714af0e640 1 -- start start 2024-03-31T16:35:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.193+0000 7f714af0e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 0x7f71440b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.193+0000 7f714af0e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71440d1d70 0x7f71440c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.193+0000 7f714af0e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71440d01a0 con 0x7f71440c7640 2024-03-31T16:35:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.193+0000 7f714af0e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f71440d1240 con 0x7f71440d1d70 2024-03-31T16:35:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.193+0000 7f714af0e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f71440d0480 con 0x7f714415e7b0 2024-03-31T16:35:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.193+0000 7f7143fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71440d1d70 0x7f71440c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.193+0000 7f7143fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71440d1d70 0x7f71440c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56152/0 (socket says 172.21.15.120:56152) 2024-03-31T16:35:32.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.193+0000 7f7143fff640 1 -- 172.21.15.120:0/1035678937 learned_addr learned my addr 172.21.15.120:0/1035678937 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.194+0000 7f7148caa640 1 --2- 172.21.15.120:0/1035678937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 0x7f71440b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.194+0000 7f7143fff640 1 -- 172.21.15.120:0/1035678937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 msgr2=0x7f71440b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.194+0000 7f7143fff640 1 --2- 172.21.15.120:0/1035678937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 0x7f71440b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.194+0000 7f7143fff640 1 -- 172.21.15.120:0/1035678937 >> v1:172.21.15.203:6789/0 conn(0x7f71440c7640 legacy=0x7f7144071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.194+0000 7f7143fff640 1 -- 172.21.15.120:0/1035678937 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71440d0760 con 0x7f71440d1d70 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.194+0000 7f7143fff640 1 --2- 172.21.15.120:0/1035678937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f71440c7100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7138009870 tx=0x7f713802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52e96ea96b455e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.194+0000 7f71437fe640 1 -- 172.21.15.120:0/1035678937 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138034070 con 0x7f71440d1d70 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f71437fe640 1 -- 172.21.15.120:0/1035678937 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7138030840 con 0x7f71440d1d70 2024-03-31T16:35:32.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f71437fe640 1 -- 172.21.15.120:0/1035678937 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138030c10 con 0x7f71440d1d70 2024-03-31T16:35:32.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f714af0e640 1 -- 172.21.15.120:0/1035678937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 msgr2=0x7f71440c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f714af0e640 1 --2- 172.21.15.120:0/1035678937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f71440c7100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7138009870 tx=0x7f713802b980 comp rx=0 tx=0).stop 2024-03-31T16:35:32.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f714af0e640 1 -- 172.21.15.120:0/1035678937 shutdown_connections 2024-03-31T16:35:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f714af0e640 1 --2- 172.21.15.120:0/1035678937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f71440c7100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f714af0e640 1 --2- 172.21.15.120:0/1035678937 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 0x7f71440b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f714af0e640 1 -- 172.21.15.120:0/1035678937 >> 172.21.15.120:0/1035678937 conn(0x7f71440b3e90 msgr2=0x7f71440b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f714af0e640 1 -- 172.21.15.120:0/1035678937 shutdown_connections 2024-03-31T16:35:32.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.195+0000 7f714af0e640 1 -- 172.21.15.120:0/1035678937 wait complete. 2024-03-31T16:35:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.196+0000 7f714af0e640 1 Processor -- start 2024-03-31T16:35:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.196+0000 7f714af0e640 1 -- start start 2024-03-31T16:35:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f714af0e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71440c7640 0x7f714415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f714af0e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f7144143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f714af0e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 0x7f7144150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f714af0e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f71440cfe30 con 0x7f71440d1d70 2024-03-31T16:35:32.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f714af0e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71440d0d20 con 0x7f71440c7640 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f714af0e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f714406da40 con 0x7f714415e7b0 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7143fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f7144143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7143fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f7144143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56168/0 (socket says 172.21.15.120:56168) 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7143fff640 1 -- 172.21.15.120:0/701027350 learned_addr learned my addr 172.21.15.120:0/701027350 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7148caa640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71440c7640 0x7f714415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f71494ab640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 0x7f7144150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7143fff640 1 -- 172.21.15.120:0/701027350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 msgr2=0x7f7144150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7143fff640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 0x7f7144150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7143fff640 1 -- 172.21.15.120:0/701027350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71440c7640 msgr2=0x7f714415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7143fff640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71440c7640 0x7f714415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.197+0000 7f7143fff640 1 -- 172.21.15.120:0/701027350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71440cd440 con 0x7f71440d1d70 2024-03-31T16:35:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.198+0000 7f7143fff640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f7144143f60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7138000c00 tx=0x7f71380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.198+0000 7f71417fa640 1 -- 172.21.15.120:0/701027350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138034040 con 0x7f71440d1d70 2024-03-31T16:35:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.198+0000 7f71417fa640 1 -- 172.21.15.120:0/701027350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7138039d90 con 0x7f71440d1d70 2024-03-31T16:35:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.198+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71440cd720 con 0x7f71440d1d70 2024-03-31T16:35:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.198+0000 7f71417fa640 1 -- 172.21.15.120:0/701027350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138043610 con 0x7f71440d1d70 2024-03-31T16:35:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.198+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71440cdce0 con 0x7f71440d1d70 2024-03-31T16:35:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.199+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7144068cd0 con 0x7f71440d1d70 2024-03-31T16:35:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.199+0000 7f71417fa640 1 -- 172.21.15.120:0/701027350 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f713804a060 con 0x7f71440d1d70 2024-03-31T16:35:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.200+0000 7f71417fa640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f713006c8f0 0x7f713006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.200+0000 7f71417fa640 1 -- 172.21.15.120:0/701027350 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f71380adb20 con 0x7f71440d1d70 2024-03-31T16:35:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.200+0000 7f7148caa640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f713006c8f0 0x7f713006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.200+0000 7f7148caa640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f713006c8f0 0x7f713006edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7134003aa0 tx=0x7f7134009830 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.204+0000 7f71417fa640 1 -- 172.21.15.120:0/701027350 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f713803e070 con 0x7f71440d1d70 2024-03-31T16:35:32.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.380+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f714415f0d0 con 0x7f71440d1d70 2024-03-31T16:35:32.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.381+0000 7f71417fa640 1 -- 172.21.15.120:0/701027350 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16630 (secure 0 0 0) 0x7f713807bf50 con 0x7f71440d1d70 2024-03-31T16:35:32.385 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:32.386 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":19,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:31.419963+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:32.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f713006c8f0 msgr2=0x7f713006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f713006c8f0 0x7f713006edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7134003aa0 tx=0x7f7134009830 comp rx=0 tx=0).stop 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 msgr2=0x7f7144143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f7144143f60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7138000c00 tx=0x7f71380046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 shutdown_connections 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f713006c8f0 0x7f713006edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f714415e7b0 0x7f7144150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71440d1d70 0x7f7144143f60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 --2- 172.21.15.120:0/701027350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71440c7640 0x7f714415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 >> 172.21.15.120:0/701027350 conn(0x7f71440b3e90 msgr2=0x7f7144159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 shutdown_connections 2024-03-31T16:35:32.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.383+0000 7f714af0e640 1 -- 172.21.15.120:0/701027350 wait complete. 2024-03-31T16:35:32.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:32.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.493+0000 7f010db60640 1 Processor -- start 2024-03-31T16:35:32.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.493+0000 7f010db60640 1 -- start start 2024-03-31T16:35:32.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f010db60640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0108070170 0x7f010806b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f010db60640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010815edc0 con 0x7f01080d1bf0 2024-03-31T16:35:32.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f010db60640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01080b5e60 con 0x7f01080705f0 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f010db60640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f01080d1fd0 con 0x7f0108070170 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f0106ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0108070170 0x7f010806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f01077fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f01080d1bf0 0x7f010815f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:45530/0 (socket says 172.21.15.120:45530) 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f01077fe640 1 -- 172.21.15.120:0/2640076926 learned_addr learned my addr 172.21.15.120:0/2640076926 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f01067fc640 1 -- 172.21.15.120:0/2640076926 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192391837 0 0) 0x7f010815edc0 con 0x7f01080d1bf0 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f01067fc640 1 -- 172.21.15.120:0/2640076926 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00f0003520 con 0x7f01080d1bf0 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f0106ffd640 1 -- 172.21.15.120:0/2640076926 >> v1:172.21.15.203:6789/0 conn(0x7f01080705f0 legacy=0x7f010806e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f0106ffd640 1 -- 172.21.15.120:0/2640076926 >> v1:172.21.15.120:6789/0 conn(0x7f01080d1bf0 legacy=0x7f010815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.494+0000 7f0106ffd640 1 -- 172.21.15.120:0/2640076926 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01080b6140 con 0x7f0108070170 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.495+0000 7f0106ffd640 1 --2- 172.21.15.120:0/2640076926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010806b570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0097a0 tx=0x7f00fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd3174677f09fd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.495+0000 7f01067fc640 1 -- 172.21.15.120:0/2640076926 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0315a0 con 0x7f0108070170 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.495+0000 7f01067fc640 1 -- 172.21.15.120:0/2640076926 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc037070 con 0x7f0108070170 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.495+0000 7f01067fc640 1 -- 172.21.15.120:0/2640076926 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc031960 con 0x7f0108070170 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.496+0000 7f010db60640 1 -- 172.21.15.120:0/2640076926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 msgr2=0x7f010806b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.496+0000 7f010db60640 1 --2- 172.21.15.120:0/2640076926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010806b570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0097a0 tx=0x7f00fc02b840 comp rx=0 tx=0).stop 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.496+0000 7f010db60640 1 -- 172.21.15.120:0/2640076926 shutdown_connections 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.496+0000 7f010db60640 1 --2- 172.21.15.120:0/2640076926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010806b570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.496+0000 7f010db60640 1 -- 172.21.15.120:0/2640076926 >> 172.21.15.120:0/2640076926 conn(0x7f01080b6560 msgr2=0x7f01080b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.496+0000 7f010db60640 1 -- 172.21.15.120:0/2640076926 shutdown_connections 2024-03-31T16:35:32.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.496+0000 7f010db60640 1 -- 172.21.15.120:0/2640076926 wait complete. 2024-03-31T16:35:32.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.497+0000 7f010db60640 1 Processor -- start 2024-03-31T16:35:32.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.497+0000 7f010db60640 1 -- start start 2024-03-31T16:35:32.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f010db60640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f010db60640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01080705f0 0x7f010806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f010db60640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01080d1bf0 0x7f010814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f010db60640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f01080b5b10 con 0x7f0108070170 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f010db60640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f010815eb80 con 0x7f01080705f0 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f010db60640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f01080b4220 con 0x7f01080d1bf0 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010815a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56188/0 (socket says 172.21.15.120:56188) 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 -- 172.21.15.120:0/2100763753 learned_addr learned my addr 172.21.15.120:0/2100763753 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f0106ffd640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01080705f0 0x7f010806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f0107fff640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01080d1bf0 0x7f010814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 -- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01080d1bf0 msgr2=0x7f010814a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01080d1bf0 0x7f010814a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 -- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01080705f0 msgr2=0x7f010806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01080705f0 0x7f010806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 -- 172.21.15.120:0/2100763753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010815ac20 con 0x7f0108070170 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f0106ffd640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01080705f0 0x7f010806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.498+0000 7f01077fe640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010815a6e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c3c0 tx=0x7f00f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.499+0000 7f00effff640 1 -- 172.21.15.120:0/2100763753 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8017070 con 0x7f0108070170 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.499+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010815cfc0 con 0x7f0108070170 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.499+0000 7f00effff640 1 -- 172.21.15.120:0/2100763753 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f8005ce0 con 0x7f0108070170 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.499+0000 7f00effff640 1 -- 172.21.15.120:0/2100763753 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f80072f0 con 0x7f0108070170 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.499+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01081e7d70 con 0x7f0108070170 2024-03-31T16:35:32.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.500+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01081e8b00 con 0x7f0108070170 2024-03-31T16:35:32.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.502+0000 7f00effff640 1 -- 172.21.15.120:0/2100763753 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f00f801a070 con 0x7f0108070170 2024-03-31T16:35:32.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.503+0000 7f00effff640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f00f406c8f0 0x7f00f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.503+0000 7f00effff640 1 -- 172.21.15.120:0/2100763753 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f00f808b320 con 0x7f0108070170 2024-03-31T16:35:32.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.503+0000 7f0106ffd640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f00f406c8f0 0x7f00f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.503+0000 7f0106ffd640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f00f406c8f0 0x7f00f406edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00fc036000 tx=0x7f00fc03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.507+0000 7f00effff640 1 -- 172.21.15.120:0/2100763753 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f00f8021020 con 0x7f0108070170 2024-03-31T16:35:32.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.682+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01080685c0 con 0x7f0108070170 2024-03-31T16:35:32.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.683+0000 7f00effff640 1 -- 172.21.15.120:0/2100763753 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16630 (secure 0 0 0) 0x7f010815cfc0 con 0x7f0108070170 2024-03-31T16:35:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:32.688 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":19,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:31.419963+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.685+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f00f406c8f0 msgr2=0x7f00f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.685+0000 7f010db60640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f00f406c8f0 0x7f00f406edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00fc036000 tx=0x7f00fc03d040 comp rx=0 tx=0).stop 2024-03-31T16:35:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 msgr2=0x7f010815a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010815a6e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f00f800c3c0 tx=0x7f00f800c880 comp rx=0 tx=0).stop 2024-03-31T16:35:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 shutdown_connections 2024-03-31T16:35:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f00f406c8f0 0x7f00f406edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01080d1bf0 0x7f010814a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01080705f0 0x7f010806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 --2- 172.21.15.120:0/2100763753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0108070170 0x7f010815a6e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 >> 172.21.15.120:0/2100763753 conn(0x7f01080b6560 msgr2=0x7f010815ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 shutdown_connections 2024-03-31T16:35:32.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.686+0000 7f010db60640 1 -- 172.21.15.120:0/2100763753 wait complete. 2024-03-31T16:35:32.701 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-31T16:35:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.800+0000 7f4e6cd9d640 1 Processor -- start 2024-03-31T16:35:32.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.800+0000 7f4e6cd9d640 1 -- start start 2024-03-31T16:35:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e6cd9d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4e6815e4a0 0x7f4e680b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e6cd9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e680cf700 0x7f4e680b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e6cd9d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6815e880 con 0x7f4e680d2310 2024-03-31T16:35:32.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e6cd9d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f4e680d34e0 con 0x7f4e680cf700 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e6cd9d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4e680d28d0 con 0x7f4e6815e4a0 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e67fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e680cf700 0x7f4e680b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e67fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4e680cf700 0x7f4e680b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56198/0 (socket says 172.21.15.120:56198) 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e67fff640 1 -- 172.21.15.120:0/2371962473 learned_addr learned my addr 172.21.15.120:0/2371962473 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e677fe640 1 --2- 172.21.15.120:0/2371962473 >> v2:172.21.15.203:3300/0 conn(0x7f4e6815e4a0 0x7f4e680b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e67fff640 1 -- 172.21.15.120:0/2371962473 >> v2:172.21.15.203:3300/0 conn(0x7f4e6815e4a0 msgr2=0x7f4e680b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e67fff640 1 --2- 172.21.15.120:0/2371962473 >> v2:172.21.15.203:3300/0 conn(0x7f4e6815e4a0 0x7f4e680b9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e67fff640 1 -- 172.21.15.120:0/2371962473 >> v1:172.21.15.203:6789/0 conn(0x7f4e680d2310 legacy=0x7f4e680ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.801+0000 7f4e67fff640 1 -- 172.21.15.120:0/2371962473 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e680d2bb0 con 0x7f4e680cf700 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.802+0000 7f4e67fff640 1 --2- 172.21.15.120:0/2371962473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680cf700 0x7f4e680b73e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4e680cfb20 tx=0x7f4e6002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f4d08fe9806003 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.802+0000 7f4e667fc640 1 -- 172.21.15.120:0/2371962473 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6002ca80 con 0x7f4e680cf700 2024-03-31T16:35:32.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.802+0000 7f4e667fc640 1 -- 172.21.15.120:0/2371962473 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6002cc20 con 0x7f4e680cf700 2024-03-31T16:35:32.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.802+0000 7f4e667fc640 1 -- 172.21.15.120:0/2371962473 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600343f0 con 0x7f4e680cf700 2024-03-31T16:35:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.802+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/2371962473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680cf700 msgr2=0x7f4e680b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.802+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/2371962473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680cf700 0x7f4e680b73e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4e680cfb20 tx=0x7f4e6002bee0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.803+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/2371962473 shutdown_connections 2024-03-31T16:35:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.803+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/2371962473 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680cf700 0x7f4e680b73e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.803+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/2371962473 >> v2:172.21.15.203:3300/0 conn(0x7f4e6815e4a0 0x7f4e680b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.803+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/2371962473 >> 172.21.15.120:0/2371962473 conn(0x7f4e680676d0 msgr2=0x7f4e68067ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.803+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/2371962473 shutdown_connections 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.803+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/2371962473 wait complete. 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.804+0000 7f4e6cd9d640 1 Processor -- start 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.804+0000 7f4e6cd9d640 1 -- start start 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e6cd9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e680cf700 0x7f4e68151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e6cd9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680d2310 0x7f4e68157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e6cd9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e6815e4a0 0x7f4e6815b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e6cd9d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680d3970 con 0x7f4e680d2310 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e6cd9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680d3170 con 0x7f4e680cf700 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e6cd9d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4e680ba1a0 con 0x7f4e6815e4a0 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680d2310 0x7f4e68157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680d2310 0x7f4e68157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56202/0 (socket says 172.21.15.120:56202) 2024-03-31T16:35:32.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 -- 172.21.15.120:0/268666133 learned_addr learned my addr 172.21.15.120:0/268666133 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e677fe640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e680cf700 0x7f4e68151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e67fff640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e6815e4a0 0x7f4e6815b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 -- 172.21.15.120:0/268666133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e6815e4a0 msgr2=0x7f4e6815b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e6815e4a0 0x7f4e6815b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 -- 172.21.15.120:0/268666133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e680cf700 msgr2=0x7f4e68151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e680cf700 0x7f4e68151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 -- 172.21.15.120:0/268666133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e68157c20 con 0x7f4e680d2310 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e66ffd640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680d2310 0x7f4e68157140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c460 tx=0x7f4e5c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e4ffff640 1 -- 172.21.15.120:0/268666133 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c017070 con 0x7f4e680d2310 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e4ffff640 1 -- 172.21.15.120:0/268666133 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c005310 con 0x7f4e680d2310 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e68157f00 con 0x7f4e680d2310 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e4ffff640 1 -- 172.21.15.120:0/268666133 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c003850 con 0x7f4e680d2310 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.805+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e681584c0 con 0x7f4e680d2310 2024-03-31T16:35:32.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.806+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e68075940 con 0x7f4e680d2310 2024-03-31T16:35:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.807+0000 7f4e4ffff640 1 -- 172.21.15.120:0/268666133 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e5c01a070 con 0x7f4e680d2310 2024-03-31T16:35:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.807+0000 7f4e4ffff640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4e5406c8f0 0x7f4e5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.807+0000 7f4e677fe640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4e5406c8f0 0x7f4e5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.807+0000 7f4e4ffff640 1 -- 172.21.15.120:0/268666133 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f4e5c08ad50 con 0x7f4e680d2310 2024-03-31T16:35:32.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.807+0000 7f4e677fe640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4e5406c8f0 0x7f4e5406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e681603f0 tx=0x7f4e58009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:32.812+0000 7f4e4ffff640 1 -- 172.21.15.120:0/268666133 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4e5c08e030 con 0x7f4e680d2310 2024-03-31T16:35:33.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.023+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4e680b5920 con 0x7f4e680d2310 2024-03-31T16:35:33.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.500+0000 7f4e4ffff640 1 -- 172.21.15.120:0/268666133 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f4e5c058b30 con 0x7f4e680d2310 2024-03-31T16:35:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4e5406c8f0 msgr2=0x7f4e5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4e5406c8f0 0x7f4e5406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e681603f0 tx=0x7f4e58009190 comp rx=0 tx=0).stop 2024-03-31T16:35:33.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680d2310 msgr2=0x7f4e68157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680d2310 0x7f4e68157140 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c460 tx=0x7f4e5c00c920 comp rx=0 tx=0).stop 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 shutdown_connections 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4e5406c8f0 0x7f4e5406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e6815e4a0 0x7f4e6815b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4e680d2310 0x7f4e68157140 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 --2- 172.21.15.120:0/268666133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e680cf700 0x7f4e68151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 >> 172.21.15.120:0/268666133 conn(0x7f4e680676d0 msgr2=0x7f4e680b93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 shutdown_connections 2024-03-31T16:35:33.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.503+0000 7f4e6cd9d640 1 -- 172.21.15.120:0/268666133 wait complete. 2024-03-31T16:35:33.519 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-31T16:35:33.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-31T16:35:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.619+0000 7fb731622640 1 Processor -- start 2024-03-31T16:35:33.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.619+0000 7fb731622640 1 -- start start 2024-03-31T16:35:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb731622640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb72c0d43d0 0x7fb72c0d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb731622640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0cf6b0 0x7fb72c0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:33.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb731622640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c0d4d20 con 0x7fb72c15e860 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb731622640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb72c0cf220 con 0x7fb72c0d43d0 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb731622640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c06dfa0 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb723fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb72c0d43d0 0x7fb72c0d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb723fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb72c0d43d0 0x7fb72c0d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56208/0 (socket says 172.21.15.120:56208) 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb723fff640 1 -- 172.21.15.120:0/2251890671 learned_addr learned my addr 172.21.15.120:0/2251890671 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb723fff640 1 -- 172.21.15.120:0/2251890671 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0cf6b0 msgr2=0x7fb72c0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb723fff640 1 --2- 172.21.15.120:0/2251890671 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0cf6b0 0x7fb72c0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb723fff640 1 -- 172.21.15.120:0/2251890671 >> v1:172.21.15.203:6789/0 conn(0x7fb72c15e860 legacy=0x7fb72c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:33.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.620+0000 7fb723fff640 1 -- 172.21.15.120:0/2251890671 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c06e240 con 0x7fb72c0d43d0 2024-03-31T16:35:33.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.621+0000 7fb723fff640 1 --2- 172.21.15.120:0/2251890671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0d43d0 0x7fb72c0d47e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb714009870 tx=0x7fb71402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bc26d01240f32d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:33.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.621+0000 7fb72a7fc640 1 -- 172.21.15.120:0/2251890671 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714034070 con 0x7fb72c0d43d0 2024-03-31T16:35:33.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.621+0000 7fb72a7fc640 1 -- 172.21.15.120:0/2251890671 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714030840 con 0x7fb72c0d43d0 2024-03-31T16:35:33.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.621+0000 7fb72a7fc640 1 -- 172.21.15.120:0/2251890671 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb714030c10 con 0x7fb72c0d43d0 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.621+0000 7fb731622640 1 -- 172.21.15.120:0/2251890671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0d43d0 msgr2=0x7fb72c0d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.621+0000 7fb731622640 1 --2- 172.21.15.120:0/2251890671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0d43d0 0x7fb72c0d47e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb714009870 tx=0x7fb71402b980 comp rx=0 tx=0).stop 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.622+0000 7fb731622640 1 -- 172.21.15.120:0/2251890671 shutdown_connections 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.622+0000 7fb731622640 1 --2- 172.21.15.120:0/2251890671 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0cf6b0 0x7fb72c0cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.622+0000 7fb731622640 1 --2- 172.21.15.120:0/2251890671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0d43d0 0x7fb72c0d47e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.622+0000 7fb731622640 1 -- 172.21.15.120:0/2251890671 >> 172.21.15.120:0/2251890671 conn(0x7fb72c09d7d0 msgr2=0x7fb72c08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.622+0000 7fb731622640 1 -- 172.21.15.120:0/2251890671 shutdown_connections 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.622+0000 7fb731622640 1 -- 172.21.15.120:0/2251890671 wait complete. 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.623+0000 7fb731622640 1 Processor -- start 2024-03-31T16:35:33.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.623+0000 7fb731622640 1 -- start start 2024-03-31T16:35:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.623+0000 7fb731622640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0cf6b0 0x7fb72c0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.623+0000 7fb731622640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0d43d0 0x7fb72c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.623+0000 7fb731622640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb72c15e860 0x7fb72c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:33.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.623+0000 7fb731622640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c06dc00 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.623+0000 7fb731622640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0d2c50 con 0x7fb72c15e860 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.623+0000 7fb731622640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c06dd80 con 0x7fb72c0d43d0 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0cf6b0 0x7fb72c0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0cf6b0 0x7fb72c0c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56210/0 (socket says 172.21.15.120:56210) 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 -- 172.21.15.120:0/972576767 learned_addr learned my addr 172.21.15.120:0/972576767 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72b7fe640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb72c15e860 0x7fb72c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb723fff640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0d43d0 0x7fb72c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 -- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0d43d0 msgr2=0x7fb72c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0d43d0 0x7fb72c0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 -- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb72c15e860 msgr2=0x7fb72c14fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:33.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb72c15e860 0x7fb72c14fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 -- 172.21.15.120:0/972576767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0c8750 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb723fff640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0d43d0 0x7fb72c0cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb72affd640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0cf6b0 0x7fb72c0c97f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00c340 tx=0x7fb71c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb7237fe640 1 -- 172.21.15.120:0/972576767 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c017070 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb7237fe640 1 -- 172.21.15.120:0/972576767 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71c0052d0 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c0c8a30 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb7237fe640 1 -- 172.21.15.120:0/972576767 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c003850 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.624+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c0c8ff0 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.625+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c0685c0 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.625+0000 7fb7237fe640 1 -- 172.21.15.120:0/972576767 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb71c01a070 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.626+0000 7fb7237fe640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb70c06c8f0 0x7fb70c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:33.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.626+0000 7fb7237fe640 1 -- 172.21.15.120:0/972576767 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb71c08ad00 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.626+0000 7fb723fff640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb70c06c8f0 0x7fb70c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:33.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.626+0000 7fb723fff640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb70c06c8f0 0x7fb70c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb714036000 tx=0x7fb71403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:33.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.631+0000 7fb7237fe640 1 -- 172.21.15.120:0/972576767 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb72c0d4d20 con 0x7fb72c0cf6b0 2024-03-31T16:35:33.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:33.845+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb72c0d11d0 con 0x7fb72c0cf6b0 2024-03-31T16:35:34.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.509+0000 7fb7237fe640 1 -- 172.21.15.120:0/972576767 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7fb71c058b70 con 0x7fb72c0cf6b0 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb70c06c8f0 msgr2=0x7fb70c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb70c06c8f0 0x7fb70c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb714036000 tx=0x7fb71403b040 comp rx=0 tx=0).stop 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0cf6b0 msgr2=0x7fb72c0c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0cf6b0 0x7fb72c0c97f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00c340 tx=0x7fb71c00c800 comp rx=0 tx=0).stop 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 shutdown_connections 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb70c06c8f0 0x7fb70c06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb72c15e860 0x7fb72c14fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb72c0d43d0 0x7fb72c0cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 --2- 172.21.15.120:0/972576767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72c0cf6b0 0x7fb72c0c97f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 >> 172.21.15.120:0/972576767 conn(0x7fb72c09d7d0 msgr2=0x7fb72c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:34.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 shutdown_connections 2024-03-31T16:35:34.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.511+0000 7fb731622640 1 -- 172.21.15.120:0/972576767 wait complete. 2024-03-31T16:35:34.527 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-31T16:35:34.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:35:34.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.625+0000 7fdcea047640 1 Processor -- start 2024-03-31T16:35:34.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.625+0000 7fdcea047640 1 -- start start 2024-03-31T16:35:34.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdcea047640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdce4070170 0x7fdce406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdcea047640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdce40705f0 0x7fdce406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdcea047640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce415edc0 con 0x7fdce40d1bf0 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdcea047640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fdce40d1fd0 con 0x7fdce40705f0 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdcea047640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fdce415eb80 con 0x7fdce4070170 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdce40705f0 0x7fdce406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce37fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fdce40d1bf0 0x7fdce415f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53110/0 (socket says 172.21.15.120:53110) 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce37fe640 1 -- 172.21.15.120:0/155686441 learned_addr learned my addr 172.21.15.120:0/155686441 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce2ffd640 1 --2- 172.21.15.120:0/155686441 >> v2:172.21.15.203:3300/0 conn(0x7fdce4070170 0x7fdce406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce27fc640 1 -- 172.21.15.120:0/155686441 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469977055 0 0) 0x7fdce415edc0 con 0x7fdce40d1bf0 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce27fc640 1 -- 172.21.15.120:0/155686441 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdccc003520 con 0x7fdce40d1bf0 2024-03-31T16:35:34.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce3fff640 1 -- 172.21.15.120:0/155686441 >> v2:172.21.15.203:3300/0 conn(0x7fdce4070170 msgr2=0x7fdce406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce3fff640 1 --2- 172.21.15.120:0/155686441 >> v2:172.21.15.203:3300/0 conn(0x7fdce4070170 0x7fdce406b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce3fff640 1 -- 172.21.15.120:0/155686441 >> v1:172.21.15.120:6789/0 conn(0x7fdce40d1bf0 legacy=0x7fdce415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.626+0000 7fdce3fff640 1 -- 172.21.15.120:0/155686441 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce40b5e60 con 0x7fdce40705f0 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.627+0000 7fdce3fff640 1 --2- 172.21.15.120:0/155686441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce406bab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdce4072350 tx=0x7fdcdc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9dbf197c63fe03 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.627+0000 7fdce27fc640 1 -- 172.21.15.120:0/155686441 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc039070 con 0x7fdce40705f0 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.627+0000 7fdce27fc640 1 -- 172.21.15.120:0/155686441 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc02cbf0 con 0x7fdce40705f0 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.627+0000 7fdce27fc640 1 -- 172.21.15.120:0/155686441 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc034440 con 0x7fdce40705f0 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.628+0000 7fdcea047640 1 -- 172.21.15.120:0/155686441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 msgr2=0x7fdce406bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.628+0000 7fdcea047640 1 --2- 172.21.15.120:0/155686441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce406bab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdce4072350 tx=0x7fdcdc02be40 comp rx=0 tx=0).stop 2024-03-31T16:35:34.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.628+0000 7fdcea047640 1 -- 172.21.15.120:0/155686441 shutdown_connections 2024-03-31T16:35:34.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.628+0000 7fdcea047640 1 --2- 172.21.15.120:0/155686441 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce406bab0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.628+0000 7fdcea047640 1 --2- 172.21.15.120:0/155686441 >> v2:172.21.15.203:3300/0 conn(0x7fdce4070170 0x7fdce406b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.628+0000 7fdcea047640 1 -- 172.21.15.120:0/155686441 >> 172.21.15.120:0/155686441 conn(0x7fdce40b6560 msgr2=0x7fdce40b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:34.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.628+0000 7fdcea047640 1 -- 172.21.15.120:0/155686441 shutdown_connections 2024-03-31T16:35:34.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.628+0000 7fdcea047640 1 -- 172.21.15.120:0/155686441 wait complete. 2024-03-31T16:35:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.629+0000 7fdcea047640 1 Processor -- start 2024-03-31T16:35:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.629+0000 7fdcea047640 1 -- start start 2024-03-31T16:35:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdcea047640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdce4070170 0x7fdce414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdcea047640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce4157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdcea047640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdce40d1bf0 0x7fdce4159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdcea047640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdce40b5b10 con 0x7fdce40705f0 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdcea047640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdce415f080 con 0x7fdce40d1bf0 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdcea047640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdce40b4220 con 0x7fdce4070170 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce4157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce4157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52158/0 (socket says 172.21.15.120:52158) 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 -- 172.21.15.120:0/1840715200 learned_addr learned my addr 172.21.15.120:0/1840715200 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce37fe640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdce4070170 0x7fdce414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce3fff640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdce40d1bf0 0x7fdce4159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 -- 172.21.15.120:0/1840715200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdce4070170 msgr2=0x7fdce414aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdce4070170 0x7fdce414aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 -- 172.21.15.120:0/1840715200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdce40d1bf0 msgr2=0x7fdce4159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdce40d1bf0 0x7fdce4159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 -- 172.21.15.120:0/1840715200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce41583c0 con 0x7fdce40705f0 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.630+0000 7fdce2ffd640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce4157910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e9b0 tx=0x7fdcd800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.631+0000 7fdccbfff640 1 -- 172.21.15.120:0/1840715200 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8017070 con 0x7fdce40705f0 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.631+0000 7fdccbfff640 1 -- 172.21.15.120:0/1840715200 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd800c9a0 con 0x7fdce40705f0 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.631+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce41586a0 con 0x7fdce40705f0 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.631+0000 7fdccbfff640 1 -- 172.21.15.120:0/1840715200 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800cd90 con 0x7fdce40705f0 2024-03-31T16:35:34.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.631+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce4158c60 con 0x7fdce40705f0 2024-03-31T16:35:34.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.632+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce40685c0 con 0x7fdce40705f0 2024-03-31T16:35:34.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.632+0000 7fdccbfff640 1 -- 172.21.15.120:0/1840715200 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcd801a070 con 0x7fdce40705f0 2024-03-31T16:35:34.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.633+0000 7fdccbfff640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcd006c8f0 0x7fdcd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.633+0000 7fdce37fe640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcd006c8f0 0x7fdcd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.633+0000 7fdccbfff640 1 -- 172.21.15.120:0/1840715200 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdcd808bd80 con 0x7fdce40705f0 2024-03-31T16:35:34.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.633+0000 7fdce37fe640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcd006c8f0 0x7fdcd006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4005880 tx=0x7fdcd4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:34.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.637+0000 7fdccbfff640 1 -- 172.21.15.120:0/1840715200 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdcd8059bf0 con 0x7fdce40705f0 2024-03-31T16:35:34.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.852+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdce40afad0 con 0x7fdce40705f0 2024-03-31T16:35:34.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.853+0000 7fdccbfff640 1 -- 172.21.15.120:0/1840715200 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7fdcd805def0 con 0x7fdce40705f0 2024-03-31T16:35:34.857 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:34.858 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:35:31.420280+0000","modified":"2024-03-31T16:35:33.846906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-03-31T16:35:34.858 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-03-31T16:35:34.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcd006c8f0 msgr2=0x7fdcd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcd006c8f0 0x7fdcd006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4005880 tx=0x7fdcd4009040 comp rx=0 tx=0).stop 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 msgr2=0x7fdce4157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce4157910 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e9b0 tx=0x7fdcd800ee70 comp rx=0 tx=0).stop 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 shutdown_connections 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcd006c8f0 0x7fdcd006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdce40d1bf0 0x7fdce4159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdce40705f0 0x7fdce4157910 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 --2- 172.21.15.120:0/1840715200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdce4070170 0x7fdce414aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 >> 172.21.15.120:0/1840715200 conn(0x7fdce40b6560 msgr2=0x7fdce415fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 shutdown_connections 2024-03-31T16:35:34.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.855+0000 7fdcea047640 1 -- 172.21.15.120:0/1840715200 wait complete. 2024-03-31T16:35:34.870 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:34.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.966+0000 7f868e10e640 1 Processor -- start 2024-03-31T16:35:34.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.966+0000 7f868e10e640 1 -- start start 2024-03-31T16:35:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f868e10e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815eca0 0x7f86880b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f868e10e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86880b4c00 con 0x7f868815a870 2024-03-31T16:35:34.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f868e10e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86880b4ee0 con 0x7f868815ac50 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f868e10e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f868806d5b0 con 0x7f868815eca0 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f86877fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f868815a870 0x7f868815e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53122/0 (socket says 172.21.15.120:53122) 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f86877fe640 1 -- 172.21.15.120:0/873114787 learned_addr learned my addr 172.21.15.120:0/873114787 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f8686ffd640 1 --2- 172.21.15.120:0/873114787 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815eca0 0x7f86880b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f86867fc640 1 -- 172.21.15.120:0/873114787 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285578107 0 0) 0x7f86880b4c00 con 0x7f868815a870 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f86867fc640 1 -- 172.21.15.120:0/873114787 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8670003520 con 0x7f868815a870 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f86867fc640 1 -- 172.21.15.120:0/873114787 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957860235 0 0) 0x7f86880b4ee0 con 0x7f868815ac50 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f86867fc640 1 -- 172.21.15.120:0/873114787 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86880b4c00 con 0x7f868815ac50 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f8686ffd640 1 -- 172.21.15.120:0/873114787 >> v1:172.21.15.203:6789/0 conn(0x7f868815ac50 legacy=0x7f86880b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f8686ffd640 1 -- 172.21.15.120:0/873114787 >> v1:172.21.15.120:6789/0 conn(0x7f868815a870 legacy=0x7f868815e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.967+0000 7f8686ffd640 1 -- 172.21.15.120:0/873114787 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868806d800 con 0x7f868815eca0 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.968+0000 7f8686ffd640 1 --2- 172.21.15.120:0/873114787 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815eca0 0x7f86880b3f10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f867c00a970 tx=0x7f867c02ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c59d1baa84bbcfa server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.968+0000 7f86867fc640 1 -- 172.21.15.120:0/873114787 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c03a070 con 0x7f868815eca0 2024-03-31T16:35:34.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.968+0000 7f86867fc640 1 -- 172.21.15.120:0/873114787 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c02dbb0 con 0x7f868815eca0 2024-03-31T16:35:34.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.968+0000 7f86867fc640 1 -- 172.21.15.120:0/873114787 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c00b040 con 0x7f868815eca0 2024-03-31T16:35:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.969+0000 7f868e10e640 1 -- 172.21.15.120:0/873114787 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815eca0 msgr2=0x7f86880b3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.969+0000 7f868e10e640 1 --2- 172.21.15.120:0/873114787 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815eca0 0x7f86880b3f10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f867c00a970 tx=0x7f867c02ce00 comp rx=0 tx=0).stop 2024-03-31T16:35:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.969+0000 7f868e10e640 1 -- 172.21.15.120:0/873114787 shutdown_connections 2024-03-31T16:35:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.969+0000 7f868e10e640 1 --2- 172.21.15.120:0/873114787 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815eca0 0x7f86880b3f10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.969+0000 7f868e10e640 1 -- 172.21.15.120:0/873114787 >> 172.21.15.120:0/873114787 conn(0x7f868806b750 msgr2=0x7f868806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.969+0000 7f868e10e640 1 -- 172.21.15.120:0/873114787 shutdown_connections 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.969+0000 7f868e10e640 1 -- 172.21.15.120:0/873114787 wait complete. 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.970+0000 7f868e10e640 1 Processor -- start 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.970+0000 7f868e10e640 1 -- start start 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f868e10e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868815a870 0x7f86881f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f868e10e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815ac50 0x7f868814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f868e10e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f868815eca0 0x7f868814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f868e10e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f868806db70 con 0x7f868815a870 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f868e10e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f868806f220 con 0x7f868815eca0 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f868e10e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f86880d0280 con 0x7f868815ac50 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868815a870 0x7f86881f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868815a870 0x7f86881f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52160/0 (socket says 172.21.15.120:52160) 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 -- 172.21.15.120:0/785782087 learned_addr learned my addr 172.21.15.120:0/785782087 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:34.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f8686ffd640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815ac50 0x7f868814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f8687fff640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f868815eca0 0x7f868814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 -- 172.21.15.120:0/785782087 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815ac50 msgr2=0x7f868814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815ac50 0x7f868814eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 -- 172.21.15.120:0/785782087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f868815eca0 msgr2=0x7f868814f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f868815eca0 0x7f868814f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 -- 172.21.15.120:0/785782087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86880af550 con 0x7f868815a870 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.971+0000 7f86877fe640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868815a870 0x7f86881f2b70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f867800c500 tx=0x7f867800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.972+0000 7f866ffff640 1 -- 172.21.15.120:0/785782087 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8678017070 con 0x7f868815a870 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.972+0000 7f866ffff640 1 -- 172.21.15.120:0/785782087 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8678005ce0 con 0x7f868815a870 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.972+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86881f3550 con 0x7f868815a870 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.972+0000 7f866ffff640 1 -- 172.21.15.120:0/785782087 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86780072f0 con 0x7f868815a870 2024-03-31T16:35:34.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.972+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86881f3b10 con 0x7f868815a870 2024-03-31T16:35:34.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.973+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868806ffb0 con 0x7f868815a870 2024-03-31T16:35:34.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.973+0000 7f866ffff640 1 -- 172.21.15.120:0/785782087 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f867801a070 con 0x7f868815a870 2024-03-31T16:35:34.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.973+0000 7f866ffff640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867406c920 0x7f867406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:34.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.973+0000 7f866ffff640 1 -- 172.21.15.120:0/785782087 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f867808ae00 con 0x7f868815a870 2024-03-31T16:35:34.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.973+0000 7f8686ffd640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867406c920 0x7f867406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:34.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.974+0000 7f8686ffd640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867406c920 0x7f867406ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f867c037000 tx=0x7f867c031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:34.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:34.978+0000 7f866ffff640 1 -- 172.21.15.120:0/785782087 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f868806ffb0 con 0x7f868815a870 2024-03-31T16:35:35.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.155+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86880b32e0 con 0x7f868815a870 2024-03-31T16:35:35.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.156+0000 7f866ffff640 1 -- 172.21.15.120:0/785782087 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f8678058bf0 con 0x7f868815a870 2024-03-31T16:35:35.160 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:35.160 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867406c920 msgr2=0x7f867406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867406c920 0x7f867406ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f867c037000 tx=0x7f867c031000 comp rx=0 tx=0).stop 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868815a870 msgr2=0x7f86881f2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868815a870 0x7f86881f2b70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f867800c500 tx=0x7f867800c9c0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 shutdown_connections 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867406c920 0x7f867406ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f868815eca0 0x7f868814f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f868815ac50 0x7f868814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 --2- 172.21.15.120:0/785782087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f868815a870 0x7f86881f2b70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 >> 172.21.15.120:0/785782087 conn(0x7f868806b750 msgr2=0x7f8688154840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 shutdown_connections 2024-03-31T16:35:35.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.158+0000 7f868e10e640 1 -- 172.21.15.120:0/785782087 wait complete. 2024-03-31T16:35:35.173 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-31T16:35:35.173 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:35:35.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.268+0000 7fb01e688640 1 Processor -- start 2024-03-31T16:35:35.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.268+0000 7fb01e688640 1 -- start start 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.269+0000 7fb01e688640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb01815f6e0 0x7fb0180d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.269+0000 7fb01e688640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0180cf6c0 con 0x7fb0180d0e70 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.269+0000 7fb01e688640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0180cf9a0 con 0x7fb0180cf050 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.269+0000 7fb01e688640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb0180cfc80 con 0x7fb01815f6e0 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.269+0000 7fb01cc25640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb01815f6e0 0x7fb0180d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.269+0000 7fb017fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb0180d0e70 0x7fb0180d1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53128/0 (socket says 172.21.15.120:53128) 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.269+0000 7fb017fff640 1 -- 172.21.15.120:0/1140872728 learned_addr learned my addr 172.21.15.120:0/1140872728 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.270+0000 7fb01cc25640 1 -- 172.21.15.120:0/1140872728 >> v1:172.21.15.203:6789/0 conn(0x7fb0180cf050 legacy=0x7fb0180d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.270+0000 7fb016ffd640 1 -- 172.21.15.120:0/1140872728 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924413452 0 0) 0x7fb0180cf9a0 con 0x7fb0180cf050 2024-03-31T16:35:35.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.270+0000 7fb01cc25640 1 -- 172.21.15.120:0/1140872728 >> v1:172.21.15.120:6789/0 conn(0x7fb0180d0e70 legacy=0x7fb0180d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.270+0000 7fb01cc25640 1 -- 172.21.15.120:0/1140872728 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0180cff60 con 0x7fb01815f6e0 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.270+0000 7fb01cc25640 1 --2- 172.21.15.120:0/1140872728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb01815f6e0 0x7fb0180d2820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb010009d90 tx=0x7fb01002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d0fc9d4baf0b03 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb016ffd640 1 -- 172.21.15.120:0/1140872728 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010039070 con 0x7fb01815f6e0 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb016ffd640 1 -- 172.21.15.120:0/1140872728 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01002cab0 con 0x7fb01815f6e0 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb016ffd640 1 -- 172.21.15.120:0/1140872728 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010034440 con 0x7fb01815f6e0 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb01e688640 1 -- 172.21.15.120:0/1140872728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb01815f6e0 msgr2=0x7fb0180d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb01e688640 1 --2- 172.21.15.120:0/1140872728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb01815f6e0 0x7fb0180d2820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb010009d90 tx=0x7fb01002bd80 comp rx=0 tx=0).stop 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb01e688640 1 -- 172.21.15.120:0/1140872728 shutdown_connections 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb01e688640 1 --2- 172.21.15.120:0/1140872728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb01815f6e0 0x7fb0180d2820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb01e688640 1 -- 172.21.15.120:0/1140872728 >> 172.21.15.120:0/1140872728 conn(0x7fb01808bfb0 msgr2=0x7fb0180d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb01e688640 1 -- 172.21.15.120:0/1140872728 shutdown_connections 2024-03-31T16:35:35.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.271+0000 7fb01e688640 1 -- 172.21.15.120:0/1140872728 wait complete. 2024-03-31T16:35:35.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.272+0000 7fb01e688640 1 Processor -- start 2024-03-31T16:35:35.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.272+0000 7fb01e688640 1 -- start start 2024-03-31T16:35:35.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb01e688640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0180cf050 0x7fb0180b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb01e688640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0180d0e70 0x7fb018158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb01e688640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb01815f6e0 0x7fb018151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb01e688640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb01815e910 con 0x7fb0180d0e70 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb01e688640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb01815fb70 con 0x7fb0180cf050 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb01e688640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb01815ea90 con 0x7fb01815f6e0 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb0177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0180d0e70 0x7fb018158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb0177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0180d0e70 0x7fb018158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52178/0 (socket says 172.21.15.120:52178) 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb0177fe640 1 -- 172.21.15.120:0/4202948793 learned_addr learned my addr 172.21.15.120:0/4202948793 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.273+0000 7fb01cc25640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb01815f6e0 0x7fb018151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb0177fe640 1 -- 172.21.15.120:0/4202948793 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb01815f6e0 msgr2=0x7fb018151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb0177fe640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb01815f6e0 0x7fb018151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb0177fe640 1 -- 172.21.15.120:0/4202948793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0180cf050 msgr2=0x7fb0180b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb0177fe640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0180cf050 0x7fb0180b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb0177fe640 1 -- 172.21.15.120:0/4202948793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb018152ee0 con 0x7fb0180d0e70 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb0177fe640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0180d0e70 0x7fb018158c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c580 tx=0x7fb00c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb014ff9640 1 -- 172.21.15.120:0/4202948793 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c005480 con 0x7fb0180d0e70 2024-03-31T16:35:35.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb014ff9640 1 -- 172.21.15.120:0/4202948793 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00c0035f0 con 0x7fb0180d0e70 2024-03-31T16:35:35.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0180b9c80 con 0x7fb0180d0e70 2024-03-31T16:35:35.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb014ff9640 1 -- 172.21.15.120:0/4202948793 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0039e0 con 0x7fb0180d0e70 2024-03-31T16:35:35.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.274+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb018158440 con 0x7fb0180d0e70 2024-03-31T16:35:35.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.275+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb018068cd0 con 0x7fb0180d0e70 2024-03-31T16:35:35.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.275+0000 7fb014ff9640 1 -- 172.21.15.120:0/4202948793 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb00c003b80 con 0x7fb0180d0e70 2024-03-31T16:35:35.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.276+0000 7fb014ff9640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb00406ca90 0x7fb00406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.276+0000 7fb017fff640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb00406ca90 0x7fb00406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.276+0000 7fb014ff9640 1 -- 172.21.15.120:0/4202948793 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb00c08b800 con 0x7fb0180d0e70 2024-03-31T16:35:35.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.276+0000 7fb017fff640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb00406ca90 0x7fb00406ef50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb008007fd0 tx=0x7fb0080079a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.280+0000 7fb014ff9640 1 -- 172.21.15.120:0/4202948793 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb018152ee0 con 0x7fb0180d0e70 2024-03-31T16:35:35.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.453+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0180b50e0 con 0x7fb00406ca90 2024-03-31T16:35:35.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.458+0000 7fb014ff9640 1 -- 172.21.15.120:0/4202948793 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7fb0180b50e0 con 0x7fb00406ca90 2024-03-31T16:35:35.465 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:35.466 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:35:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb00406ca90 msgr2=0x7fb00406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb00406ca90 0x7fb00406ef50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb008007fd0 tx=0x7fb0080079a0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0180d0e70 msgr2=0x7fb018158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0180d0e70 0x7fb018158c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c580 tx=0x7fb00c00ca40 comp rx=0 tx=0).stop 2024-03-31T16:35:35.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 shutdown_connections 2024-03-31T16:35:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb00406ca90 0x7fb00406ef50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb01815f6e0 0x7fb018151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb0180d0e70 0x7fb018158c40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 --2- 172.21.15.120:0/4202948793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb0180cf050 0x7fb0180b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 >> 172.21.15.120:0/4202948793 conn(0x7fb01808bfb0 msgr2=0x7fb0180d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.461+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 shutdown_connections 2024-03-31T16:35:35.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.462+0000 7fb01e688640 1 -- 172.21.15.120:0/4202948793 wait complete. 2024-03-31T16:35:35.476 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-31T16:35:33.858110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219132,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755588,"statfs":{"total":773094113280,"available":772869722112,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000818"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-31T16:35:22.936068+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:35:22.936068+0000","last_peered":"2024-03-31T16:35:22.936068+0000","last_clean":"2024-03-31T16:35:22.936068+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:35:22.936068+0000","last_undegraded":"2024-03-31T16:35:22.936068+0000","last_fullsized":"2024-03-31T16:35:22.936068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:35:35.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:35:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.612+0000 7fef6b3ba640 1 Processor -- start 2024-03-31T16:35:35.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.612+0000 7fef6b3ba640 1 -- start start 2024-03-31T16:35:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.613+0000 7fef6b3ba640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fef640cf050 0x7fef6415f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.613+0000 7fef6b3ba640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 0x7fef640d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.613+0000 7fef6b3ba640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef640cf6c0 con 0x7fef640d0e70 2024-03-31T16:35:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.613+0000 7fef6b3ba640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fef6415fc20 con 0x7fef640cf050 2024-03-31T16:35:35.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.613+0000 7fef6b3ba640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fef640cf9a0 con 0x7fef640d2110 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.613+0000 7fef69156640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fef640d0e70 0x7fef640d1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53140/0 (socket says 172.21.15.120:53140) 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.613+0000 7fef69156640 1 -- 172.21.15.120:0/3782039728 learned_addr learned my addr 172.21.15.120:0/3782039728 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.613+0000 7fef68955640 1 --2- 172.21.15.120:0/3782039728 >> v2:172.21.15.203:3300/0 conn(0x7fef640cf050 0x7fef6415f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.614+0000 7fef69957640 1 --2- 172.21.15.120:0/3782039728 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 0x7fef640d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.614+0000 7fef5bfff640 1 -- 172.21.15.120:0/3782039728 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2733658506 0 0) 0x7fef640cf6c0 con 0x7fef640d0e70 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.614+0000 7fef5bfff640 1 -- 172.21.15.120:0/3782039728 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef50003520 con 0x7fef640d0e70 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.614+0000 7fef68955640 1 -- 172.21.15.120:0/3782039728 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 msgr2=0x7fef640d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.614+0000 7fef68955640 1 --2- 172.21.15.120:0/3782039728 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 0x7fef640d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.614+0000 7fef68955640 1 -- 172.21.15.120:0/3782039728 >> v1:172.21.15.120:6789/0 conn(0x7fef640d0e70 legacy=0x7fef640d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.614+0000 7fef68955640 1 -- 172.21.15.120:0/3782039728 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef640cfc80 con 0x7fef640cf050 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef68955640 1 --2- 172.21.15.120:0/3782039728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 0x7fef6415f6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef540097a0 tx=0x7fef5402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e1b31e1fe656ea3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef5bfff640 1 -- 172.21.15.120:0/3782039728 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54035020 con 0x7fef640cf050 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef5bfff640 1 -- 172.21.15.120:0/3782039728 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef54031830 con 0x7fef640cf050 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef5bfff640 1 -- 172.21.15.120:0/3782039728 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54031be0 con 0x7fef640cf050 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef6b3ba640 1 -- 172.21.15.120:0/3782039728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 msgr2=0x7fef6415f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/3782039728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 0x7fef6415f6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fef540097a0 tx=0x7fef5402b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef6b3ba640 1 -- 172.21.15.120:0/3782039728 shutdown_connections 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/3782039728 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 0x7fef640d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/3782039728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 0x7fef6415f6e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef6b3ba640 1 -- 172.21.15.120:0/3782039728 >> 172.21.15.120:0/3782039728 conn(0x7fef6408bfb0 msgr2=0x7fef640d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef6b3ba640 1 -- 172.21.15.120:0/3782039728 shutdown_connections 2024-03-31T16:35:35.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.615+0000 7fef6b3ba640 1 -- 172.21.15.120:0/3782039728 wait complete. 2024-03-31T16:35:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef6b3ba640 1 Processor -- start 2024-03-31T16:35:35.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef6b3ba640 1 -- start start 2024-03-31T16:35:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef6b3ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 0x7fef641f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef6b3ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef640d0e70 0x7fef640cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef6b3ba640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 0x7fef6414cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef6b3ba640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fef6415e910 con 0x7fef640d0e70 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef6b3ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef640d0240 con 0x7fef640cf050 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef6b3ba640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fef6415ea90 con 0x7fef640d2110 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef68955640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef640d0e70 0x7fef640cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef68955640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef640d0e70 0x7fef640cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52180/0 (socket says 172.21.15.120:52180) 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef68955640 1 -- 172.21.15.120:0/349163583 learned_addr learned my addr 172.21.15.120:0/349163583 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef69156640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 0x7fef641f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.617+0000 7fef69957640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 0x7fef6414cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef68955640 1 -- 172.21.15.120:0/349163583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 msgr2=0x7fef6414cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef68955640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 0x7fef6414cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef68955640 1 -- 172.21.15.120:0/349163583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 msgr2=0x7fef641f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef68955640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 0x7fef641f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef68955640 1 -- 172.21.15.120:0/349163583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef640cb340 con 0x7fef640d0e70 2024-03-31T16:35:35.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef68955640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef640d0e70 0x7fef640cb6f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fef54000c00 tx=0x7fef540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef59ffb640 1 -- 172.21.15.120:0/349163583 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54035050 con 0x7fef640d0e70 2024-03-31T16:35:35.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef59ffb640 1 -- 172.21.15.120:0/349163583 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef54004450 con 0x7fef640d0e70 2024-03-31T16:35:35.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef640ce270 con 0x7fef640d0e70 2024-03-31T16:35:35.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef59ffb640 1 -- 172.21.15.120:0/349163583 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54003810 con 0x7fef640d0e70 2024-03-31T16:35:35.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.618+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef640ce830 con 0x7fef640d0e70 2024-03-31T16:35:35.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.619+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef64068cd0 con 0x7fef640d0e70 2024-03-31T16:35:35.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.619+0000 7fef59ffb640 1 -- 172.21.15.120:0/349163583 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef54038020 con 0x7fef640d0e70 2024-03-31T16:35:35.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.620+0000 7fef59ffb640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fef4806c8f0 0x7fef4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.620+0000 7fef69156640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fef4806c8f0 0x7fef4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.620+0000 7fef59ffb640 1 -- 172.21.15.120:0/349163583 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fef540ad570 con 0x7fef640d0e70 2024-03-31T16:35:35.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.620+0000 7fef69156640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fef4806c8f0 0x7fef4806edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef60005c00 tx=0x7fef60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.624+0000 7fef59ffb640 1 -- 172.21.15.120:0/349163583 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fef5407b350 con 0x7fef640d0e70 2024-03-31T16:35:35.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.797+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef6408e580 con 0x7fef4806c8f0 2024-03-31T16:35:35.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.802+0000 7fef59ffb640 1 -- 172.21.15.120:0/349163583 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7fef6408e580 con 0x7fef4806c8f0 2024-03-31T16:35:35.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:35.809 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:35:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fef4806c8f0 msgr2=0x7fef4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fef4806c8f0 0x7fef4806edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef60005c00 tx=0x7fef60009040 comp rx=0 tx=0).stop 2024-03-31T16:35:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef640d0e70 msgr2=0x7fef640cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef640d0e70 0x7fef640cb6f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fef54000c00 tx=0x7fef540046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 shutdown_connections 2024-03-31T16:35:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fef4806c8f0 0x7fef4806edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fef640d2110 0x7fef6414cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fef640d0e70 0x7fef640cb6f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 --2- 172.21.15.120:0/349163583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef640cf050 0x7fef641f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 >> 172.21.15.120:0/349163583 conn(0x7fef6408bfb0 msgr2=0x7fef6415f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:35.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 shutdown_connections 2024-03-31T16:35:35.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.805+0000 7fef6b3ba640 1 -- 172.21.15.120:0/349163583 wait complete. 2024-03-31T16:35:35.820 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-31T16:35:33.858110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219132,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755588,"statfs":{"total":773094113280,"available":772869722112,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000818"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-31T16:35:22.936068+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:35:22.936068+0000","last_peered":"2024-03-31T16:35:22.936068+0000","last_clean":"2024-03-31T16:35:22.936068+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:35:22.936068+0000","last_undegraded":"2024-03-31T16:35:22.936068+0000","last_fullsized":"2024-03-31T16:35:22.936068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:31.049108+0000","last_change":"2024-03-31T16:35:31.049108+0000","last_active":"2024-03-31T16:35:31.049108+0000","last_peered":"2024-03-31T16:35:31.049108+0000","last_clean":"2024-03-31T16:35:31.049108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:31.049108+0000","last_undegraded":"2024-03-31T16:35:31.049108+0000","last_fullsized":"2024-03-31T16:35:31.049108+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-31T16:35:30.044577+0000","last_change":"2024-03-31T16:35:30.044577+0000","last_active":"2024-03-31T16:35:30.044577+0000","last_peered":"2024-03-31T16:35:30.044577+0000","last_clean":"2024-03-31T16:35:30.044577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-31T16:35:30.044577+0000","last_undegraded":"2024-03-31T16:35:30.044577+0000","last_fullsized":"2024-03-31T16:35:30.044577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:35:35.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:35:35.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.955+0000 7f0617f15640 1 Processor -- start 2024-03-31T16:35:35.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.955+0000 7f0617f15640 1 -- start start 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f0617f15640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f061015e860 0x7f061006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f0617f15640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f061006da30 0x7f06100d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f0617f15640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f061006dfa0 con 0x7f06100d4910 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f0617f15640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f06100cf220 con 0x7f061015e860 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f0617f15640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f06100d4cf0 con 0x7f061006da30 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f0615cb1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f061015e860 0x7f061006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f0615cb1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f061015e860 0x7f061006d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52194/0 (socket says 172.21.15.120:52194) 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f0615cb1640 1 -- 172.21.15.120:0/2050619727 learned_addr learned my addr 172.21.15.120:0/2050619727 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:35.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.956+0000 7f06154b0640 1 --2- 172.21.15.120:0/2050619727 >> v2:172.21.15.203:3300/0 conn(0x7f061006da30 0x7f06100d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.957+0000 7f0615cb1640 1 -- 172.21.15.120:0/2050619727 >> v2:172.21.15.203:3300/0 conn(0x7f061006da30 msgr2=0x7f06100d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:35.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.957+0000 7f0615cb1640 1 --2- 172.21.15.120:0/2050619727 >> v2:172.21.15.203:3300/0 conn(0x7f061006da30 0x7f06100d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.957+0000 7f0615cb1640 1 -- 172.21.15.120:0/2050619727 >> v1:172.21.15.203:6789/0 conn(0x7f06100d4910 legacy=0x7f06100d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.957+0000 7f0615cb1640 1 -- 172.21.15.120:0/2050619727 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061006e240 con 0x7f061015e860 2024-03-31T16:35:35.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.957+0000 7f0615cb1640 1 --2- 172.21.15.120:0/2050619727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f061006d4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0610162160 tx=0x7f060c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0991bfbe5970ee server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0614caf640 1 -- 172.21.15.120:0/2050619727 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c034070 con 0x7f061015e860 2024-03-31T16:35:35.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0614caf640 1 -- 172.21.15.120:0/2050619727 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060c030860 con 0x7f061015e860 2024-03-31T16:35:35.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0614caf640 1 -- 172.21.15.120:0/2050619727 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c030c30 con 0x7f061015e860 2024-03-31T16:35:35.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0617f15640 1 -- 172.21.15.120:0/2050619727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 msgr2=0x7f061006d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0617f15640 1 --2- 172.21.15.120:0/2050619727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f061006d4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0610162160 tx=0x7f060c02b9a0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0617f15640 1 -- 172.21.15.120:0/2050619727 shutdown_connections 2024-03-31T16:35:35.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0617f15640 1 --2- 172.21.15.120:0/2050619727 >> v2:172.21.15.203:3300/0 conn(0x7f061006da30 0x7f06100d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0617f15640 1 --2- 172.21.15.120:0/2050619727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f061006d4f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0617f15640 1 -- 172.21.15.120:0/2050619727 >> 172.21.15.120:0/2050619727 conn(0x7f061009d7d0 msgr2=0x7f061008bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:35.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0617f15640 1 -- 172.21.15.120:0/2050619727 shutdown_connections 2024-03-31T16:35:35.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.958+0000 7f0617f15640 1 -- 172.21.15.120:0/2050619727 wait complete. 2024-03-31T16:35:35.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.959+0000 7f0617f15640 1 Processor -- start 2024-03-31T16:35:35.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.959+0000 7f0617f15640 1 -- start start 2024-03-31T16:35:35.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f0617f15640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f061006da30 0x7f0610153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f0617f15640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06100d4910 0x7f06100b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f0617f15640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f06100b8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f0617f15640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f06100cedb0 con 0x7f061015e860 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f0617f15640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f06100d2c50 con 0x7f06100d4910 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f0617f15640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f06100cef30 con 0x7f061006da30 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06164b2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f06100b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06164b2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f06100b8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52200/0 (socket says 172.21.15.120:52200) 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06164b2640 1 -- 172.21.15.120:0/2020463368 learned_addr learned my addr 172.21.15.120:0/2020463368 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f0615cb1640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f061006da30 0x7f0610153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06154b0640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06100d4910 0x7f06100b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06164b2640 1 -- 172.21.15.120:0/2020463368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f061006da30 msgr2=0x7f0610153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06164b2640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f061006da30 0x7f0610153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06164b2640 1 -- 172.21.15.120:0/2020463368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06100d4910 msgr2=0x7f06100b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06164b2640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06100d4910 0x7f06100b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:35.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.960+0000 7f06164b2640 1 -- 172.21.15.120:0/2020463368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06100b8dd0 con 0x7f061015e860 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.961+0000 7f06164b2640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f06100b8750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f060800c760 tx=0x7f060800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.961+0000 7f06067fc640 1 -- 172.21.15.120:0/2020463368 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608003b90 con 0x7f061015e860 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.961+0000 7f06067fc640 1 -- 172.21.15.120:0/2020463368 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0608003d50 con 0x7f061015e860 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.961+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06100b90b0 con 0x7f061015e860 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.961+0000 7f06067fc640 1 -- 172.21.15.120:0/2020463368 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060800aa90 con 0x7f061015e860 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.961+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06101f55d0 con 0x7f061015e860 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.962+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06100b95d0 con 0x7f061015e860 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.962+0000 7f06067fc640 1 -- 172.21.15.120:0/2020463368 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f060800ac30 con 0x7f061015e860 2024-03-31T16:35:35.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.963+0000 7f06067fc640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05f406c8f0 0x7f05f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:35.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.963+0000 7f0615cb1640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05f406c8f0 0x7f05f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:35.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.963+0000 7f06067fc640 1 -- 172.21.15.120:0/2020463368 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f060808b8c0 con 0x7f061015e860 2024-03-31T16:35:35.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.963+0000 7f0615cb1640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05f406c8f0 0x7f05f406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f060c036000 tx=0x7f060c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:35.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:35.967+0000 7f06067fc640 1 -- 172.21.15.120:0/2020463368 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f06100b95d0 con 0x7f061015e860 2024-03-31T16:35:36.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.141+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06100685c0 con 0x7f05f406c8f0 2024-03-31T16:35:36.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.147+0000 7f06067fc640 1 -- 172.21.15.120:0/2020463368 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f06100685c0 con 0x7f05f406c8f0 2024-03-31T16:35:36.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:36.163 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:35:36.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05f406c8f0 msgr2=0x7f05f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05f406c8f0 0x7f05f406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f060c036000 tx=0x7f060c03b040 comp rx=0 tx=0).stop 2024-03-31T16:35:36.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 msgr2=0x7f06100b8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f06100b8750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f060800c760 tx=0x7f060800cc20 comp rx=0 tx=0).stop 2024-03-31T16:35:36.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 shutdown_connections 2024-03-31T16:35:36.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05f406c8f0 0x7f05f406edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f061015e860 0x7f06100b8750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06100d4910 0x7f06100b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 --2- 172.21.15.120:0/2020463368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f061006da30 0x7f0610153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 >> 172.21.15.120:0/2020463368 conn(0x7f061009d7d0 msgr2=0x7f06100b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 shutdown_connections 2024-03-31T16:35:36.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.150+0000 7f0617f15640 1 -- 172.21.15.120:0/2020463368 wait complete. 2024-03-31T16:35:36.166 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-31T16:35:35.858528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.809264"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629943+0000","last_change":"2024-03-31T16:35:32.082188+0000","last_active":"2024-03-31T16:35:33.629943+0000","last_peered":"2024-03-31T16:35:33.629943+0000","last_clean":"2024-03-31T16:35:33.629943+0000","last_became_active":"2024-03-31T16:35:32.081925+0000","last_became_peered":"2024-03-31T16:35:32.081925+0000","last_unstale":"2024-03-31T16:35:33.629943+0000","last_undegraded":"2024-03-31T16:35:33.629943+0000","last_fullsized":"2024-03-31T16:35:33.629943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074810+0000","last_change":"2024-03-31T16:35:32.070694+0000","last_active":"2024-03-31T16:35:33.074810+0000","last_peered":"2024-03-31T16:35:33.074810+0000","last_clean":"2024-03-31T16:35:33.074810+0000","last_became_active":"2024-03-31T16:35:32.070442+0000","last_became_peered":"2024-03-31T16:35:32.070442+0000","last_unstale":"2024-03-31T16:35:33.074810+0000","last_undegraded":"2024-03-31T16:35:33.074810+0000","last_fullsized":"2024-03-31T16:35:33.074810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629856+0000","last_change":"2024-03-31T16:35:32.069876+0000","last_active":"2024-03-31T16:35:33.629856+0000","last_peered":"2024-03-31T16:35:33.629856+0000","last_clean":"2024-03-31T16:35:33.629856+0000","last_became_active":"2024-03-31T16:35:32.069638+0000","last_became_peered":"2024-03-31T16:35:32.069638+0000","last_unstale":"2024-03-31T16:35:33.629856+0000","last_undegraded":"2024-03-31T16:35:33.629856+0000","last_fullsized":"2024-03-31T16:35:33.629856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079518+0000","last_change":"2024-03-31T16:35:32.076897+0000","last_active":"2024-03-31T16:35:33.079518+0000","last_peered":"2024-03-31T16:35:33.079518+0000","last_clean":"2024-03-31T16:35:33.079518+0000","last_became_active":"2024-03-31T16:35:32.076633+0000","last_became_peered":"2024-03-31T16:35:32.076633+0000","last_unstale":"2024-03-31T16:35:33.079518+0000","last_undegraded":"2024-03-31T16:35:33.079518+0000","last_fullsized":"2024-03-31T16:35:33.079518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629757+0000","last_change":"2024-03-31T16:35:32.081370+0000","last_active":"2024-03-31T16:35:33.629757+0000","last_peered":"2024-03-31T16:35:33.629757+0000","last_clean":"2024-03-31T16:35:33.629757+0000","last_became_active":"2024-03-31T16:35:32.080814+0000","last_became_peered":"2024-03-31T16:35:32.080814+0000","last_unstale":"2024-03-31T16:35:33.629757+0000","last_undegraded":"2024-03-31T16:35:33.629757+0000","last_fullsized":"2024-03-31T16:35:33.629757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079237+0000","last_change":"2024-03-31T16:35:32.070742+0000","last_active":"2024-03-31T16:35:33.079237+0000","last_peered":"2024-03-31T16:35:33.079237+0000","last_clean":"2024-03-31T16:35:33.079237+0000","last_became_active":"2024-03-31T16:35:32.070264+0000","last_became_peered":"2024-03-31T16:35:32.070264+0000","last_unstale":"2024-03-31T16:35:33.079237+0000","last_undegraded":"2024-03-31T16:35:33.079237+0000","last_fullsized":"2024-03-31T16:35:33.079237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629493+0000","last_change":"2024-03-31T16:35:32.081753+0000","last_active":"2024-03-31T16:35:33.629493+0000","last_peered":"2024-03-31T16:35:33.629493+0000","last_clean":"2024-03-31T16:35:33.629493+0000","last_became_active":"2024-03-31T16:35:32.081453+0000","last_became_peered":"2024-03-31T16:35:32.081453+0000","last_unstale":"2024-03-31T16:35:33.629493+0000","last_undegraded":"2024-03-31T16:35:33.629493+0000","last_fullsized":"2024-03-31T16:35:33.629493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311273+0000","last_change":"2024-03-31T16:35:32.080813+0000","last_active":"2024-03-31T16:35:33.311273+0000","last_peered":"2024-03-31T16:35:33.311273+0000","last_clean":"2024-03-31T16:35:33.311273+0000","last_became_active":"2024-03-31T16:35:32.080309+0000","last_became_peered":"2024-03-31T16:35:32.080309+0000","last_unstale":"2024-03-31T16:35:33.311273+0000","last_undegraded":"2024-03-31T16:35:33.311273+0000","last_fullsized":"2024-03-31T16:35:33.311273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629958+0000","last_change":"2024-03-31T16:35:32.083450+0000","last_active":"2024-03-31T16:35:33.629958+0000","last_peered":"2024-03-31T16:35:33.629958+0000","last_clean":"2024-03-31T16:35:33.629958+0000","last_became_active":"2024-03-31T16:35:32.083187+0000","last_became_peered":"2024-03-31T16:35:32.083187+0000","last_unstale":"2024-03-31T16:35:33.629958+0000","last_undegraded":"2024-03-31T16:35:33.629958+0000","last_fullsized":"2024-03-31T16:35:33.629958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078571+0000","last_change":"2024-03-31T16:35:32.084349+0000","last_active":"2024-03-31T16:35:33.078571+0000","last_peered":"2024-03-31T16:35:33.078571+0000","last_clean":"2024-03-31T16:35:33.078571+0000","last_became_active":"2024-03-31T16:35:32.084055+0000","last_became_peered":"2024-03-31T16:35:32.084055+0000","last_unstale":"2024-03-31T16:35:33.078571+0000","last_undegraded":"2024-03-31T16:35:33.078571+0000","last_fullsized":"2024-03-31T16:35:33.078571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078081+0000","last_change":"2024-03-31T16:35:32.081612+0000","last_active":"2024-03-31T16:35:33.078081+0000","last_peered":"2024-03-31T16:35:33.078081+0000","last_clean":"2024-03-31T16:35:33.078081+0000","last_became_active":"2024-03-31T16:35:32.081288+0000","last_became_peered":"2024-03-31T16:35:32.081288+0000","last_unstale":"2024-03-31T16:35:33.078081+0000","last_undegraded":"2024-03-31T16:35:33.078081+0000","last_fullsized":"2024-03-31T16:35:33.078081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078261+0000","last_change":"2024-03-31T16:35:32.080466+0000","last_active":"2024-03-31T16:35:33.078261+0000","last_peered":"2024-03-31T16:35:33.078261+0000","last_clean":"2024-03-31T16:35:33.078261+0000","last_became_active":"2024-03-31T16:35:32.080192+0000","last_became_peered":"2024-03-31T16:35:32.080192+0000","last_unstale":"2024-03-31T16:35:33.078261+0000","last_undegraded":"2024-03-31T16:35:33.078261+0000","last_fullsized":"2024-03-31T16:35:33.078261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:56.678344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311515+0000","last_change":"2024-03-31T16:35:32.077617+0000","last_active":"2024-03-31T16:35:33.311515+0000","last_peered":"2024-03-31T16:35:33.311515+0000","last_clean":"2024-03-31T16:35:33.311515+0000","last_became_active":"2024-03-31T16:35:32.077017+0000","last_became_peered":"2024-03-31T16:35:32.077017+0000","last_unstale":"2024-03-31T16:35:33.311515+0000","last_undegraded":"2024-03-31T16:35:33.311515+0000","last_fullsized":"2024-03-31T16:35:33.311515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629702+0000","last_change":"2024-03-31T16:35:32.069024+0000","last_active":"2024-03-31T16:35:33.629702+0000","last_peered":"2024-03-31T16:35:33.629702+0000","last_clean":"2024-03-31T16:35:33.629702+0000","last_became_active":"2024-03-31T16:35:32.068738+0000","last_became_peered":"2024-03-31T16:35:32.068738+0000","last_unstale":"2024-03-31T16:35:33.629702+0000","last_undegraded":"2024-03-31T16:35:33.629702+0000","last_fullsized":"2024-03-31T16:35:33.629702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074478+0000","last_change":"2024-03-31T16:35:32.073796+0000","last_active":"2024-03-31T16:35:33.074478+0000","last_peered":"2024-03-31T16:35:33.074478+0000","last_clean":"2024-03-31T16:35:33.074478+0000","last_became_active":"2024-03-31T16:35:32.073514+0000","last_became_peered":"2024-03-31T16:35:32.073514+0000","last_unstale":"2024-03-31T16:35:33.074478+0000","last_undegraded":"2024-03-31T16:35:33.074478+0000","last_fullsized":"2024-03-31T16:35:33.074478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078993+0000","last_change":"2024-03-31T16:35:32.071718+0000","last_active":"2024-03-31T16:35:33.078993+0000","last_peered":"2024-03-31T16:35:33.078993+0000","last_clean":"2024-03-31T16:35:33.078993+0000","last_became_active":"2024-03-31T16:35:32.071286+0000","last_became_peered":"2024-03-31T16:35:32.071286+0000","last_unstale":"2024-03-31T16:35:33.078993+0000","last_undegraded":"2024-03-31T16:35:33.078993+0000","last_fullsized":"2024-03-31T16:35:33.078993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078539+0000","last_change":"2024-03-31T16:35:32.076047+0000","last_active":"2024-03-31T16:35:33.078539+0000","last_peered":"2024-03-31T16:35:33.078539+0000","last_clean":"2024-03-31T16:35:33.078539+0000","last_became_active":"2024-03-31T16:35:32.075802+0000","last_became_peered":"2024-03-31T16:35:32.075802+0000","last_unstale":"2024-03-31T16:35:33.078539+0000","last_undegraded":"2024-03-31T16:35:33.078539+0000","last_fullsized":"2024-03-31T16:35:33.078539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128917+0000","last_change":"2024-03-31T16:35:32.080444+0000","last_active":"2024-03-31T16:35:33.128917+0000","last_peered":"2024-03-31T16:35:33.128917+0000","last_clean":"2024-03-31T16:35:33.128917+0000","last_became_active":"2024-03-31T16:35:32.080141+0000","last_became_peered":"2024-03-31T16:35:32.080141+0000","last_unstale":"2024-03-31T16:35:33.128917+0000","last_undegraded":"2024-03-31T16:35:33.128917+0000","last_fullsized":"2024-03-31T16:35:33.128917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629965+0000","last_change":"2024-03-31T16:35:32.083381+0000","last_active":"2024-03-31T16:35:33.629965+0000","last_peered":"2024-03-31T16:35:33.629965+0000","last_clean":"2024-03-31T16:35:33.629965+0000","last_became_active":"2024-03-31T16:35:32.083134+0000","last_became_peered":"2024-03-31T16:35:32.083134+0000","last_unstale":"2024-03-31T16:35:33.629965+0000","last_undegraded":"2024-03-31T16:35:33.629965+0000","last_fullsized":"2024-03-31T16:35:33.629965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078368+0000","last_change":"2024-03-31T16:35:32.079624+0000","last_active":"2024-03-31T16:35:33.078368+0000","last_peered":"2024-03-31T16:35:33.078368+0000","last_clean":"2024-03-31T16:35:33.078368+0000","last_became_active":"2024-03-31T16:35:32.079376+0000","last_became_peered":"2024-03-31T16:35:32.079376+0000","last_unstale":"2024-03-31T16:35:33.078368+0000","last_undegraded":"2024-03-31T16:35:33.078368+0000","last_fullsized":"2024-03-31T16:35:33.078368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630066+0000","last_change":"2024-03-31T16:35:32.070619+0000","last_active":"2024-03-31T16:35:33.630066+0000","last_peered":"2024-03-31T16:35:33.630066+0000","last_clean":"2024-03-31T16:35:33.630066+0000","last_became_active":"2024-03-31T16:35:32.070240+0000","last_became_peered":"2024-03-31T16:35:32.070240+0000","last_unstale":"2024-03-31T16:35:33.630066+0000","last_undegraded":"2024-03-31T16:35:33.630066+0000","last_fullsized":"2024-03-31T16:35:33.630066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079368+0000","last_change":"2024-03-31T16:35:32.069561+0000","last_active":"2024-03-31T16:35:33.079368+0000","last_peered":"2024-03-31T16:35:33.079368+0000","last_clean":"2024-03-31T16:35:33.079368+0000","last_became_active":"2024-03-31T16:35:32.069299+0000","last_became_peered":"2024-03-31T16:35:32.069299+0000","last_unstale":"2024-03-31T16:35:33.079368+0000","last_undegraded":"2024-03-31T16:35:33.079368+0000","last_fullsized":"2024-03-31T16:35:33.079368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311327+0000","last_change":"2024-03-31T16:35:32.077589+0000","last_active":"2024-03-31T16:35:33.311327+0000","last_peered":"2024-03-31T16:35:33.311327+0000","last_clean":"2024-03-31T16:35:33.311327+0000","last_became_active":"2024-03-31T16:35:32.077321+0000","last_became_peered":"2024-03-31T16:35:32.077321+0000","last_unstale":"2024-03-31T16:35:33.311327+0000","last_undegraded":"2024-03-31T16:35:33.311327+0000","last_fullsized":"2024-03-31T16:35:33.311327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078983+0000","last_change":"2024-03-31T16:35:32.077562+0000","last_active":"2024-03-31T16:35:33.078983+0000","last_peered":"2024-03-31T16:35:33.078983+0000","last_clean":"2024-03-31T16:35:33.078983+0000","last_became_active":"2024-03-31T16:35:32.077275+0000","last_became_peered":"2024-03-31T16:35:32.077275+0000","last_unstale":"2024-03-31T16:35:33.078983+0000","last_undegraded":"2024-03-31T16:35:33.078983+0000","last_fullsized":"2024-03-31T16:35:33.078983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311700+0000","last_change":"2024-03-31T16:35:32.086200+0000","last_active":"2024-03-31T16:35:33.311700+0000","last_peered":"2024-03-31T16:35:33.311700+0000","last_clean":"2024-03-31T16:35:33.311700+0000","last_became_active":"2024-03-31T16:35:32.085924+0000","last_became_peered":"2024-03-31T16:35:32.085924+0000","last_unstale":"2024-03-31T16:35:33.311700+0000","last_undegraded":"2024-03-31T16:35:33.311700+0000","last_fullsized":"2024-03-31T16:35:33.311700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078702+0000","last_change":"2024-03-31T16:35:32.088160+0000","last_active":"2024-03-31T16:35:33.078702+0000","last_peered":"2024-03-31T16:35:33.078702+0000","last_clean":"2024-03-31T16:35:33.078702+0000","last_became_active":"2024-03-31T16:35:32.087875+0000","last_became_peered":"2024-03-31T16:35:32.087875+0000","last_unstale":"2024-03-31T16:35:33.078702+0000","last_undegraded":"2024-03-31T16:35:33.078702+0000","last_fullsized":"2024-03-31T16:35:33.078702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:32.075010+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:32.074715+0000","last_became_peered":"2024-03-31T16:35:32.074715+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311571+0000","last_change":"2024-03-31T16:35:32.077435+0000","last_active":"2024-03-31T16:35:33.311571+0000","last_peered":"2024-03-31T16:35:33.311571+0000","last_clean":"2024-03-31T16:35:33.311571+0000","last_became_active":"2024-03-31T16:35:32.077163+0000","last_became_peered":"2024-03-31T16:35:32.077163+0000","last_unstale":"2024-03-31T16:35:33.311571+0000","last_undegraded":"2024-03-31T16:35:33.311571+0000","last_fullsized":"2024-03-31T16:35:33.311571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630102+0000","last_change":"2024-03-31T16:35:32.076462+0000","last_active":"2024-03-31T16:35:33.630102+0000","last_peered":"2024-03-31T16:35:33.630102+0000","last_clean":"2024-03-31T16:35:33.630102+0000","last_became_active":"2024-03-31T16:35:32.076201+0000","last_became_peered":"2024-03-31T16:35:32.076201+0000","last_unstale":"2024-03-31T16:35:33.630102+0000","last_undegraded":"2024-03-31T16:35:33.630102+0000","last_fullsized":"2024-03-31T16:35:33.630102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079461+0000","last_change":"2024-03-31T16:35:32.074783+0000","last_active":"2024-03-31T16:35:33.079461+0000","last_peered":"2024-03-31T16:35:33.079461+0000","last_clean":"2024-03-31T16:35:33.079461+0000","last_became_active":"2024-03-31T16:35:32.074536+0000","last_became_peered":"2024-03-31T16:35:32.074536+0000","last_unstale":"2024-03-31T16:35:33.079461+0000","last_undegraded":"2024-03-31T16:35:33.079461+0000","last_fullsized":"2024-03-31T16:35:33.079461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128826+0000","last_change":"2024-03-31T16:35:32.077326+0000","last_active":"2024-03-31T16:35:33.128826+0000","last_peered":"2024-03-31T16:35:33.128826+0000","last_clean":"2024-03-31T16:35:33.128826+0000","last_became_active":"2024-03-31T16:35:32.077039+0000","last_became_peered":"2024-03-31T16:35:32.077039+0000","last_unstale":"2024-03-31T16:35:33.128826+0000","last_undegraded":"2024-03-31T16:35:33.128826+0000","last_fullsized":"2024-03-31T16:35:33.128826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077057+0000","last_change":"2024-03-31T16:35:32.085061+0000","last_active":"2024-03-31T16:35:33.077057+0000","last_peered":"2024-03-31T16:35:33.077057+0000","last_clean":"2024-03-31T16:35:33.077057+0000","last_became_active":"2024-03-31T16:35:32.084792+0000","last_became_peered":"2024-03-31T16:35:32.084792+0000","last_unstale":"2024-03-31T16:35:33.077057+0000","last_undegraded":"2024-03-31T16:35:33.077057+0000","last_fullsized":"2024-03-31T16:35:33.077057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078221+0000","last_change":"2024-03-31T16:35:32.074311+0000","last_active":"2024-03-31T16:35:33.078221+0000","last_peered":"2024-03-31T16:35:33.078221+0000","last_clean":"2024-03-31T16:35:33.078221+0000","last_became_active":"2024-03-31T16:35:32.074039+0000","last_became_peered":"2024-03-31T16:35:32.074039+0000","last_unstale":"2024-03-31T16:35:33.078221+0000","last_undegraded":"2024-03-31T16:35:33.078221+0000","last_fullsized":"2024-03-31T16:35:33.078221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:44.307915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311618+0000","last_change":"2024-03-31T16:35:31.078753+0000","last_active":"2024-03-31T16:35:33.311618+0000","last_peered":"2024-03-31T16:35:33.311618+0000","last_clean":"2024-03-31T16:35:33.311618+0000","last_became_active":"2024-03-31T16:35:31.078408+0000","last_became_peered":"2024-03-31T16:35:31.078408+0000","last_unstale":"2024-03-31T16:35:33.311618+0000","last_undegraded":"2024-03-31T16:35:33.311618+0000","last_fullsized":"2024-03-31T16:35:33.311618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630191+0000","last_change":"2024-03-31T16:35:32.070960+0000","last_active":"2024-03-31T16:35:33.630191+0000","last_peered":"2024-03-31T16:35:33.630191+0000","last_clean":"2024-03-31T16:35:33.630191+0000","last_became_active":"2024-03-31T16:35:32.070713+0000","last_became_peered":"2024-03-31T16:35:32.070713+0000","last_unstale":"2024-03-31T16:35:33.630191+0000","last_undegraded":"2024-03-31T16:35:33.630191+0000","last_fullsized":"2024-03-31T16:35:33.630191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077405+0000","last_change":"2024-03-31T16:35:31.076917+0000","last_active":"2024-03-31T16:35:33.077405+0000","last_peered":"2024-03-31T16:35:33.077405+0000","last_clean":"2024-03-31T16:35:33.077405+0000","last_became_active":"2024-03-31T16:35:31.076373+0000","last_became_peered":"2024-03-31T16:35:31.076373+0000","last_unstale":"2024-03-31T16:35:33.077405+0000","last_undegraded":"2024-03-31T16:35:33.077405+0000","last_fullsized":"2024-03-31T16:35:33.077405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311424+0000","last_change":"2024-03-31T16:35:31.072420+0000","last_active":"2024-03-31T16:35:33.311424+0000","last_peered":"2024-03-31T16:35:33.311424+0000","last_clean":"2024-03-31T16:35:33.311424+0000","last_became_active":"2024-03-31T16:35:31.071802+0000","last_became_peered":"2024-03-31T16:35:31.071802+0000","last_unstale":"2024-03-31T16:35:33.311424+0000","last_undegraded":"2024-03-31T16:35:33.311424+0000","last_fullsized":"2024-03-31T16:35:33.311424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311331+0000","last_change":"2024-03-31T16:35:32.074735+0000","last_active":"2024-03-31T16:35:33.311331+0000","last_peered":"2024-03-31T16:35:33.311331+0000","last_clean":"2024-03-31T16:35:33.311331+0000","last_became_active":"2024-03-31T16:35:32.074093+0000","last_became_peered":"2024-03-31T16:35:32.074093+0000","last_unstale":"2024-03-31T16:35:33.311331+0000","last_undegraded":"2024-03-31T16:35:33.311331+0000","last_fullsized":"2024-03-31T16:35:33.311331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079036+0000","last_change":"2024-03-31T16:35:31.073148+0000","last_active":"2024-03-31T16:35:33.079036+0000","last_peered":"2024-03-31T16:35:33.079036+0000","last_clean":"2024-03-31T16:35:33.079036+0000","last_became_active":"2024-03-31T16:35:31.072813+0000","last_became_peered":"2024-03-31T16:35:31.072813+0000","last_unstale":"2024-03-31T16:35:33.079036+0000","last_undegraded":"2024-03-31T16:35:33.079036+0000","last_fullsized":"2024-03-31T16:35:33.079036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074452+0000","last_change":"2024-03-31T16:35:32.076380+0000","last_active":"2024-03-31T16:35:33.074452+0000","last_peered":"2024-03-31T16:35:33.074452+0000","last_clean":"2024-03-31T16:35:33.074452+0000","last_became_active":"2024-03-31T16:35:32.076113+0000","last_became_peered":"2024-03-31T16:35:32.076113+0000","last_unstale":"2024-03-31T16:35:33.074452+0000","last_undegraded":"2024-03-31T16:35:33.074452+0000","last_fullsized":"2024-03-31T16:35:33.074452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078091+0000","last_change":"2024-03-31T16:35:31.075070+0000","last_active":"2024-03-31T16:35:33.078091+0000","last_peered":"2024-03-31T16:35:33.078091+0000","last_clean":"2024-03-31T16:35:33.078091+0000","last_became_active":"2024-03-31T16:35:31.074753+0000","last_became_peered":"2024-03-31T16:35:31.074753+0000","last_unstale":"2024-03-31T16:35:33.078091+0000","last_undegraded":"2024-03-31T16:35:33.078091+0000","last_fullsized":"2024-03-31T16:35:33.078091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078764+0000","last_change":"2024-03-31T16:35:32.067130+0000","last_active":"2024-03-31T16:35:33.078764+0000","last_peered":"2024-03-31T16:35:33.078764+0000","last_clean":"2024-03-31T16:35:33.078764+0000","last_became_active":"2024-03-31T16:35:32.066719+0000","last_became_peered":"2024-03-31T16:35:32.066719+0000","last_unstale":"2024-03-31T16:35:33.078764+0000","last_undegraded":"2024-03-31T16:35:33.078764+0000","last_fullsized":"2024-03-31T16:35:33.078764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078833+0000","last_change":"2024-03-31T16:35:31.074858+0000","last_active":"2024-03-31T16:35:33.078833+0000","last_peered":"2024-03-31T16:35:33.078833+0000","last_clean":"2024-03-31T16:35:33.078833+0000","last_became_active":"2024-03-31T16:35:31.074274+0000","last_became_peered":"2024-03-31T16:35:31.074274+0000","last_unstale":"2024-03-31T16:35:33.078833+0000","last_undegraded":"2024-03-31T16:35:33.078833+0000","last_fullsized":"2024-03-31T16:35:33.078833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629883+0000","last_change":"2024-03-31T16:35:32.069889+0000","last_active":"2024-03-31T16:35:33.629883+0000","last_peered":"2024-03-31T16:35:33.629883+0000","last_clean":"2024-03-31T16:35:33.629883+0000","last_became_active":"2024-03-31T16:35:32.069595+0000","last_became_peered":"2024-03-31T16:35:32.069595+0000","last_unstale":"2024-03-31T16:35:33.629883+0000","last_undegraded":"2024-03-31T16:35:33.629883+0000","last_fullsized":"2024-03-31T16:35:33.629883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:31.075199+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:31.074912+0000","last_became_peered":"2024-03-31T16:35:31.074912+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078396+0000","last_change":"2024-03-31T16:35:32.075288+0000","last_active":"2024-03-31T16:35:33.078396+0000","last_peered":"2024-03-31T16:35:33.078396+0000","last_clean":"2024-03-31T16:35:33.078396+0000","last_became_active":"2024-03-31T16:35:32.074982+0000","last_became_peered":"2024-03-31T16:35:32.074982+0000","last_unstale":"2024-03-31T16:35:33.078396+0000","last_undegraded":"2024-03-31T16:35:33.078396+0000","last_fullsized":"2024-03-31T16:35:33.078396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078276+0000","last_change":"2024-03-31T16:35:31.071044+0000","last_active":"2024-03-31T16:35:33.078276+0000","last_peered":"2024-03-31T16:35:33.078276+0000","last_clean":"2024-03-31T16:35:33.078276+0000","last_became_active":"2024-03-31T16:35:31.070775+0000","last_became_peered":"2024-03-31T16:35:31.070775+0000","last_unstale":"2024-03-31T16:35:33.078276+0000","last_undegraded":"2024-03-31T16:35:33.078276+0000","last_fullsized":"2024-03-31T16:35:33.078276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629719+0000","last_change":"2024-03-31T16:35:32.082874+0000","last_active":"2024-03-31T16:35:33.629719+0000","last_peered":"2024-03-31T16:35:33.629719+0000","last_clean":"2024-03-31T16:35:33.629719+0000","last_became_active":"2024-03-31T16:35:32.082582+0000","last_became_peered":"2024-03-31T16:35:32.082582+0000","last_unstale":"2024-03-31T16:35:33.629719+0000","last_undegraded":"2024-03-31T16:35:33.629719+0000","last_fullsized":"2024-03-31T16:35:33.629719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630199+0000","last_change":"2024-03-31T16:35:31.072679+0000","last_active":"2024-03-31T16:35:33.630199+0000","last_peered":"2024-03-31T16:35:33.630199+0000","last_clean":"2024-03-31T16:35:33.630199+0000","last_became_active":"2024-03-31T16:35:31.072349+0000","last_became_peered":"2024-03-31T16:35:31.072349+0000","last_unstale":"2024-03-31T16:35:33.630199+0000","last_undegraded":"2024-03-31T16:35:33.630199+0000","last_fullsized":"2024-03-31T16:35:33.630199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629731+0000","last_change":"2024-03-31T16:35:32.072536+0000","last_active":"2024-03-31T16:35:33.629731+0000","last_peered":"2024-03-31T16:35:33.629731+0000","last_clean":"2024-03-31T16:35:33.629731+0000","last_became_active":"2024-03-31T16:35:32.072299+0000","last_became_peered":"2024-03-31T16:35:32.072299+0000","last_unstale":"2024-03-31T16:35:33.629731+0000","last_undegraded":"2024-03-31T16:35:33.629731+0000","last_fullsized":"2024-03-31T16:35:33.629731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079455+0000","last_change":"2024-03-31T16:35:31.071681+0000","last_active":"2024-03-31T16:35:33.079455+0000","last_peered":"2024-03-31T16:35:33.079455+0000","last_clean":"2024-03-31T16:35:33.079455+0000","last_became_active":"2024-03-31T16:35:31.071425+0000","last_became_peered":"2024-03-31T16:35:31.071425+0000","last_unstale":"2024-03-31T16:35:33.079455+0000","last_undegraded":"2024-03-31T16:35:33.079455+0000","last_fullsized":"2024-03-31T16:35:33.079455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629860+0000","last_change":"2024-03-31T16:35:32.081639+0000","last_active":"2024-03-31T16:35:33.629860+0000","last_peered":"2024-03-31T16:35:33.629860+0000","last_clean":"2024-03-31T16:35:33.629860+0000","last_became_active":"2024-03-31T16:35:32.081101+0000","last_became_peered":"2024-03-31T16:35:32.081101+0000","last_unstale":"2024-03-31T16:35:33.629860+0000","last_undegraded":"2024-03-31T16:35:33.629860+0000","last_fullsized":"2024-03-31T16:35:33.629860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077272+0000","last_change":"2024-03-31T16:35:31.076342+0000","last_active":"2024-03-31T16:35:33.077272+0000","last_peered":"2024-03-31T16:35:33.077272+0000","last_clean":"2024-03-31T16:35:33.077272+0000","last_became_active":"2024-03-31T16:35:31.075546+0000","last_became_peered":"2024-03-31T16:35:31.075546+0000","last_unstale":"2024-03-31T16:35:33.077272+0000","last_undegraded":"2024-03-31T16:35:33.077272+0000","last_fullsized":"2024-03-31T16:35:33.077272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077346+0000","last_change":"2024-03-31T16:35:32.077698+0000","last_active":"2024-03-31T16:35:33.077346+0000","last_peered":"2024-03-31T16:35:33.077346+0000","last_clean":"2024-03-31T16:35:33.077346+0000","last_became_active":"2024-03-31T16:35:32.077415+0000","last_became_peered":"2024-03-31T16:35:32.077415+0000","last_unstale":"2024-03-31T16:35:33.077346+0000","last_undegraded":"2024-03-31T16:35:33.077346+0000","last_fullsized":"2024-03-31T16:35:33.077346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128862+0000","last_change":"2024-03-31T16:35:31.066612+0000","last_active":"2024-03-31T16:35:33.128862+0000","last_peered":"2024-03-31T16:35:33.128862+0000","last_clean":"2024-03-31T16:35:33.128862+0000","last_became_active":"2024-03-31T16:35:31.066089+0000","last_became_peered":"2024-03-31T16:35:31.066089+0000","last_unstale":"2024-03-31T16:35:33.128862+0000","last_undegraded":"2024-03-31T16:35:33.128862+0000","last_fullsized":"2024-03-31T16:35:33.128862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629500+0000","last_change":"2024-03-31T16:35:32.078195+0000","last_active":"2024-03-31T16:35:33.629500+0000","last_peered":"2024-03-31T16:35:33.629500+0000","last_clean":"2024-03-31T16:35:33.629500+0000","last_became_active":"2024-03-31T16:35:32.077878+0000","last_became_peered":"2024-03-31T16:35:32.077878+0000","last_unstale":"2024-03-31T16:35:33.629500+0000","last_undegraded":"2024-03-31T16:35:33.629500+0000","last_fullsized":"2024-03-31T16:35:33.629500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078606+0000","last_change":"2024-03-31T16:35:31.073893+0000","last_active":"2024-03-31T16:35:33.078606+0000","last_peered":"2024-03-31T16:35:33.078606+0000","last_clean":"2024-03-31T16:35:33.078606+0000","last_became_active":"2024-03-31T16:35:31.073625+0000","last_became_peered":"2024-03-31T16:35:31.073625+0000","last_unstale":"2024-03-31T16:35:33.078606+0000","last_undegraded":"2024-03-31T16:35:33.078606+0000","last_fullsized":"2024-03-31T16:35:33.078606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:09:31.419651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629895+0000","last_change":"2024-03-31T16:35:32.082027+0000","last_active":"2024-03-31T16:35:33.629895+0000","last_peered":"2024-03-31T16:35:33.629895+0000","last_clean":"2024-03-31T16:35:33.629895+0000","last_became_active":"2024-03-31T16:35:32.080888+0000","last_became_peered":"2024-03-31T16:35:32.080888+0000","last_unstale":"2024-03-31T16:35:33.629895+0000","last_undegraded":"2024-03-31T16:35:33.629895+0000","last_fullsized":"2024-03-31T16:35:33.629895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128888+0000","last_change":"2024-03-31T16:35:31.071984+0000","last_active":"2024-03-31T16:35:33.128888+0000","last_peered":"2024-03-31T16:35:33.128888+0000","last_clean":"2024-03-31T16:35:33.128888+0000","last_became_active":"2024-03-31T16:35:31.071703+0000","last_became_peered":"2024-03-31T16:35:31.071703+0000","last_unstale":"2024-03-31T16:35:33.128888+0000","last_undegraded":"2024-03-31T16:35:33.128888+0000","last_fullsized":"2024-03-31T16:35:33.128888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630062+0000","last_change":"2024-03-31T16:35:32.081372+0000","last_active":"2024-03-31T16:35:33.630062+0000","last_peered":"2024-03-31T16:35:33.630062+0000","last_clean":"2024-03-31T16:35:33.630062+0000","last_became_active":"2024-03-31T16:35:32.081052+0000","last_became_peered":"2024-03-31T16:35:32.081052+0000","last_unstale":"2024-03-31T16:35:33.630062+0000","last_undegraded":"2024-03-31T16:35:33.630062+0000","last_fullsized":"2024-03-31T16:35:33.630062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:11:37.125510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074783+0000","last_change":"2024-03-31T16:35:31.071727+0000","last_active":"2024-03-31T16:35:33.074783+0000","last_peered":"2024-03-31T16:35:33.074783+0000","last_clean":"2024-03-31T16:35:33.074783+0000","last_became_active":"2024-03-31T16:35:31.071417+0000","last_became_peered":"2024-03-31T16:35:31.071417+0000","last_unstale":"2024-03-31T16:35:33.074783+0000","last_undegraded":"2024-03-31T16:35:33.074783+0000","last_fullsized":"2024-03-31T16:35:33.074783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079593+0000","last_change":"2024-03-31T16:35:32.075436+0000","last_active":"2024-03-31T16:35:33.079593+0000","last_peered":"2024-03-31T16:35:33.079593+0000","last_clean":"2024-03-31T16:35:33.079593+0000","last_became_active":"2024-03-31T16:35:32.075165+0000","last_became_peered":"2024-03-31T16:35:32.075165+0000","last_unstale":"2024-03-31T16:35:33.079593+0000","last_undegraded":"2024-03-31T16:35:33.079593+0000","last_fullsized":"2024-03-31T16:35:33.079593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128801+0000","last_change":"2024-03-31T16:35:31.075714+0000","last_active":"2024-03-31T16:35:33.128801+0000","last_peered":"2024-03-31T16:35:33.128801+0000","last_clean":"2024-03-31T16:35:33.128801+0000","last_became_active":"2024-03-31T16:35:31.075208+0000","last_became_peered":"2024-03-31T16:35:31.075208+0000","last_unstale":"2024-03-31T16:35:33.128801+0000","last_undegraded":"2024-03-31T16:35:33.128801+0000","last_fullsized":"2024-03-31T16:35:33.128801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629869+0000","last_change":"2024-03-31T16:35:32.083722+0000","last_active":"2024-03-31T16:35:33.629869+0000","last_peered":"2024-03-31T16:35:33.629869+0000","last_clean":"2024-03-31T16:35:33.629869+0000","last_became_active":"2024-03-31T16:35:32.082940+0000","last_became_peered":"2024-03-31T16:35:32.082940+0000","last_unstale":"2024-03-31T16:35:33.629869+0000","last_undegraded":"2024-03-31T16:35:33.629869+0000","last_fullsized":"2024-03-31T16:35:33.629869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629462+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:35:33.629462+0000","last_peered":"2024-03-31T16:35:33.629462+0000","last_clean":"2024-03-31T16:35:33.629462+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:35:33.629462+0000","last_undegraded":"2024-03-31T16:35:33.629462+0000","last_fullsized":"2024-03-31T16:35:33.629462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077654+0000","last_change":"2024-03-31T16:35:31.067899+0000","last_active":"2024-03-31T16:35:33.077654+0000","last_peered":"2024-03-31T16:35:33.077654+0000","last_clean":"2024-03-31T16:35:33.077654+0000","last_became_active":"2024-03-31T16:35:31.067599+0000","last_became_peered":"2024-03-31T16:35:31.067599+0000","last_unstale":"2024-03-31T16:35:33.077654+0000","last_undegraded":"2024-03-31T16:35:33.077654+0000","last_fullsized":"2024-03-31T16:35:33.077654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311433+0000","last_change":"2024-03-31T16:35:32.075582+0000","last_active":"2024-03-31T16:35:33.311433+0000","last_peered":"2024-03-31T16:35:33.311433+0000","last_clean":"2024-03-31T16:35:33.311433+0000","last_became_active":"2024-03-31T16:35:32.075305+0000","last_became_peered":"2024-03-31T16:35:32.075305+0000","last_unstale":"2024-03-31T16:35:33.311433+0000","last_undegraded":"2024-03-31T16:35:33.311433+0000","last_fullsized":"2024-03-31T16:35:33.311433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629405+0000","last_change":"2024-03-31T16:35:31.077578+0000","last_active":"2024-03-31T16:35:33.629405+0000","last_peered":"2024-03-31T16:35:33.629405+0000","last_clean":"2024-03-31T16:35:33.629405+0000","last_became_active":"2024-03-31T16:35:31.076918+0000","last_became_peered":"2024-03-31T16:35:31.076918+0000","last_unstale":"2024-03-31T16:35:33.629405+0000","last_undegraded":"2024-03-31T16:35:33.629405+0000","last_fullsized":"2024-03-31T16:35:33.629405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629665+0000","last_change":"2024-03-31T16:35:32.071942+0000","last_active":"2024-03-31T16:35:33.629665+0000","last_peered":"2024-03-31T16:35:33.629665+0000","last_clean":"2024-03-31T16:35:33.629665+0000","last_became_active":"2024-03-31T16:35:32.071670+0000","last_became_peered":"2024-03-31T16:35:32.071670+0000","last_unstale":"2024-03-31T16:35:33.629665+0000","last_undegraded":"2024-03-31T16:35:33.629665+0000","last_fullsized":"2024-03-31T16:35:33.629665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:25:21.037477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128907+0000","last_change":"2024-03-31T16:35:31.070684+0000","last_active":"2024-03-31T16:35:33.128907+0000","last_peered":"2024-03-31T16:35:33.128907+0000","last_clean":"2024-03-31T16:35:33.128907+0000","last_became_active":"2024-03-31T16:35:31.070356+0000","last_became_peered":"2024-03-31T16:35:31.070356+0000","last_unstale":"2024-03-31T16:35:33.128907+0000","last_undegraded":"2024-03-31T16:35:33.128907+0000","last_fullsized":"2024-03-31T16:35:33.128907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074515+0000","last_change":"2024-03-31T16:35:32.069540+0000","last_active":"2024-03-31T16:35:33.074515+0000","last_peered":"2024-03-31T16:35:33.074515+0000","last_clean":"2024-03-31T16:35:33.074515+0000","last_became_active":"2024-03-31T16:35:32.069256+0000","last_became_peered":"2024-03-31T16:35:32.069256+0000","last_unstale":"2024-03-31T16:35:33.074515+0000","last_undegraded":"2024-03-31T16:35:33.074515+0000","last_fullsized":"2024-03-31T16:35:33.074515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079522+0000","last_change":"2024-03-31T16:35:31.069729+0000","last_active":"2024-03-31T16:35:33.079522+0000","last_peered":"2024-03-31T16:35:33.079522+0000","last_clean":"2024-03-31T16:35:33.079522+0000","last_became_active":"2024-03-31T16:35:31.069435+0000","last_became_peered":"2024-03-31T16:35:31.069435+0000","last_unstale":"2024-03-31T16:35:33.079522+0000","last_undegraded":"2024-03-31T16:35:33.079522+0000","last_fullsized":"2024-03-31T16:35:33.079522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078662+0000","last_change":"2024-03-31T16:35:32.072296+0000","last_active":"2024-03-31T16:35:33.078662+0000","last_peered":"2024-03-31T16:35:33.078662+0000","last_clean":"2024-03-31T16:35:33.078662+0000","last_became_active":"2024-03-31T16:35:32.071947+0000","last_became_peered":"2024-03-31T16:35:32.071947+0000","last_unstale":"2024-03-31T16:35:33.078662+0000","last_undegraded":"2024-03-31T16:35:33.078662+0000","last_fullsized":"2024-03-31T16:35:33.078662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074675+0000","last_change":"2024-03-31T16:35:31.070142+0000","last_active":"2024-03-31T16:35:33.074675+0000","last_peered":"2024-03-31T16:35:33.074675+0000","last_clean":"2024-03-31T16:35:33.074675+0000","last_became_active":"2024-03-31T16:35:31.069855+0000","last_became_peered":"2024-03-31T16:35:31.069855+0000","last_unstale":"2024-03-31T16:35:33.074675+0000","last_undegraded":"2024-03-31T16:35:33.074675+0000","last_fullsized":"2024-03-31T16:35:33.074675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079469+0000","last_change":"2024-03-31T16:35:32.076452+0000","last_active":"2024-03-31T16:35:33.079469+0000","last_peered":"2024-03-31T16:35:33.079469+0000","last_clean":"2024-03-31T16:35:33.079469+0000","last_became_active":"2024-03-31T16:35:32.076176+0000","last_became_peered":"2024-03-31T16:35:32.076176+0000","last_unstale":"2024-03-31T16:35:33.079469+0000","last_undegraded":"2024-03-31T16:35:33.079469+0000","last_fullsized":"2024-03-31T16:35:33.079469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629942+0000","last_change":"2024-03-31T16:35:31.077517+0000","last_active":"2024-03-31T16:35:33.629942+0000","last_peered":"2024-03-31T16:35:33.629942+0000","last_clean":"2024-03-31T16:35:33.629942+0000","last_became_active":"2024-03-31T16:35:31.077239+0000","last_became_peered":"2024-03-31T16:35:31.077239+0000","last_unstale":"2024-03-31T16:35:33.629942+0000","last_undegraded":"2024-03-31T16:35:33.629942+0000","last_fullsized":"2024-03-31T16:35:33.629942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074667+0000","last_change":"2024-03-31T16:35:32.070836+0000","last_active":"2024-03-31T16:35:33.074667+0000","last_peered":"2024-03-31T16:35:33.074667+0000","last_clean":"2024-03-31T16:35:33.074667+0000","last_became_active":"2024-03-31T16:35:32.070521+0000","last_became_peered":"2024-03-31T16:35:32.070521+0000","last_unstale":"2024-03-31T16:35:33.074667+0000","last_undegraded":"2024-03-31T16:35:33.074667+0000","last_fullsized":"2024-03-31T16:35:33.074667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077062+0000","last_change":"2024-03-31T16:35:31.074489+0000","last_active":"2024-03-31T16:35:33.077062+0000","last_peered":"2024-03-31T16:35:33.077062+0000","last_clean":"2024-03-31T16:35:33.077062+0000","last_became_active":"2024-03-31T16:35:31.074195+0000","last_became_peered":"2024-03-31T16:35:31.074195+0000","last_unstale":"2024-03-31T16:35:33.077062+0000","last_undegraded":"2024-03-31T16:35:33.077062+0000","last_fullsized":"2024-03-31T16:35:33.077062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311754+0000","last_change":"2024-03-31T16:35:32.083120+0000","last_active":"2024-03-31T16:35:33.311754+0000","last_peered":"2024-03-31T16:35:33.311754+0000","last_clean":"2024-03-31T16:35:33.311754+0000","last_became_active":"2024-03-31T16:35:32.082841+0000","last_became_peered":"2024-03-31T16:35:32.082841+0000","last_unstale":"2024-03-31T16:35:33.311754+0000","last_undegraded":"2024-03-31T16:35:33.311754+0000","last_fullsized":"2024-03-31T16:35:33.311754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078173+0000","last_change":"2024-03-31T16:35:31.076558+0000","last_active":"2024-03-31T16:35:33.078173+0000","last_peered":"2024-03-31T16:35:33.078173+0000","last_clean":"2024-03-31T16:35:33.078173+0000","last_became_active":"2024-03-31T16:35:31.075298+0000","last_became_peered":"2024-03-31T16:35:31.075298+0000","last_unstale":"2024-03-31T16:35:33.078173+0000","last_undegraded":"2024-03-31T16:35:33.078173+0000","last_fullsized":"2024-03-31T16:35:33.078173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629833+0000","last_change":"2024-03-31T16:35:32.069455+0000","last_active":"2024-03-31T16:35:33.629833+0000","last_peered":"2024-03-31T16:35:33.629833+0000","last_clean":"2024-03-31T16:35:33.629833+0000","last_became_active":"2024-03-31T16:35:32.069153+0000","last_became_peered":"2024-03-31T16:35:32.069153+0000","last_unstale":"2024-03-31T16:35:33.629833+0000","last_undegraded":"2024-03-31T16:35:33.629833+0000","last_fullsized":"2024-03-31T16:35:33.629833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629400+0000","last_change":"2024-03-31T16:35:31.078800+0000","last_active":"2024-03-31T16:35:33.629400+0000","last_peered":"2024-03-31T16:35:33.629400+0000","last_clean":"2024-03-31T16:35:33.629400+0000","last_became_active":"2024-03-31T16:35:31.078459+0000","last_became_peered":"2024-03-31T16:35:31.078459+0000","last_unstale":"2024-03-31T16:35:33.629400+0000","last_undegraded":"2024-03-31T16:35:33.629400+0000","last_fullsized":"2024-03-31T16:35:33.629400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078033+0000","last_change":"2024-03-31T16:35:32.069622+0000","last_active":"2024-03-31T16:35:33.078033+0000","last_peered":"2024-03-31T16:35:33.078033+0000","last_clean":"2024-03-31T16:35:33.078033+0000","last_became_active":"2024-03-31T16:35:32.069306+0000","last_became_peered":"2024-03-31T16:35:32.069306+0000","last_unstale":"2024-03-31T16:35:33.078033+0000","last_undegraded":"2024-03-31T16:35:33.078033+0000","last_fullsized":"2024-03-31T16:35:33.078033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:09.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074545+0000","last_change":"2024-03-31T16:35:31.075114+0000","last_active":"2024-03-31T16:35:33.074545+0000","last_peered":"2024-03-31T16:35:33.074545+0000","last_clean":"2024-03-31T16:35:33.074545+0000","last_became_active":"2024-03-31T16:35:31.074806+0000","last_became_peered":"2024-03-31T16:35:31.074806+0000","last_unstale":"2024-03-31T16:35:33.074545+0000","last_undegraded":"2024-03-31T16:35:33.074545+0000","last_fullsized":"2024-03-31T16:35:33.074545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311430+0000","last_change":"2024-03-31T16:35:32.074953+0000","last_active":"2024-03-31T16:35:33.311430+0000","last_peered":"2024-03-31T16:35:33.311430+0000","last_clean":"2024-03-31T16:35:33.311430+0000","last_became_active":"2024-03-31T16:35:32.074427+0000","last_became_peered":"2024-03-31T16:35:32.074427+0000","last_unstale":"2024-03-31T16:35:33.311430+0000","last_undegraded":"2024-03-31T16:35:33.311430+0000","last_fullsized":"2024-03-31T16:35:33.311430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074527+0000","last_change":"2024-03-31T16:35:31.075011+0000","last_active":"2024-03-31T16:35:33.074527+0000","last_peered":"2024-03-31T16:35:33.074527+0000","last_clean":"2024-03-31T16:35:33.074527+0000","last_became_active":"2024-03-31T16:35:31.074731+0000","last_became_peered":"2024-03-31T16:35:31.074731+0000","last_unstale":"2024-03-31T16:35:33.074527+0000","last_undegraded":"2024-03-31T16:35:33.074527+0000","last_fullsized":"2024-03-31T16:35:33.074527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311546+0000","last_change":"2024-03-31T16:35:32.075723+0000","last_active":"2024-03-31T16:35:33.311546+0000","last_peered":"2024-03-31T16:35:33.311546+0000","last_clean":"2024-03-31T16:35:33.311546+0000","last_became_active":"2024-03-31T16:35:32.075324+0000","last_became_peered":"2024-03-31T16:35:32.075324+0000","last_unstale":"2024-03-31T16:35:33.311546+0000","last_undegraded":"2024-03-31T16:35:33.311546+0000","last_fullsized":"2024-03-31T16:35:33.311546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629868+0000","last_change":"2024-03-31T16:35:31.077732+0000","last_active":"2024-03-31T16:35:33.629868+0000","last_peered":"2024-03-31T16:35:33.629868+0000","last_clean":"2024-03-31T16:35:33.629868+0000","last_became_active":"2024-03-31T16:35:31.076950+0000","last_became_peered":"2024-03-31T16:35:31.076950+0000","last_unstale":"2024-03-31T16:35:33.629868+0000","last_undegraded":"2024-03-31T16:35:33.629868+0000","last_fullsized":"2024-03-31T16:35:33.629868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077294+0000","last_change":"2024-03-31T16:35:32.078813+0000","last_active":"2024-03-31T16:35:33.077294+0000","last_peered":"2024-03-31T16:35:33.077294+0000","last_clean":"2024-03-31T16:35:33.077294+0000","last_became_active":"2024-03-31T16:35:32.078564+0000","last_became_peered":"2024-03-31T16:35:32.078564+0000","last_unstale":"2024-03-31T16:35:33.077294+0000","last_undegraded":"2024-03-31T16:35:33.077294+0000","last_fullsized":"2024-03-31T16:35:33.077294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079367+0000","last_change":"2024-03-31T16:35:32.070433+0000","last_active":"2024-03-31T16:35:33.079367+0000","last_peered":"2024-03-31T16:35:33.079367+0000","last_clean":"2024-03-31T16:35:33.079367+0000","last_became_active":"2024-03-31T16:35:32.070040+0000","last_became_peered":"2024-03-31T16:35:32.070040+0000","last_unstale":"2024-03-31T16:35:33.079367+0000","last_undegraded":"2024-03-31T16:35:33.079367+0000","last_fullsized":"2024-03-31T16:35:33.079367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629671+0000","last_change":"2024-03-31T16:35:31.077383+0000","last_active":"2024-03-31T16:35:33.629671+0000","last_peered":"2024-03-31T16:35:33.629671+0000","last_clean":"2024-03-31T16:35:33.629671+0000","last_became_active":"2024-03-31T16:35:31.076971+0000","last_became_peered":"2024-03-31T16:35:31.076971+0000","last_unstale":"2024-03-31T16:35:33.629671+0000","last_undegraded":"2024-03-31T16:35:33.629671+0000","last_fullsized":"2024-03-31T16:35:33.629671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079595+0000","last_change":"2024-03-31T16:35:32.070447+0000","last_active":"2024-03-31T16:35:33.079595+0000","last_peered":"2024-03-31T16:35:33.079595+0000","last_clean":"2024-03-31T16:35:33.079595+0000","last_became_active":"2024-03-31T16:35:32.070062+0000","last_became_peered":"2024-03-31T16:35:32.070062+0000","last_unstale":"2024-03-31T16:35:33.079595+0000","last_undegraded":"2024-03-31T16:35:33.079595+0000","last_fullsized":"2024-03-31T16:35:33.079595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629811+0000","last_change":"2024-03-31T16:35:31.078244+0000","last_active":"2024-03-31T16:35:33.629811+0000","last_peered":"2024-03-31T16:35:33.629811+0000","last_clean":"2024-03-31T16:35:33.629811+0000","last_became_active":"2024-03-31T16:35:31.077952+0000","last_became_peered":"2024-03-31T16:35:31.077952+0000","last_unstale":"2024-03-31T16:35:33.629811+0000","last_undegraded":"2024-03-31T16:35:33.629811+0000","last_fullsized":"2024-03-31T16:35:33.629811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629875+0000","last_change":"2024-03-31T16:35:32.072440+0000","last_active":"2024-03-31T16:35:33.629875+0000","last_peered":"2024-03-31T16:35:33.629875+0000","last_clean":"2024-03-31T16:35:33.629875+0000","last_became_active":"2024-03-31T16:35:32.072156+0000","last_became_peered":"2024-03-31T16:35:32.072156+0000","last_unstale":"2024-03-31T16:35:33.629875+0000","last_undegraded":"2024-03-31T16:35:33.629875+0000","last_fullsized":"2024-03-31T16:35:33.629875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311695+0000","last_change":"2024-03-31T16:35:31.073210+0000","last_active":"2024-03-31T16:35:33.311695+0000","last_peered":"2024-03-31T16:35:33.311695+0000","last_clean":"2024-03-31T16:35:33.311695+0000","last_became_active":"2024-03-31T16:35:31.072922+0000","last_became_peered":"2024-03-31T16:35:31.072922+0000","last_unstale":"2024-03-31T16:35:33.311695+0000","last_undegraded":"2024-03-31T16:35:33.311695+0000","last_fullsized":"2024-03-31T16:35:33.311695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311639+0000","last_change":"2024-03-31T16:35:32.080402+0000","last_active":"2024-03-31T16:35:33.311639+0000","last_peered":"2024-03-31T16:35:33.311639+0000","last_clean":"2024-03-31T16:35:33.311639+0000","last_became_active":"2024-03-31T16:35:32.080137+0000","last_became_peered":"2024-03-31T16:35:32.080137+0000","last_unstale":"2024-03-31T16:35:33.311639+0000","last_undegraded":"2024-03-31T16:35:33.311639+0000","last_fullsized":"2024-03-31T16:35:33.311639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630039+0000","last_change":"2024-03-31T16:35:31.076017+0000","last_active":"2024-03-31T16:35:33.630039+0000","last_peered":"2024-03-31T16:35:33.630039+0000","last_clean":"2024-03-31T16:35:33.630039+0000","last_became_active":"2024-03-31T16:35:31.075647+0000","last_became_peered":"2024-03-31T16:35:31.075647+0000","last_unstale":"2024-03-31T16:35:33.630039+0000","last_undegraded":"2024-03-31T16:35:33.630039+0000","last_fullsized":"2024-03-31T16:35:33.630039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:35:36.170 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-31T16:35:36.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.301+0000 7f076dd74640 1 Processor -- start 2024-03-31T16:35:36.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.301+0000 7f076dd74640 1 -- start start 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.301+0000 7f076dd74640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 0x7f07680d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.301+0000 7f076dd74640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f07680cf6b0 0x7f07680cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.301+0000 7f076dd74640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076806dfa0 con 0x7f076815e860 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.301+0000 7f076dd74640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f07680cf220 con 0x7f07680cf6b0 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.301+0000 7f076dd74640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f07680d4cf0 con 0x7f07680d43d0 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f07677fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f076815e860 0x7f076806d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53142/0 (socket says 172.21.15.120:53142) 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f07677fe640 1 -- 172.21.15.120:0/1626231501 learned_addr learned my addr 172.21.15.120:0/1626231501 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f075effd640 1 --2- 172.21.15.120:0/1626231501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 0x7f07680d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f0767fff640 1 --2- 172.21.15.120:0/1626231501 >> v2:172.21.15.203:3300/0 conn(0x7f07680cf6b0 0x7f07680cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f0766ffd640 1 -- 172.21.15.120:0/1626231501 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236142672 0 0) 0x7f076806dfa0 con 0x7f076815e860 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f0766ffd640 1 -- 172.21.15.120:0/1626231501 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0754003520 con 0x7f076815e860 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f0767fff640 1 -- 172.21.15.120:0/1626231501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 msgr2=0x7f07680d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f0767fff640 1 --2- 172.21.15.120:0/1626231501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 0x7f07680d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f0767fff640 1 -- 172.21.15.120:0/1626231501 >> v1:172.21.15.120:6789/0 conn(0x7f076815e860 legacy=0x7f076806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.302+0000 7f0767fff640 1 -- 172.21.15.120:0/1626231501 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076806e240 con 0x7f07680cf6b0 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f0767fff640 1 --2- 172.21.15.120:0/1626231501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 0x7f07680cfb00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f076806e170 tx=0x7f076002be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ec256d2b6d5990 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f0766ffd640 1 -- 172.21.15.120:0/1626231501 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760039070 con 0x7f07680cf6b0 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f0766ffd640 1 -- 172.21.15.120:0/1626231501 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076002cc40 con 0x7f07680cf6b0 2024-03-31T16:35:36.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f0766ffd640 1 -- 172.21.15.120:0/1626231501 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760034440 con 0x7f07680cf6b0 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f076dd74640 1 -- 172.21.15.120:0/1626231501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 msgr2=0x7f07680cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f076dd74640 1 --2- 172.21.15.120:0/1626231501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 0x7f07680cfb00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f076806e170 tx=0x7f076002be90 comp rx=0 tx=0).stop 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f076dd74640 1 -- 172.21.15.120:0/1626231501 shutdown_connections 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f076dd74640 1 --2- 172.21.15.120:0/1626231501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 0x7f07680cfb00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f076dd74640 1 --2- 172.21.15.120:0/1626231501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 0x7f07680d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f076dd74640 1 -- 172.21.15.120:0/1626231501 >> 172.21.15.120:0/1626231501 conn(0x7f076809d7d0 msgr2=0x7f076808bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f076dd74640 1 -- 172.21.15.120:0/1626231501 shutdown_connections 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.303+0000 7f076dd74640 1 -- 172.21.15.120:0/1626231501 wait complete. 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.304+0000 7f076dd74640 1 Processor -- start 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f076dd74640 1 -- start start 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f076dd74640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 0x7f07680b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f076dd74640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 0x7f07681f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f076dd74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f076815e860 0x7f07681f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f076dd74640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f076806dc00 con 0x7f076815e860 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f076dd74640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f07680d2c50 con 0x7f07680cf6b0 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f076dd74640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f076806dd80 con 0x7f07680d43d0 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f0767fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f076815e860 0x7f07681f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f07677fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 0x7f07680b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f0767fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f076815e860 0x7f07681f7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52206/0 (socket says 172.21.15.120:52206) 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f0767fff640 1 -- 172.21.15.120:0/1547829515 learned_addr learned my addr 172.21.15.120:0/1547829515 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.305+0000 7f075effd640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 0x7f07681f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0767fff640 1 -- 172.21.15.120:0/1547829515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 msgr2=0x7f07681f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0767fff640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 0x7f07681f7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0767fff640 1 -- 172.21.15.120:0/1547829515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 msgr2=0x7f07680b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0767fff640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 0x7f07680b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0767fff640 1 -- 172.21.15.120:0/1547829515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07680b77d0 con 0x7f076815e860 2024-03-31T16:35:36.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0767fff640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f076815e860 0x7f07681f7da0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f076002c4a0 tx=0x7f0760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:36.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0764ff9640 1 -- 172.21.15.120:0/1547829515 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760039050 con 0x7f076815e860 2024-03-31T16:35:36.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0764ff9640 1 -- 172.21.15.120:0/1547829515 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0760045070 con 0x7f076815e860 2024-03-31T16:35:36.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07680b7ab0 con 0x7f076815e860 2024-03-31T16:35:36.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f0764ff9640 1 -- 172.21.15.120:0/1547829515 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760009450 con 0x7f076815e860 2024-03-31T16:35:36.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.306+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07680b8070 con 0x7f076815e860 2024-03-31T16:35:36.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.307+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07680685c0 con 0x7f076815e860 2024-03-31T16:35:36.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.307+0000 7f0764ff9640 1 -- 172.21.15.120:0/1547829515 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0760040670 con 0x7f076815e860 2024-03-31T16:35:36.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.308+0000 7f0764ff9640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f074806c8f0 0x7f074806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.308+0000 7f0764ff9640 1 -- 172.21.15.120:0/1547829515 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f07600ae3d0 con 0x7f076815e860 2024-03-31T16:35:36.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.308+0000 7f07677fe640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f074806c8f0 0x7f074806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.308+0000 7f07677fe640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f074806c8f0 0x7f074806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0750005880 tx=0x7f0750009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:36.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.312+0000 7f0764ff9640 1 -- 172.21.15.120:0/1547829515 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f076007c360 con 0x7f076815e860 2024-03-31T16:35:36.507 INFO:tasks.ceph.mds.b.smithi203.stderr:2024-03-31T16:35:36.503+0000 7f407a8d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-31T16:35:36.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.556+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f07680b2410 con 0x7f076815e860 2024-03-31T16:35:36.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.556+0000 7f0764ff9640 1 -- 172.21.15.120:0/1547829515 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1011 (secure 0 0 0) 0x7f0760080660 con 0x7f076815e860 2024-03-31T16:35:36.561 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:36.561 INFO:teuthology.orchestra.run.smithi120.stdout:{"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1711902918,"num_in_osds":8,"osd_in_since":1711902909,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224206848,"bytes_avail":772869906432,"bytes_total":773094113280,"write_bytes_sec":2467,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4287}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-31T16:35:07.709352+0000","services":{}},"progress_events":{}} 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f074806c8f0 msgr2=0x7f074806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f074806c8f0 0x7f074806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0750005880 tx=0x7f0750009040 comp rx=0 tx=0).stop 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f076815e860 msgr2=0x7f07681f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f076815e860 0x7f07681f7da0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f076002c4a0 tx=0x7f0760004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 shutdown_connections 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f074806c8f0 0x7f074806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f076815e860 0x7f07681f7da0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07680d43d0 0x7f07681f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 --2- 172.21.15.120:0/1547829515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f07680cf6b0 0x7f07680b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 >> 172.21.15.120:0/1547829515 conn(0x7f076809d7d0 msgr2=0x7f07680b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:36.563 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 shutdown_connections 2024-03-31T16:35:36.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.558+0000 7f076dd74640 1 -- 172.21.15.120:0/1547829515 wait complete. 2024-03-31T16:35:36.573 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-31T16:35:36.573 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:35:36.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.668+0000 7f84aadba640 1 Processor -- start 2024-03-31T16:35:36.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.668+0000 7f84aadba640 1 -- start start 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84aadba640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f84a40b4af0 0x7f84a415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84aadba640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f84a4141680 0x7f84a415cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84aadba640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a415d7c0 con 0x7f84a41412a0 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84aadba640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f84a4141be0 con 0x7f84a40b4af0 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84aadba640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f84a4141ec0 con 0x7f84a4141680 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f84a40b4af0 0x7f84a415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f84a40b4af0 0x7f84a415ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52210/0 (socket says 172.21.15.120:52210) 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a3fff640 1 -- 172.21.15.120:0/920366114 learned_addr learned my addr 172.21.15.120:0/920366114 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:36.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a9357640 1 --2- 172.21.15.120:0/920366114 >> v2:172.21.15.203:3300/0 conn(0x7f84a4141680 0x7f84a415cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a3fff640 1 -- 172.21.15.120:0/920366114 >> v2:172.21.15.203:3300/0 conn(0x7f84a4141680 msgr2=0x7f84a415cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:36.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a3fff640 1 --2- 172.21.15.120:0/920366114 >> v2:172.21.15.203:3300/0 conn(0x7f84a4141680 0x7f84a415cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a3fff640 1 -- 172.21.15.120:0/920366114 >> v1:172.21.15.120:6789/0 conn(0x7f84a41412a0 legacy=0x7f84a40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a3fff640 1 -- 172.21.15.120:0/920366114 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a41421a0 con 0x7f84a40b4af0 2024-03-31T16:35:36.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.669+0000 7f84a37fe640 1 -- 172.21.15.120:0/920366114 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791876166 0 0) 0x7f84a415d7c0 con 0x7f84a41412a0 2024-03-31T16:35:36.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.670+0000 7f84a3fff640 1 --2- 172.21.15.120:0/920366114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a415ca50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f84a415a440 tx=0x7f849802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d7fcda62d34d14 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:36.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.670+0000 7f84a37fe640 1 -- 172.21.15.120:0/920366114 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8498034070 con 0x7f84a40b4af0 2024-03-31T16:35:36.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.670+0000 7f84a37fe640 1 -- 172.21.15.120:0/920366114 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8498030860 con 0x7f84a40b4af0 2024-03-31T16:35:36.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.670+0000 7f84a37fe640 1 -- 172.21.15.120:0/920366114 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8498030c30 con 0x7f84a40b4af0 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.671+0000 7f84aadba640 1 -- 172.21.15.120:0/920366114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 msgr2=0x7f84a415ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.671+0000 7f84aadba640 1 --2- 172.21.15.120:0/920366114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a415ca50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f84a415a440 tx=0x7f849802b9a0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.671+0000 7f84aadba640 1 -- 172.21.15.120:0/920366114 shutdown_connections 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.671+0000 7f84aadba640 1 --2- 172.21.15.120:0/920366114 >> v2:172.21.15.203:3300/0 conn(0x7f84a4141680 0x7f84a415cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.671+0000 7f84aadba640 1 --2- 172.21.15.120:0/920366114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a415ca50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.671+0000 7f84aadba640 1 -- 172.21.15.120:0/920366114 >> 172.21.15.120:0/920366114 conn(0x7f84a4067670 msgr2=0x7f84a4067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.671+0000 7f84aadba640 1 -- 172.21.15.120:0/920366114 shutdown_connections 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.671+0000 7f84aadba640 1 -- 172.21.15.120:0/920366114 wait complete. 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.672+0000 7f84aadba640 1 Processor -- start 2024-03-31T16:35:36.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.672+0000 7f84aadba640 1 -- start start 2024-03-31T16:35:36.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84aadba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a40b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84aadba640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84a41412a0 0x7f84a41f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84aadba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a4141680 0x7f84a4158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84aadba640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f84a41429a0 con 0x7f84a40b4af0 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84aadba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84a415d4d0 con 0x7f84a4141680 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84aadba640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f84a40cec40 con 0x7f84a41412a0 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a40b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a40b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52212/0 (socket says 172.21.15.120:52212) 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 -- 172.21.15.120:0/1278074977 learned_addr learned my addr 172.21.15.120:0/1278074977 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 -- 172.21.15.120:0/1278074977 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84a41412a0 msgr2=0x7f84a41f1480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84a41412a0 0x7f84a41f1480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 -- 172.21.15.120:0/1278074977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a4141680 msgr2=0x7f84a4158e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a4141680 0x7f84a4158e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 -- 172.21.15.120:0/1278074977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a40b5ad0 con 0x7f84a40b4af0 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a8b56640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a40b5360 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f849400c4e0 tx=0x7f849400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a17fa640 1 -- 172.21.15.120:0/1278074977 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494017070 con 0x7f84a40b4af0 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a17fa640 1 -- 172.21.15.120:0/1278074977 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84940035f0 con 0x7f84a40b4af0 2024-03-31T16:35:36.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84a17fa640 1 -- 172.21.15.120:0/1278074977 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84940039e0 con 0x7f84a40b4af0 2024-03-31T16:35:36.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.673+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a40b5db0 con 0x7f84a40b4af0 2024-03-31T16:35:36.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.674+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a40b6370 con 0x7f84a40b4af0 2024-03-31T16:35:36.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.674+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a4074f30 con 0x7f84a40b4af0 2024-03-31T16:35:36.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.675+0000 7f84a17fa640 1 -- 172.21.15.120:0/1278074977 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f849401a070 con 0x7f84a40b4af0 2024-03-31T16:35:36.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.675+0000 7f84a17fa640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f849006c8f0 0x7f849006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:36.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.675+0000 7f84a17fa640 1 -- 172.21.15.120:0/1278074977 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f849408adf0 con 0x7f84a40b4af0 2024-03-31T16:35:36.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.675+0000 7f84a3fff640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f849006c8f0 0x7f849006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:36.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.676+0000 7f84a3fff640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f849006c8f0 0x7f849006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8498036000 tx=0x7f8498008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:36.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.680+0000 7f84a17fa640 1 -- 172.21.15.120:0/1278074977 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8494058bd0 con 0x7f84a40b4af0 2024-03-31T16:35:36.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.851+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84a41568b0 con 0x7f849006c8f0 2024-03-31T16:35:36.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.857+0000 7f84a17fa640 1 -- 172.21.15.120:0/1278074977 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f84a41568b0 con 0x7f849006c8f0 2024-03-31T16:35:36.864 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:36.865 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f849006c8f0 msgr2=0x7f849006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f849006c8f0 0x7f849006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8498036000 tx=0x7f8498008030 comp rx=0 tx=0).stop 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 msgr2=0x7f84a40b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a40b5360 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f849400c4e0 tx=0x7f849400c9a0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 shutdown_connections 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f849006c8f0 0x7f849006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84a4141680 0x7f84a4158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84a41412a0 0x7f84a41f1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 --2- 172.21.15.120:0/1278074977 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84a40b4af0 0x7f84a40b5360 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 >> 172.21.15.120:0/1278074977 conn(0x7f84a4067670 msgr2=0x7f84a4067a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 shutdown_connections 2024-03-31T16:35:36.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:36.860+0000 7f84aadba640 1 -- 172.21.15.120:0/1278074977 wait complete. 2024-03-31T16:35:36.875 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-31T16:35:35.858528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.809264"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629943+0000","last_change":"2024-03-31T16:35:32.082188+0000","last_active":"2024-03-31T16:35:33.629943+0000","last_peered":"2024-03-31T16:35:33.629943+0000","last_clean":"2024-03-31T16:35:33.629943+0000","last_became_active":"2024-03-31T16:35:32.081925+0000","last_became_peered":"2024-03-31T16:35:32.081925+0000","last_unstale":"2024-03-31T16:35:33.629943+0000","last_undegraded":"2024-03-31T16:35:33.629943+0000","last_fullsized":"2024-03-31T16:35:33.629943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074810+0000","last_change":"2024-03-31T16:35:32.070694+0000","last_active":"2024-03-31T16:35:33.074810+0000","last_peered":"2024-03-31T16:35:33.074810+0000","last_clean":"2024-03-31T16:35:33.074810+0000","last_became_active":"2024-03-31T16:35:32.070442+0000","last_became_peered":"2024-03-31T16:35:32.070442+0000","last_unstale":"2024-03-31T16:35:33.074810+0000","last_undegraded":"2024-03-31T16:35:33.074810+0000","last_fullsized":"2024-03-31T16:35:33.074810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629856+0000","last_change":"2024-03-31T16:35:32.069876+0000","last_active":"2024-03-31T16:35:33.629856+0000","last_peered":"2024-03-31T16:35:33.629856+0000","last_clean":"2024-03-31T16:35:33.629856+0000","last_became_active":"2024-03-31T16:35:32.069638+0000","last_became_peered":"2024-03-31T16:35:32.069638+0000","last_unstale":"2024-03-31T16:35:33.629856+0000","last_undegraded":"2024-03-31T16:35:33.629856+0000","last_fullsized":"2024-03-31T16:35:33.629856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079518+0000","last_change":"2024-03-31T16:35:32.076897+0000","last_active":"2024-03-31T16:35:33.079518+0000","last_peered":"2024-03-31T16:35:33.079518+0000","last_clean":"2024-03-31T16:35:33.079518+0000","last_became_active":"2024-03-31T16:35:32.076633+0000","last_became_peered":"2024-03-31T16:35:32.076633+0000","last_unstale":"2024-03-31T16:35:33.079518+0000","last_undegraded":"2024-03-31T16:35:33.079518+0000","last_fullsized":"2024-03-31T16:35:33.079518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629757+0000","last_change":"2024-03-31T16:35:32.081370+0000","last_active":"2024-03-31T16:35:33.629757+0000","last_peered":"2024-03-31T16:35:33.629757+0000","last_clean":"2024-03-31T16:35:33.629757+0000","last_became_active":"2024-03-31T16:35:32.080814+0000","last_became_peered":"2024-03-31T16:35:32.080814+0000","last_unstale":"2024-03-31T16:35:33.629757+0000","last_undegraded":"2024-03-31T16:35:33.629757+0000","last_fullsized":"2024-03-31T16:35:33.629757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079237+0000","last_change":"2024-03-31T16:35:32.070742+0000","last_active":"2024-03-31T16:35:33.079237+0000","last_peered":"2024-03-31T16:35:33.079237+0000","last_clean":"2024-03-31T16:35:33.079237+0000","last_became_active":"2024-03-31T16:35:32.070264+0000","last_became_peered":"2024-03-31T16:35:32.070264+0000","last_unstale":"2024-03-31T16:35:33.079237+0000","last_undegraded":"2024-03-31T16:35:33.079237+0000","last_fullsized":"2024-03-31T16:35:33.079237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629493+0000","last_change":"2024-03-31T16:35:32.081753+0000","last_active":"2024-03-31T16:35:33.629493+0000","last_peered":"2024-03-31T16:35:33.629493+0000","last_clean":"2024-03-31T16:35:33.629493+0000","last_became_active":"2024-03-31T16:35:32.081453+0000","last_became_peered":"2024-03-31T16:35:32.081453+0000","last_unstale":"2024-03-31T16:35:33.629493+0000","last_undegraded":"2024-03-31T16:35:33.629493+0000","last_fullsized":"2024-03-31T16:35:33.629493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311273+0000","last_change":"2024-03-31T16:35:32.080813+0000","last_active":"2024-03-31T16:35:33.311273+0000","last_peered":"2024-03-31T16:35:33.311273+0000","last_clean":"2024-03-31T16:35:33.311273+0000","last_became_active":"2024-03-31T16:35:32.080309+0000","last_became_peered":"2024-03-31T16:35:32.080309+0000","last_unstale":"2024-03-31T16:35:33.311273+0000","last_undegraded":"2024-03-31T16:35:33.311273+0000","last_fullsized":"2024-03-31T16:35:33.311273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629958+0000","last_change":"2024-03-31T16:35:32.083450+0000","last_active":"2024-03-31T16:35:33.629958+0000","last_peered":"2024-03-31T16:35:33.629958+0000","last_clean":"2024-03-31T16:35:33.629958+0000","last_became_active":"2024-03-31T16:35:32.083187+0000","last_became_peered":"2024-03-31T16:35:32.083187+0000","last_unstale":"2024-03-31T16:35:33.629958+0000","last_undegraded":"2024-03-31T16:35:33.629958+0000","last_fullsized":"2024-03-31T16:35:33.629958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078571+0000","last_change":"2024-03-31T16:35:32.084349+0000","last_active":"2024-03-31T16:35:33.078571+0000","last_peered":"2024-03-31T16:35:33.078571+0000","last_clean":"2024-03-31T16:35:33.078571+0000","last_became_active":"2024-03-31T16:35:32.084055+0000","last_became_peered":"2024-03-31T16:35:32.084055+0000","last_unstale":"2024-03-31T16:35:33.078571+0000","last_undegraded":"2024-03-31T16:35:33.078571+0000","last_fullsized":"2024-03-31T16:35:33.078571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078081+0000","last_change":"2024-03-31T16:35:32.081612+0000","last_active":"2024-03-31T16:35:33.078081+0000","last_peered":"2024-03-31T16:35:33.078081+0000","last_clean":"2024-03-31T16:35:33.078081+0000","last_became_active":"2024-03-31T16:35:32.081288+0000","last_became_peered":"2024-03-31T16:35:32.081288+0000","last_unstale":"2024-03-31T16:35:33.078081+0000","last_undegraded":"2024-03-31T16:35:33.078081+0000","last_fullsized":"2024-03-31T16:35:33.078081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078261+0000","last_change":"2024-03-31T16:35:32.080466+0000","last_active":"2024-03-31T16:35:33.078261+0000","last_peered":"2024-03-31T16:35:33.078261+0000","last_clean":"2024-03-31T16:35:33.078261+0000","last_became_active":"2024-03-31T16:35:32.080192+0000","last_became_peered":"2024-03-31T16:35:32.080192+0000","last_unstale":"2024-03-31T16:35:33.078261+0000","last_undegraded":"2024-03-31T16:35:33.078261+0000","last_fullsized":"2024-03-31T16:35:33.078261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:56.678344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311515+0000","last_change":"2024-03-31T16:35:32.077617+0000","last_active":"2024-03-31T16:35:33.311515+0000","last_peered":"2024-03-31T16:35:33.311515+0000","last_clean":"2024-03-31T16:35:33.311515+0000","last_became_active":"2024-03-31T16:35:32.077017+0000","last_became_peered":"2024-03-31T16:35:32.077017+0000","last_unstale":"2024-03-31T16:35:33.311515+0000","last_undegraded":"2024-03-31T16:35:33.311515+0000","last_fullsized":"2024-03-31T16:35:33.311515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629702+0000","last_change":"2024-03-31T16:35:32.069024+0000","last_active":"2024-03-31T16:35:33.629702+0000","last_peered":"2024-03-31T16:35:33.629702+0000","last_clean":"2024-03-31T16:35:33.629702+0000","last_became_active":"2024-03-31T16:35:32.068738+0000","last_became_peered":"2024-03-31T16:35:32.068738+0000","last_unstale":"2024-03-31T16:35:33.629702+0000","last_undegraded":"2024-03-31T16:35:33.629702+0000","last_fullsized":"2024-03-31T16:35:33.629702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074478+0000","last_change":"2024-03-31T16:35:32.073796+0000","last_active":"2024-03-31T16:35:33.074478+0000","last_peered":"2024-03-31T16:35:33.074478+0000","last_clean":"2024-03-31T16:35:33.074478+0000","last_became_active":"2024-03-31T16:35:32.073514+0000","last_became_peered":"2024-03-31T16:35:32.073514+0000","last_unstale":"2024-03-31T16:35:33.074478+0000","last_undegraded":"2024-03-31T16:35:33.074478+0000","last_fullsized":"2024-03-31T16:35:33.074478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078993+0000","last_change":"2024-03-31T16:35:32.071718+0000","last_active":"2024-03-31T16:35:33.078993+0000","last_peered":"2024-03-31T16:35:33.078993+0000","last_clean":"2024-03-31T16:35:33.078993+0000","last_became_active":"2024-03-31T16:35:32.071286+0000","last_became_peered":"2024-03-31T16:35:32.071286+0000","last_unstale":"2024-03-31T16:35:33.078993+0000","last_undegraded":"2024-03-31T16:35:33.078993+0000","last_fullsized":"2024-03-31T16:35:33.078993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078539+0000","last_change":"2024-03-31T16:35:32.076047+0000","last_active":"2024-03-31T16:35:33.078539+0000","last_peered":"2024-03-31T16:35:33.078539+0000","last_clean":"2024-03-31T16:35:33.078539+0000","last_became_active":"2024-03-31T16:35:32.075802+0000","last_became_peered":"2024-03-31T16:35:32.075802+0000","last_unstale":"2024-03-31T16:35:33.078539+0000","last_undegraded":"2024-03-31T16:35:33.078539+0000","last_fullsized":"2024-03-31T16:35:33.078539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128917+0000","last_change":"2024-03-31T16:35:32.080444+0000","last_active":"2024-03-31T16:35:33.128917+0000","last_peered":"2024-03-31T16:35:33.128917+0000","last_clean":"2024-03-31T16:35:33.128917+0000","last_became_active":"2024-03-31T16:35:32.080141+0000","last_became_peered":"2024-03-31T16:35:32.080141+0000","last_unstale":"2024-03-31T16:35:33.128917+0000","last_undegraded":"2024-03-31T16:35:33.128917+0000","last_fullsized":"2024-03-31T16:35:33.128917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629965+0000","last_change":"2024-03-31T16:35:32.083381+0000","last_active":"2024-03-31T16:35:33.629965+0000","last_peered":"2024-03-31T16:35:33.629965+0000","last_clean":"2024-03-31T16:35:33.629965+0000","last_became_active":"2024-03-31T16:35:32.083134+0000","last_became_peered":"2024-03-31T16:35:32.083134+0000","last_unstale":"2024-03-31T16:35:33.629965+0000","last_undegraded":"2024-03-31T16:35:33.629965+0000","last_fullsized":"2024-03-31T16:35:33.629965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078368+0000","last_change":"2024-03-31T16:35:32.079624+0000","last_active":"2024-03-31T16:35:33.078368+0000","last_peered":"2024-03-31T16:35:33.078368+0000","last_clean":"2024-03-31T16:35:33.078368+0000","last_became_active":"2024-03-31T16:35:32.079376+0000","last_became_peered":"2024-03-31T16:35:32.079376+0000","last_unstale":"2024-03-31T16:35:33.078368+0000","last_undegraded":"2024-03-31T16:35:33.078368+0000","last_fullsized":"2024-03-31T16:35:33.078368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630066+0000","last_change":"2024-03-31T16:35:32.070619+0000","last_active":"2024-03-31T16:35:33.630066+0000","last_peered":"2024-03-31T16:35:33.630066+0000","last_clean":"2024-03-31T16:35:33.630066+0000","last_became_active":"2024-03-31T16:35:32.070240+0000","last_became_peered":"2024-03-31T16:35:32.070240+0000","last_unstale":"2024-03-31T16:35:33.630066+0000","last_undegraded":"2024-03-31T16:35:33.630066+0000","last_fullsized":"2024-03-31T16:35:33.630066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079368+0000","last_change":"2024-03-31T16:35:32.069561+0000","last_active":"2024-03-31T16:35:33.079368+0000","last_peered":"2024-03-31T16:35:33.079368+0000","last_clean":"2024-03-31T16:35:33.079368+0000","last_became_active":"2024-03-31T16:35:32.069299+0000","last_became_peered":"2024-03-31T16:35:32.069299+0000","last_unstale":"2024-03-31T16:35:33.079368+0000","last_undegraded":"2024-03-31T16:35:33.079368+0000","last_fullsized":"2024-03-31T16:35:33.079368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311327+0000","last_change":"2024-03-31T16:35:32.077589+0000","last_active":"2024-03-31T16:35:33.311327+0000","last_peered":"2024-03-31T16:35:33.311327+0000","last_clean":"2024-03-31T16:35:33.311327+0000","last_became_active":"2024-03-31T16:35:32.077321+0000","last_became_peered":"2024-03-31T16:35:32.077321+0000","last_unstale":"2024-03-31T16:35:33.311327+0000","last_undegraded":"2024-03-31T16:35:33.311327+0000","last_fullsized":"2024-03-31T16:35:33.311327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078983+0000","last_change":"2024-03-31T16:35:32.077562+0000","last_active":"2024-03-31T16:35:33.078983+0000","last_peered":"2024-03-31T16:35:33.078983+0000","last_clean":"2024-03-31T16:35:33.078983+0000","last_became_active":"2024-03-31T16:35:32.077275+0000","last_became_peered":"2024-03-31T16:35:32.077275+0000","last_unstale":"2024-03-31T16:35:33.078983+0000","last_undegraded":"2024-03-31T16:35:33.078983+0000","last_fullsized":"2024-03-31T16:35:33.078983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311700+0000","last_change":"2024-03-31T16:35:32.086200+0000","last_active":"2024-03-31T16:35:33.311700+0000","last_peered":"2024-03-31T16:35:33.311700+0000","last_clean":"2024-03-31T16:35:33.311700+0000","last_became_active":"2024-03-31T16:35:32.085924+0000","last_became_peered":"2024-03-31T16:35:32.085924+0000","last_unstale":"2024-03-31T16:35:33.311700+0000","last_undegraded":"2024-03-31T16:35:33.311700+0000","last_fullsized":"2024-03-31T16:35:33.311700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078702+0000","last_change":"2024-03-31T16:35:32.088160+0000","last_active":"2024-03-31T16:35:33.078702+0000","last_peered":"2024-03-31T16:35:33.078702+0000","last_clean":"2024-03-31T16:35:33.078702+0000","last_became_active":"2024-03-31T16:35:32.087875+0000","last_became_peered":"2024-03-31T16:35:32.087875+0000","last_unstale":"2024-03-31T16:35:33.078702+0000","last_undegraded":"2024-03-31T16:35:33.078702+0000","last_fullsized":"2024-03-31T16:35:33.078702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:32.075010+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:32.074715+0000","last_became_peered":"2024-03-31T16:35:32.074715+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311571+0000","last_change":"2024-03-31T16:35:32.077435+0000","last_active":"2024-03-31T16:35:33.311571+0000","last_peered":"2024-03-31T16:35:33.311571+0000","last_clean":"2024-03-31T16:35:33.311571+0000","last_became_active":"2024-03-31T16:35:32.077163+0000","last_became_peered":"2024-03-31T16:35:32.077163+0000","last_unstale":"2024-03-31T16:35:33.311571+0000","last_undegraded":"2024-03-31T16:35:33.311571+0000","last_fullsized":"2024-03-31T16:35:33.311571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630102+0000","last_change":"2024-03-31T16:35:32.076462+0000","last_active":"2024-03-31T16:35:33.630102+0000","last_peered":"2024-03-31T16:35:33.630102+0000","last_clean":"2024-03-31T16:35:33.630102+0000","last_became_active":"2024-03-31T16:35:32.076201+0000","last_became_peered":"2024-03-31T16:35:32.076201+0000","last_unstale":"2024-03-31T16:35:33.630102+0000","last_undegraded":"2024-03-31T16:35:33.630102+0000","last_fullsized":"2024-03-31T16:35:33.630102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079461+0000","last_change":"2024-03-31T16:35:32.074783+0000","last_active":"2024-03-31T16:35:33.079461+0000","last_peered":"2024-03-31T16:35:33.079461+0000","last_clean":"2024-03-31T16:35:33.079461+0000","last_became_active":"2024-03-31T16:35:32.074536+0000","last_became_peered":"2024-03-31T16:35:32.074536+0000","last_unstale":"2024-03-31T16:35:33.079461+0000","last_undegraded":"2024-03-31T16:35:33.079461+0000","last_fullsized":"2024-03-31T16:35:33.079461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128826+0000","last_change":"2024-03-31T16:35:32.077326+0000","last_active":"2024-03-31T16:35:33.128826+0000","last_peered":"2024-03-31T16:35:33.128826+0000","last_clean":"2024-03-31T16:35:33.128826+0000","last_became_active":"2024-03-31T16:35:32.077039+0000","last_became_peered":"2024-03-31T16:35:32.077039+0000","last_unstale":"2024-03-31T16:35:33.128826+0000","last_undegraded":"2024-03-31T16:35:33.128826+0000","last_fullsized":"2024-03-31T16:35:33.128826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077057+0000","last_change":"2024-03-31T16:35:32.085061+0000","last_active":"2024-03-31T16:35:33.077057+0000","last_peered":"2024-03-31T16:35:33.077057+0000","last_clean":"2024-03-31T16:35:33.077057+0000","last_became_active":"2024-03-31T16:35:32.084792+0000","last_became_peered":"2024-03-31T16:35:32.084792+0000","last_unstale":"2024-03-31T16:35:33.077057+0000","last_undegraded":"2024-03-31T16:35:33.077057+0000","last_fullsized":"2024-03-31T16:35:33.077057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078221+0000","last_change":"2024-03-31T16:35:32.074311+0000","last_active":"2024-03-31T16:35:33.078221+0000","last_peered":"2024-03-31T16:35:33.078221+0000","last_clean":"2024-03-31T16:35:33.078221+0000","last_became_active":"2024-03-31T16:35:32.074039+0000","last_became_peered":"2024-03-31T16:35:32.074039+0000","last_unstale":"2024-03-31T16:35:33.078221+0000","last_undegraded":"2024-03-31T16:35:33.078221+0000","last_fullsized":"2024-03-31T16:35:33.078221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:44.307915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311618+0000","last_change":"2024-03-31T16:35:31.078753+0000","last_active":"2024-03-31T16:35:33.311618+0000","last_peered":"2024-03-31T16:35:33.311618+0000","last_clean":"2024-03-31T16:35:33.311618+0000","last_became_active":"2024-03-31T16:35:31.078408+0000","last_became_peered":"2024-03-31T16:35:31.078408+0000","last_unstale":"2024-03-31T16:35:33.311618+0000","last_undegraded":"2024-03-31T16:35:33.311618+0000","last_fullsized":"2024-03-31T16:35:33.311618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630191+0000","last_change":"2024-03-31T16:35:32.070960+0000","last_active":"2024-03-31T16:35:33.630191+0000","last_peered":"2024-03-31T16:35:33.630191+0000","last_clean":"2024-03-31T16:35:33.630191+0000","last_became_active":"2024-03-31T16:35:32.070713+0000","last_became_peered":"2024-03-31T16:35:32.070713+0000","last_unstale":"2024-03-31T16:35:33.630191+0000","last_undegraded":"2024-03-31T16:35:33.630191+0000","last_fullsized":"2024-03-31T16:35:33.630191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077405+0000","last_change":"2024-03-31T16:35:31.076917+0000","last_active":"2024-03-31T16:35:33.077405+0000","last_peered":"2024-03-31T16:35:33.077405+0000","last_clean":"2024-03-31T16:35:33.077405+0000","last_became_active":"2024-03-31T16:35:31.076373+0000","last_became_peered":"2024-03-31T16:35:31.076373+0000","last_unstale":"2024-03-31T16:35:33.077405+0000","last_undegraded":"2024-03-31T16:35:33.077405+0000","last_fullsized":"2024-03-31T16:35:33.077405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311424+0000","last_change":"2024-03-31T16:35:31.072420+0000","last_active":"2024-03-31T16:35:33.311424+0000","last_peered":"2024-03-31T16:35:33.311424+0000","last_clean":"2024-03-31T16:35:33.311424+0000","last_became_active":"2024-03-31T16:35:31.071802+0000","last_became_peered":"2024-03-31T16:35:31.071802+0000","last_unstale":"2024-03-31T16:35:33.311424+0000","last_undegraded":"2024-03-31T16:35:33.311424+0000","last_fullsized":"2024-03-31T16:35:33.311424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311331+0000","last_change":"2024-03-31T16:35:32.074735+0000","last_active":"2024-03-31T16:35:33.311331+0000","last_peered":"2024-03-31T16:35:33.311331+0000","last_clean":"2024-03-31T16:35:33.311331+0000","last_became_active":"2024-03-31T16:35:32.074093+0000","last_became_peered":"2024-03-31T16:35:32.074093+0000","last_unstale":"2024-03-31T16:35:33.311331+0000","last_undegraded":"2024-03-31T16:35:33.311331+0000","last_fullsized":"2024-03-31T16:35:33.311331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079036+0000","last_change":"2024-03-31T16:35:31.073148+0000","last_active":"2024-03-31T16:35:33.079036+0000","last_peered":"2024-03-31T16:35:33.079036+0000","last_clean":"2024-03-31T16:35:33.079036+0000","last_became_active":"2024-03-31T16:35:31.072813+0000","last_became_peered":"2024-03-31T16:35:31.072813+0000","last_unstale":"2024-03-31T16:35:33.079036+0000","last_undegraded":"2024-03-31T16:35:33.079036+0000","last_fullsized":"2024-03-31T16:35:33.079036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074452+0000","last_change":"2024-03-31T16:35:32.076380+0000","last_active":"2024-03-31T16:35:33.074452+0000","last_peered":"2024-03-31T16:35:33.074452+0000","last_clean":"2024-03-31T16:35:33.074452+0000","last_became_active":"2024-03-31T16:35:32.076113+0000","last_became_peered":"2024-03-31T16:35:32.076113+0000","last_unstale":"2024-03-31T16:35:33.074452+0000","last_undegraded":"2024-03-31T16:35:33.074452+0000","last_fullsized":"2024-03-31T16:35:33.074452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078091+0000","last_change":"2024-03-31T16:35:31.075070+0000","last_active":"2024-03-31T16:35:33.078091+0000","last_peered":"2024-03-31T16:35:33.078091+0000","last_clean":"2024-03-31T16:35:33.078091+0000","last_became_active":"2024-03-31T16:35:31.074753+0000","last_became_peered":"2024-03-31T16:35:31.074753+0000","last_unstale":"2024-03-31T16:35:33.078091+0000","last_undegraded":"2024-03-31T16:35:33.078091+0000","last_fullsized":"2024-03-31T16:35:33.078091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078764+0000","last_change":"2024-03-31T16:35:32.067130+0000","last_active":"2024-03-31T16:35:33.078764+0000","last_peered":"2024-03-31T16:35:33.078764+0000","last_clean":"2024-03-31T16:35:33.078764+0000","last_became_active":"2024-03-31T16:35:32.066719+0000","last_became_peered":"2024-03-31T16:35:32.066719+0000","last_unstale":"2024-03-31T16:35:33.078764+0000","last_undegraded":"2024-03-31T16:35:33.078764+0000","last_fullsized":"2024-03-31T16:35:33.078764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078833+0000","last_change":"2024-03-31T16:35:31.074858+0000","last_active":"2024-03-31T16:35:33.078833+0000","last_peered":"2024-03-31T16:35:33.078833+0000","last_clean":"2024-03-31T16:35:33.078833+0000","last_became_active":"2024-03-31T16:35:31.074274+0000","last_became_peered":"2024-03-31T16:35:31.074274+0000","last_unstale":"2024-03-31T16:35:33.078833+0000","last_undegraded":"2024-03-31T16:35:33.078833+0000","last_fullsized":"2024-03-31T16:35:33.078833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629883+0000","last_change":"2024-03-31T16:35:32.069889+0000","last_active":"2024-03-31T16:35:33.629883+0000","last_peered":"2024-03-31T16:35:33.629883+0000","last_clean":"2024-03-31T16:35:33.629883+0000","last_became_active":"2024-03-31T16:35:32.069595+0000","last_became_peered":"2024-03-31T16:35:32.069595+0000","last_unstale":"2024-03-31T16:35:33.629883+0000","last_undegraded":"2024-03-31T16:35:33.629883+0000","last_fullsized":"2024-03-31T16:35:33.629883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:31.075199+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:31.074912+0000","last_became_peered":"2024-03-31T16:35:31.074912+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078396+0000","last_change":"2024-03-31T16:35:32.075288+0000","last_active":"2024-03-31T16:35:33.078396+0000","last_peered":"2024-03-31T16:35:33.078396+0000","last_clean":"2024-03-31T16:35:33.078396+0000","last_became_active":"2024-03-31T16:35:32.074982+0000","last_became_peered":"2024-03-31T16:35:32.074982+0000","last_unstale":"2024-03-31T16:35:33.078396+0000","last_undegraded":"2024-03-31T16:35:33.078396+0000","last_fullsized":"2024-03-31T16:35:33.078396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078276+0000","last_change":"2024-03-31T16:35:31.071044+0000","last_active":"2024-03-31T16:35:33.078276+0000","last_peered":"2024-03-31T16:35:33.078276+0000","last_clean":"2024-03-31T16:35:33.078276+0000","last_became_active":"2024-03-31T16:35:31.070775+0000","last_became_peered":"2024-03-31T16:35:31.070775+0000","last_unstale":"2024-03-31T16:35:33.078276+0000","last_undegraded":"2024-03-31T16:35:33.078276+0000","last_fullsized":"2024-03-31T16:35:33.078276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629719+0000","last_change":"2024-03-31T16:35:32.082874+0000","last_active":"2024-03-31T16:35:33.629719+0000","last_peered":"2024-03-31T16:35:33.629719+0000","last_clean":"2024-03-31T16:35:33.629719+0000","last_became_active":"2024-03-31T16:35:32.082582+0000","last_became_peered":"2024-03-31T16:35:32.082582+0000","last_unstale":"2024-03-31T16:35:33.629719+0000","last_undegraded":"2024-03-31T16:35:33.629719+0000","last_fullsized":"2024-03-31T16:35:33.629719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630199+0000","last_change":"2024-03-31T16:35:31.072679+0000","last_active":"2024-03-31T16:35:33.630199+0000","last_peered":"2024-03-31T16:35:33.630199+0000","last_clean":"2024-03-31T16:35:33.630199+0000","last_became_active":"2024-03-31T16:35:31.072349+0000","last_became_peered":"2024-03-31T16:35:31.072349+0000","last_unstale":"2024-03-31T16:35:33.630199+0000","last_undegraded":"2024-03-31T16:35:33.630199+0000","last_fullsized":"2024-03-31T16:35:33.630199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629731+0000","last_change":"2024-03-31T16:35:32.072536+0000","last_active":"2024-03-31T16:35:33.629731+0000","last_peered":"2024-03-31T16:35:33.629731+0000","last_clean":"2024-03-31T16:35:33.629731+0000","last_became_active":"2024-03-31T16:35:32.072299+0000","last_became_peered":"2024-03-31T16:35:32.072299+0000","last_unstale":"2024-03-31T16:35:33.629731+0000","last_undegraded":"2024-03-31T16:35:33.629731+0000","last_fullsized":"2024-03-31T16:35:33.629731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079455+0000","last_change":"2024-03-31T16:35:31.071681+0000","last_active":"2024-03-31T16:35:33.079455+0000","last_peered":"2024-03-31T16:35:33.079455+0000","last_clean":"2024-03-31T16:35:33.079455+0000","last_became_active":"2024-03-31T16:35:31.071425+0000","last_became_peered":"2024-03-31T16:35:31.071425+0000","last_unstale":"2024-03-31T16:35:33.079455+0000","last_undegraded":"2024-03-31T16:35:33.079455+0000","last_fullsized":"2024-03-31T16:35:33.079455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629860+0000","last_change":"2024-03-31T16:35:32.081639+0000","last_active":"2024-03-31T16:35:33.629860+0000","last_peered":"2024-03-31T16:35:33.629860+0000","last_clean":"2024-03-31T16:35:33.629860+0000","last_became_active":"2024-03-31T16:35:32.081101+0000","last_became_peered":"2024-03-31T16:35:32.081101+0000","last_unstale":"2024-03-31T16:35:33.629860+0000","last_undegraded":"2024-03-31T16:35:33.629860+0000","last_fullsized":"2024-03-31T16:35:33.629860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077272+0000","last_change":"2024-03-31T16:35:31.076342+0000","last_active":"2024-03-31T16:35:33.077272+0000","last_peered":"2024-03-31T16:35:33.077272+0000","last_clean":"2024-03-31T16:35:33.077272+0000","last_became_active":"2024-03-31T16:35:31.075546+0000","last_became_peered":"2024-03-31T16:35:31.075546+0000","last_unstale":"2024-03-31T16:35:33.077272+0000","last_undegraded":"2024-03-31T16:35:33.077272+0000","last_fullsized":"2024-03-31T16:35:33.077272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077346+0000","last_change":"2024-03-31T16:35:32.077698+0000","last_active":"2024-03-31T16:35:33.077346+0000","last_peered":"2024-03-31T16:35:33.077346+0000","last_clean":"2024-03-31T16:35:33.077346+0000","last_became_active":"2024-03-31T16:35:32.077415+0000","last_became_peered":"2024-03-31T16:35:32.077415+0000","last_unstale":"2024-03-31T16:35:33.077346+0000","last_undegraded":"2024-03-31T16:35:33.077346+0000","last_fullsized":"2024-03-31T16:35:33.077346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128862+0000","last_change":"2024-03-31T16:35:31.066612+0000","last_active":"2024-03-31T16:35:33.128862+0000","last_peered":"2024-03-31T16:35:33.128862+0000","last_clean":"2024-03-31T16:35:33.128862+0000","last_became_active":"2024-03-31T16:35:31.066089+0000","last_became_peered":"2024-03-31T16:35:31.066089+0000","last_unstale":"2024-03-31T16:35:33.128862+0000","last_undegraded":"2024-03-31T16:35:33.128862+0000","last_fullsized":"2024-03-31T16:35:33.128862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629500+0000","last_change":"2024-03-31T16:35:32.078195+0000","last_active":"2024-03-31T16:35:33.629500+0000","last_peered":"2024-03-31T16:35:33.629500+0000","last_clean":"2024-03-31T16:35:33.629500+0000","last_became_active":"2024-03-31T16:35:32.077878+0000","last_became_peered":"2024-03-31T16:35:32.077878+0000","last_unstale":"2024-03-31T16:35:33.629500+0000","last_undegraded":"2024-03-31T16:35:33.629500+0000","last_fullsized":"2024-03-31T16:35:33.629500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078606+0000","last_change":"2024-03-31T16:35:31.073893+0000","last_active":"2024-03-31T16:35:33.078606+0000","last_peered":"2024-03-31T16:35:33.078606+0000","last_clean":"2024-03-31T16:35:33.078606+0000","last_became_active":"2024-03-31T16:35:31.073625+0000","last_became_peered":"2024-03-31T16:35:31.073625+0000","last_unstale":"2024-03-31T16:35:33.078606+0000","last_undegraded":"2024-03-31T16:35:33.078606+0000","last_fullsized":"2024-03-31T16:35:33.078606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:09:31.419651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629895+0000","last_change":"2024-03-31T16:35:32.082027+0000","last_active":"2024-03-31T16:35:33.629895+0000","last_peered":"2024-03-31T16:35:33.629895+0000","last_clean":"2024-03-31T16:35:33.629895+0000","last_became_active":"2024-03-31T16:35:32.080888+0000","last_became_peered":"2024-03-31T16:35:32.080888+0000","last_unstale":"2024-03-31T16:35:33.629895+0000","last_undegraded":"2024-03-31T16:35:33.629895+0000","last_fullsized":"2024-03-31T16:35:33.629895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128888+0000","last_change":"2024-03-31T16:35:31.071984+0000","last_active":"2024-03-31T16:35:33.128888+0000","last_peered":"2024-03-31T16:35:33.128888+0000","last_clean":"2024-03-31T16:35:33.128888+0000","last_became_active":"2024-03-31T16:35:31.071703+0000","last_became_peered":"2024-03-31T16:35:31.071703+0000","last_unstale":"2024-03-31T16:35:33.128888+0000","last_undegraded":"2024-03-31T16:35:33.128888+0000","last_fullsized":"2024-03-31T16:35:33.128888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630062+0000","last_change":"2024-03-31T16:35:32.081372+0000","last_active":"2024-03-31T16:35:33.630062+0000","last_peered":"2024-03-31T16:35:33.630062+0000","last_clean":"2024-03-31T16:35:33.630062+0000","last_became_active":"2024-03-31T16:35:32.081052+0000","last_became_peered":"2024-03-31T16:35:32.081052+0000","last_unstale":"2024-03-31T16:35:33.630062+0000","last_undegraded":"2024-03-31T16:35:33.630062+0000","last_fullsized":"2024-03-31T16:35:33.630062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:11:37.125510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074783+0000","last_change":"2024-03-31T16:35:31.071727+0000","last_active":"2024-03-31T16:35:33.074783+0000","last_peered":"2024-03-31T16:35:33.074783+0000","last_clean":"2024-03-31T16:35:33.074783+0000","last_became_active":"2024-03-31T16:35:31.071417+0000","last_became_peered":"2024-03-31T16:35:31.071417+0000","last_unstale":"2024-03-31T16:35:33.074783+0000","last_undegraded":"2024-03-31T16:35:33.074783+0000","last_fullsized":"2024-03-31T16:35:33.074783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079593+0000","last_change":"2024-03-31T16:35:32.075436+0000","last_active":"2024-03-31T16:35:33.079593+0000","last_peered":"2024-03-31T16:35:33.079593+0000","last_clean":"2024-03-31T16:35:33.079593+0000","last_became_active":"2024-03-31T16:35:32.075165+0000","last_became_peered":"2024-03-31T16:35:32.075165+0000","last_unstale":"2024-03-31T16:35:33.079593+0000","last_undegraded":"2024-03-31T16:35:33.079593+0000","last_fullsized":"2024-03-31T16:35:33.079593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128801+0000","last_change":"2024-03-31T16:35:31.075714+0000","last_active":"2024-03-31T16:35:33.128801+0000","last_peered":"2024-03-31T16:35:33.128801+0000","last_clean":"2024-03-31T16:35:33.128801+0000","last_became_active":"2024-03-31T16:35:31.075208+0000","last_became_peered":"2024-03-31T16:35:31.075208+0000","last_unstale":"2024-03-31T16:35:33.128801+0000","last_undegraded":"2024-03-31T16:35:33.128801+0000","last_fullsized":"2024-03-31T16:35:33.128801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629869+0000","last_change":"2024-03-31T16:35:32.083722+0000","last_active":"2024-03-31T16:35:33.629869+0000","last_peered":"2024-03-31T16:35:33.629869+0000","last_clean":"2024-03-31T16:35:33.629869+0000","last_became_active":"2024-03-31T16:35:32.082940+0000","last_became_peered":"2024-03-31T16:35:32.082940+0000","last_unstale":"2024-03-31T16:35:33.629869+0000","last_undegraded":"2024-03-31T16:35:33.629869+0000","last_fullsized":"2024-03-31T16:35:33.629869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629462+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:35:33.629462+0000","last_peered":"2024-03-31T16:35:33.629462+0000","last_clean":"2024-03-31T16:35:33.629462+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:35:33.629462+0000","last_undegraded":"2024-03-31T16:35:33.629462+0000","last_fullsized":"2024-03-31T16:35:33.629462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077654+0000","last_change":"2024-03-31T16:35:31.067899+0000","last_active":"2024-03-31T16:35:33.077654+0000","last_peered":"2024-03-31T16:35:33.077654+0000","last_clean":"2024-03-31T16:35:33.077654+0000","last_became_active":"2024-03-31T16:35:31.067599+0000","last_became_peered":"2024-03-31T16:35:31.067599+0000","last_unstale":"2024-03-31T16:35:33.077654+0000","last_undegraded":"2024-03-31T16:35:33.077654+0000","last_fullsized":"2024-03-31T16:35:33.077654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311433+0000","last_change":"2024-03-31T16:35:32.075582+0000","last_active":"2024-03-31T16:35:33.311433+0000","last_peered":"2024-03-31T16:35:33.311433+0000","last_clean":"2024-03-31T16:35:33.311433+0000","last_became_active":"2024-03-31T16:35:32.075305+0000","last_became_peered":"2024-03-31T16:35:32.075305+0000","last_unstale":"2024-03-31T16:35:33.311433+0000","last_undegraded":"2024-03-31T16:35:33.311433+0000","last_fullsized":"2024-03-31T16:35:33.311433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629405+0000","last_change":"2024-03-31T16:35:31.077578+0000","last_active":"2024-03-31T16:35:33.629405+0000","last_peered":"2024-03-31T16:35:33.629405+0000","last_clean":"2024-03-31T16:35:33.629405+0000","last_became_active":"2024-03-31T16:35:31.076918+0000","last_became_peered":"2024-03-31T16:35:31.076918+0000","last_unstale":"2024-03-31T16:35:33.629405+0000","last_undegraded":"2024-03-31T16:35:33.629405+0000","last_fullsized":"2024-03-31T16:35:33.629405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629665+0000","last_change":"2024-03-31T16:35:32.071942+0000","last_active":"2024-03-31T16:35:33.629665+0000","last_peered":"2024-03-31T16:35:33.629665+0000","last_clean":"2024-03-31T16:35:33.629665+0000","last_became_active":"2024-03-31T16:35:32.071670+0000","last_became_peered":"2024-03-31T16:35:32.071670+0000","last_unstale":"2024-03-31T16:35:33.629665+0000","last_undegraded":"2024-03-31T16:35:33.629665+0000","last_fullsized":"2024-03-31T16:35:33.629665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:25:21.037477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128907+0000","last_change":"2024-03-31T16:35:31.070684+0000","last_active":"2024-03-31T16:35:33.128907+0000","last_peered":"2024-03-31T16:35:33.128907+0000","last_clean":"2024-03-31T16:35:33.128907+0000","last_became_active":"2024-03-31T16:35:31.070356+0000","last_became_peered":"2024-03-31T16:35:31.070356+0000","last_unstale":"2024-03-31T16:35:33.128907+0000","last_undegraded":"2024-03-31T16:35:33.128907+0000","last_fullsized":"2024-03-31T16:35:33.128907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074515+0000","last_change":"2024-03-31T16:35:32.069540+0000","last_active":"2024-03-31T16:35:33.074515+0000","last_peered":"2024-03-31T16:35:33.074515+0000","last_clean":"2024-03-31T16:35:33.074515+0000","last_became_active":"2024-03-31T16:35:32.069256+0000","last_became_peered":"2024-03-31T16:35:32.069256+0000","last_unstale":"2024-03-31T16:35:33.074515+0000","last_undegraded":"2024-03-31T16:35:33.074515+0000","last_fullsized":"2024-03-31T16:35:33.074515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079522+0000","last_change":"2024-03-31T16:35:31.069729+0000","last_active":"2024-03-31T16:35:33.079522+0000","last_peered":"2024-03-31T16:35:33.079522+0000","last_clean":"2024-03-31T16:35:33.079522+0000","last_became_active":"2024-03-31T16:35:31.069435+0000","last_became_peered":"2024-03-31T16:35:31.069435+0000","last_unstale":"2024-03-31T16:35:33.079522+0000","last_undegraded":"2024-03-31T16:35:33.079522+0000","last_fullsized":"2024-03-31T16:35:33.079522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078662+0000","last_change":"2024-03-31T16:35:32.072296+0000","last_active":"2024-03-31T16:35:33.078662+0000","last_peered":"2024-03-31T16:35:33.078662+0000","last_clean":"2024-03-31T16:35:33.078662+0000","last_became_active":"2024-03-31T16:35:32.071947+0000","last_became_peered":"2024-03-31T16:35:32.071947+0000","last_unstale":"2024-03-31T16:35:33.078662+0000","last_undegraded":"2024-03-31T16:35:33.078662+0000","last_fullsized":"2024-03-31T16:35:33.078662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074675+0000","last_change":"2024-03-31T16:35:31.070142+0000","last_active":"2024-03-31T16:35:33.074675+0000","last_peered":"2024-03-31T16:35:33.074675+0000","last_clean":"2024-03-31T16:35:33.074675+0000","last_became_active":"2024-03-31T16:35:31.069855+0000","last_became_peered":"2024-03-31T16:35:31.069855+0000","last_unstale":"2024-03-31T16:35:33.074675+0000","last_undegraded":"2024-03-31T16:35:33.074675+0000","last_fullsized":"2024-03-31T16:35:33.074675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079469+0000","last_change":"2024-03-31T16:35:32.076452+0000","last_active":"2024-03-31T16:35:33.079469+0000","last_peered":"2024-03-31T16:35:33.079469+0000","last_clean":"2024-03-31T16:35:33.079469+0000","last_became_active":"2024-03-31T16:35:32.076176+0000","last_became_peered":"2024-03-31T16:35:32.076176+0000","last_unstale":"2024-03-31T16:35:33.079469+0000","last_undegraded":"2024-03-31T16:35:33.079469+0000","last_fullsized":"2024-03-31T16:35:33.079469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629942+0000","last_change":"2024-03-31T16:35:31.077517+0000","last_active":"2024-03-31T16:35:33.629942+0000","last_peered":"2024-03-31T16:35:33.629942+0000","last_clean":"2024-03-31T16:35:33.629942+0000","last_became_active":"2024-03-31T16:35:31.077239+0000","last_became_peered":"2024-03-31T16:35:31.077239+0000","last_unstale":"2024-03-31T16:35:33.629942+0000","last_undegraded":"2024-03-31T16:35:33.629942+0000","last_fullsized":"2024-03-31T16:35:33.629942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074667+0000","last_change":"2024-03-31T16:35:32.070836+0000","last_active":"2024-03-31T16:35:33.074667+0000","last_peered":"2024-03-31T16:35:33.074667+0000","last_clean":"2024-03-31T16:35:33.074667+0000","last_became_active":"2024-03-31T16:35:32.070521+0000","last_became_peered":"2024-03-31T16:35:32.070521+0000","last_unstale":"2024-03-31T16:35:33.074667+0000","last_undegraded":"2024-03-31T16:35:33.074667+0000","last_fullsized":"2024-03-31T16:35:33.074667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077062+0000","last_change":"2024-03-31T16:35:31.074489+0000","last_active":"2024-03-31T16:35:33.077062+0000","last_peered":"2024-03-31T16:35:33.077062+0000","last_clean":"2024-03-31T16:35:33.077062+0000","last_became_active":"2024-03-31T16:35:31.074195+0000","last_became_peered":"2024-03-31T16:35:31.074195+0000","last_unstale":"2024-03-31T16:35:33.077062+0000","last_undegraded":"2024-03-31T16:35:33.077062+0000","last_fullsized":"2024-03-31T16:35:33.077062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311754+0000","last_change":"2024-03-31T16:35:32.083120+0000","last_active":"2024-03-31T16:35:33.311754+0000","last_peered":"2024-03-31T16:35:33.311754+0000","last_clean":"2024-03-31T16:35:33.311754+0000","last_became_active":"2024-03-31T16:35:32.082841+0000","last_became_peered":"2024-03-31T16:35:32.082841+0000","last_unstale":"2024-03-31T16:35:33.311754+0000","last_undegraded":"2024-03-31T16:35:33.311754+0000","last_fullsized":"2024-03-31T16:35:33.311754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078173+0000","last_change":"2024-03-31T16:35:31.076558+0000","last_active":"2024-03-31T16:35:33.078173+0000","last_peered":"2024-03-31T16:35:33.078173+0000","last_clean":"2024-03-31T16:35:33.078173+0000","last_became_active":"2024-03-31T16:35:31.075298+0000","last_became_peered":"2024-03-31T16:35:31.075298+0000","last_unstale":"2024-03-31T16:35:33.078173+0000","last_undegraded":"2024-03-31T16:35:33.078173+0000","last_fullsized":"2024-03-31T16:35:33.078173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629833+0000","last_change":"2024-03-31T16:35:32.069455+0000","last_active":"2024-03-31T16:35:33.629833+0000","last_peered":"2024-03-31T16:35:33.629833+0000","last_clean":"2024-03-31T16:35:33.629833+0000","last_became_active":"2024-03-31T16:35:32.069153+0000","last_became_peered":"2024-03-31T16:35:32.069153+0000","last_unstale":"2024-03-31T16:35:33.629833+0000","last_undegraded":"2024-03-31T16:35:33.629833+0000","last_fullsized":"2024-03-31T16:35:33.629833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629400+0000","last_change":"2024-03-31T16:35:31.078800+0000","last_active":"2024-03-31T16:35:33.629400+0000","last_peered":"2024-03-31T16:35:33.629400+0000","last_clean":"2024-03-31T16:35:33.629400+0000","last_became_active":"2024-03-31T16:35:31.078459+0000","last_became_peered":"2024-03-31T16:35:31.078459+0000","last_unstale":"2024-03-31T16:35:33.629400+0000","last_undegraded":"2024-03-31T16:35:33.629400+0000","last_fullsized":"2024-03-31T16:35:33.629400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078033+0000","last_change":"2024-03-31T16:35:32.069622+0000","last_active":"2024-03-31T16:35:33.078033+0000","last_peered":"2024-03-31T16:35:33.078033+0000","last_clean":"2024-03-31T16:35:33.078033+0000","last_became_active":"2024-03-31T16:35:32.069306+0000","last_became_peered":"2024-03-31T16:35:32.069306+0000","last_unstale":"2024-03-31T16:35:33.078033+0000","last_undegraded":"2024-03-31T16:35:33.078033+0000","last_fullsized":"2024-03-31T16:35:33.078033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:09.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074545+0000","last_change":"2024-03-31T16:35:31.075114+0000","last_active":"2024-03-31T16:35:33.074545+0000","last_peered":"2024-03-31T16:35:33.074545+0000","last_clean":"2024-03-31T16:35:33.074545+0000","last_became_active":"2024-03-31T16:35:31.074806+0000","last_became_peered":"2024-03-31T16:35:31.074806+0000","last_unstale":"2024-03-31T16:35:33.074545+0000","last_undegraded":"2024-03-31T16:35:33.074545+0000","last_fullsized":"2024-03-31T16:35:33.074545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311430+0000","last_change":"2024-03-31T16:35:32.074953+0000","last_active":"2024-03-31T16:35:33.311430+0000","last_peered":"2024-03-31T16:35:33.311430+0000","last_clean":"2024-03-31T16:35:33.311430+0000","last_became_active":"2024-03-31T16:35:32.074427+0000","last_became_peered":"2024-03-31T16:35:32.074427+0000","last_unstale":"2024-03-31T16:35:33.311430+0000","last_undegraded":"2024-03-31T16:35:33.311430+0000","last_fullsized":"2024-03-31T16:35:33.311430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074527+0000","last_change":"2024-03-31T16:35:31.075011+0000","last_active":"2024-03-31T16:35:33.074527+0000","last_peered":"2024-03-31T16:35:33.074527+0000","last_clean":"2024-03-31T16:35:33.074527+0000","last_became_active":"2024-03-31T16:35:31.074731+0000","last_became_peered":"2024-03-31T16:35:31.074731+0000","last_unstale":"2024-03-31T16:35:33.074527+0000","last_undegraded":"2024-03-31T16:35:33.074527+0000","last_fullsized":"2024-03-31T16:35:33.074527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311546+0000","last_change":"2024-03-31T16:35:32.075723+0000","last_active":"2024-03-31T16:35:33.311546+0000","last_peered":"2024-03-31T16:35:33.311546+0000","last_clean":"2024-03-31T16:35:33.311546+0000","last_became_active":"2024-03-31T16:35:32.075324+0000","last_became_peered":"2024-03-31T16:35:32.075324+0000","last_unstale":"2024-03-31T16:35:33.311546+0000","last_undegraded":"2024-03-31T16:35:33.311546+0000","last_fullsized":"2024-03-31T16:35:33.311546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629868+0000","last_change":"2024-03-31T16:35:31.077732+0000","last_active":"2024-03-31T16:35:33.629868+0000","last_peered":"2024-03-31T16:35:33.629868+0000","last_clean":"2024-03-31T16:35:33.629868+0000","last_became_active":"2024-03-31T16:35:31.076950+0000","last_became_peered":"2024-03-31T16:35:31.076950+0000","last_unstale":"2024-03-31T16:35:33.629868+0000","last_undegraded":"2024-03-31T16:35:33.629868+0000","last_fullsized":"2024-03-31T16:35:33.629868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077294+0000","last_change":"2024-03-31T16:35:32.078813+0000","last_active":"2024-03-31T16:35:33.077294+0000","last_peered":"2024-03-31T16:35:33.077294+0000","last_clean":"2024-03-31T16:35:33.077294+0000","last_became_active":"2024-03-31T16:35:32.078564+0000","last_became_peered":"2024-03-31T16:35:32.078564+0000","last_unstale":"2024-03-31T16:35:33.077294+0000","last_undegraded":"2024-03-31T16:35:33.077294+0000","last_fullsized":"2024-03-31T16:35:33.077294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079367+0000","last_change":"2024-03-31T16:35:32.070433+0000","last_active":"2024-03-31T16:35:33.079367+0000","last_peered":"2024-03-31T16:35:33.079367+0000","last_clean":"2024-03-31T16:35:33.079367+0000","last_became_active":"2024-03-31T16:35:32.070040+0000","last_became_peered":"2024-03-31T16:35:32.070040+0000","last_unstale":"2024-03-31T16:35:33.079367+0000","last_undegraded":"2024-03-31T16:35:33.079367+0000","last_fullsized":"2024-03-31T16:35:33.079367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629671+0000","last_change":"2024-03-31T16:35:31.077383+0000","last_active":"2024-03-31T16:35:33.629671+0000","last_peered":"2024-03-31T16:35:33.629671+0000","last_clean":"2024-03-31T16:35:33.629671+0000","last_became_active":"2024-03-31T16:35:31.076971+0000","last_became_peered":"2024-03-31T16:35:31.076971+0000","last_unstale":"2024-03-31T16:35:33.629671+0000","last_undegraded":"2024-03-31T16:35:33.629671+0000","last_fullsized":"2024-03-31T16:35:33.629671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079595+0000","last_change":"2024-03-31T16:35:32.070447+0000","last_active":"2024-03-31T16:35:33.079595+0000","last_peered":"2024-03-31T16:35:33.079595+0000","last_clean":"2024-03-31T16:35:33.079595+0000","last_became_active":"2024-03-31T16:35:32.070062+0000","last_became_peered":"2024-03-31T16:35:32.070062+0000","last_unstale":"2024-03-31T16:35:33.079595+0000","last_undegraded":"2024-03-31T16:35:33.079595+0000","last_fullsized":"2024-03-31T16:35:33.079595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629811+0000","last_change":"2024-03-31T16:35:31.078244+0000","last_active":"2024-03-31T16:35:33.629811+0000","last_peered":"2024-03-31T16:35:33.629811+0000","last_clean":"2024-03-31T16:35:33.629811+0000","last_became_active":"2024-03-31T16:35:31.077952+0000","last_became_peered":"2024-03-31T16:35:31.077952+0000","last_unstale":"2024-03-31T16:35:33.629811+0000","last_undegraded":"2024-03-31T16:35:33.629811+0000","last_fullsized":"2024-03-31T16:35:33.629811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629875+0000","last_change":"2024-03-31T16:35:32.072440+0000","last_active":"2024-03-31T16:35:33.629875+0000","last_peered":"2024-03-31T16:35:33.629875+0000","last_clean":"2024-03-31T16:35:33.629875+0000","last_became_active":"2024-03-31T16:35:32.072156+0000","last_became_peered":"2024-03-31T16:35:32.072156+0000","last_unstale":"2024-03-31T16:35:33.629875+0000","last_undegraded":"2024-03-31T16:35:33.629875+0000","last_fullsized":"2024-03-31T16:35:33.629875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311695+0000","last_change":"2024-03-31T16:35:31.073210+0000","last_active":"2024-03-31T16:35:33.311695+0000","last_peered":"2024-03-31T16:35:33.311695+0000","last_clean":"2024-03-31T16:35:33.311695+0000","last_became_active":"2024-03-31T16:35:31.072922+0000","last_became_peered":"2024-03-31T16:35:31.072922+0000","last_unstale":"2024-03-31T16:35:33.311695+0000","last_undegraded":"2024-03-31T16:35:33.311695+0000","last_fullsized":"2024-03-31T16:35:33.311695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311639+0000","last_change":"2024-03-31T16:35:32.080402+0000","last_active":"2024-03-31T16:35:33.311639+0000","last_peered":"2024-03-31T16:35:33.311639+0000","last_clean":"2024-03-31T16:35:33.311639+0000","last_became_active":"2024-03-31T16:35:32.080137+0000","last_became_peered":"2024-03-31T16:35:32.080137+0000","last_unstale":"2024-03-31T16:35:33.311639+0000","last_undegraded":"2024-03-31T16:35:33.311639+0000","last_fullsized":"2024-03-31T16:35:33.311639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630039+0000","last_change":"2024-03-31T16:35:31.076017+0000","last_active":"2024-03-31T16:35:33.630039+0000","last_peered":"2024-03-31T16:35:33.630039+0000","last_clean":"2024-03-31T16:35:33.630039+0000","last_became_active":"2024-03-31T16:35:31.075647+0000","last_became_peered":"2024-03-31T16:35:31.075647+0000","last_unstale":"2024-03-31T16:35:33.630039+0000","last_undegraded":"2024-03-31T16:35:33.630039+0000","last_fullsized":"2024-03-31T16:35:33.630039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:35:39.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:35:39.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.987+0000 7fb574bba640 1 Processor -- start 2024-03-31T16:35:39.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.987+0000 7fb574bba640 1 -- start start 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb574bba640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb5700d4760 0x7fb570169550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb574bba640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5700ceef0 con 0x7fb5700d0cb0 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb574bba640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb57015eab0 con 0x7fb57015e6d0 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb574bba640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb5700d1220 con 0x7fb5700d4760 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb567fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb5700d0cb0 0x7fb5700d4050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53164/0 (socket says 172.21.15.120:53164) 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb567fff640 1 -- 172.21.15.120:0/1508383917 learned_addr learned my addr 172.21.15.120:0/1508383917 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb56ed9d640 1 --2- 172.21.15.120:0/1508383917 >> v2:172.21.15.203:3300/0 conn(0x7fb5700d4760 0x7fb570169550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb56dd9b640 1 -- 172.21.15.120:0/1508383917 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212899127 0 0) 0x7fb5700ceef0 con 0x7fb5700d0cb0 2024-03-31T16:35:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb56dd9b640 1 -- 172.21.15.120:0/1508383917 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb55c003520 con 0x7fb5700d0cb0 2024-03-31T16:35:39.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb56ed9d640 1 -- 172.21.15.120:0/1508383917 >> v1:172.21.15.203:6789/0 conn(0x7fb57015e6d0 legacy=0x7fb5700d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:39.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb56ed9d640 1 -- 172.21.15.120:0/1508383917 >> v1:172.21.15.120:6789/0 conn(0x7fb5700d0cb0 legacy=0x7fb5700d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:39.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb56dd9b640 1 -- 172.21.15.120:0/1508383917 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626249018 0 0) 0x7fb57015eab0 con 0x7fb57015e6d0 2024-03-31T16:35:39.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.988+0000 7fb56ed9d640 1 -- 172.21.15.120:0/1508383917 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5700d1500 con 0x7fb5700d4760 2024-03-31T16:35:39.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.989+0000 7fb56ed9d640 1 --2- 172.21.15.120:0/1508383917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5700d4760 0x7fb570169550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb568009d90 tx=0x7fb56802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c28e2192f85dd6a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:39.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.989+0000 7fb56dd9b640 1 -- 172.21.15.120:0/1508383917 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568039070 con 0x7fb5700d4760 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.989+0000 7fb56dd9b640 1 -- 172.21.15.120:0/1508383917 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56802cd00 con 0x7fb5700d4760 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.989+0000 7fb56dd9b640 1 -- 172.21.15.120:0/1508383917 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568034640 con 0x7fb5700d4760 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.990+0000 7fb574bba640 1 -- 172.21.15.120:0/1508383917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5700d4760 msgr2=0x7fb570169550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.990+0000 7fb574bba640 1 --2- 172.21.15.120:0/1508383917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5700d4760 0x7fb570169550 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb568009d90 tx=0x7fb56802bf50 comp rx=0 tx=0).stop 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.990+0000 7fb574bba640 1 -- 172.21.15.120:0/1508383917 shutdown_connections 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.990+0000 7fb574bba640 1 --2- 172.21.15.120:0/1508383917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5700d4760 0x7fb570169550 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.990+0000 7fb574bba640 1 -- 172.21.15.120:0/1508383917 >> 172.21.15.120:0/1508383917 conn(0x7fb57009d7b0 msgr2=0x7fb57008bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.990+0000 7fb574bba640 1 -- 172.21.15.120:0/1508383917 shutdown_connections 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.990+0000 7fb574bba640 1 -- 172.21.15.120:0/1508383917 wait complete. 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.991+0000 7fb574bba640 1 Processor -- start 2024-03-31T16:35:39.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.991+0000 7fb574bba640 1 -- start start 2024-03-31T16:35:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb574bba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5700d0cb0 0x7fb5700b9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb574bba640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5700d4760 0x7fb5700cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb574bba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57015e6d0 0x7fb570153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb574bba640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb57006c890 con 0x7fb5700d0cb0 2024-03-31T16:35:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb574bba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5700d1ac0 con 0x7fb57015e6d0 2024-03-31T16:35:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb574bba640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb57006ca10 con 0x7fb5700d4760 2024-03-31T16:35:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb56e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5700d0cb0 0x7fb5700b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb56e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5700d0cb0 0x7fb5700b9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52222/0 (socket says 172.21.15.120:52222) 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb56e59c640 1 -- 172.21.15.120:0/91349745 learned_addr learned my addr 172.21.15.120:0/91349745 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb56ed9d640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57015e6d0 0x7fb570153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.992+0000 7fb567fff640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5700d4760 0x7fb5700cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb56e59c640 1 -- 172.21.15.120:0/91349745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5700d4760 msgr2=0x7fb5700cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb56e59c640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5700d4760 0x7fb5700cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb56e59c640 1 -- 172.21.15.120:0/91349745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57015e6d0 msgr2=0x7fb570153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb56e59c640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57015e6d0 0x7fb570153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb56e59c640 1 -- 172.21.15.120:0/91349745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5700b7f90 con 0x7fb5700d0cb0 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb56e59c640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5700d0cb0 0x7fb5700b9030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c440 tx=0x7fb56000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb566ffd640 1 -- 172.21.15.120:0/91349745 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560017070 con 0x7fb5700d0cb0 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb566ffd640 1 -- 172.21.15.120:0/91349745 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb560005480 con 0x7fb5700d0cb0 2024-03-31T16:35:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5700b82d0 con 0x7fb5700d0cb0 2024-03-31T16:35:40.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb566ffd640 1 -- 172.21.15.120:0/91349745 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560003830 con 0x7fb5700d0cb0 2024-03-31T16:35:40.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.993+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5700b8b10 con 0x7fb5700d0cb0 2024-03-31T16:35:40.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.994+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5700685c0 con 0x7fb5700d0cb0 2024-03-31T16:35:40.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.994+0000 7fb566ffd640 1 -- 172.21.15.120:0/91349745 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb56001a070 con 0x7fb5700d0cb0 2024-03-31T16:35:40.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.995+0000 7fb566ffd640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb55006c8f0 0x7fb55006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.995+0000 7fb566ffd640 1 -- 172.21.15.120:0/91349745 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb56008adc0 con 0x7fb5700d0cb0 2024-03-31T16:35:40.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.995+0000 7fb567fff640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb55006c8f0 0x7fb55006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.995+0000 7fb567fff640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb55006c8f0 0x7fb55006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb5700cabf0 tx=0x7fb558009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:39.999+0000 7fb566ffd640 1 -- 172.21.15.120:0/91349745 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb5700b82d0 con 0x7fb5700d0cb0 2024-03-31T16:35:40.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.176+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb57006c670 con 0x7fb55006c8f0 2024-03-31T16:35:40.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.182+0000 7fb566ffd640 1 -- 172.21.15.120:0/91349745 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fb57006c670 con 0x7fb55006c8f0 2024-03-31T16:35:40.189 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:40.190 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:35:40.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb55006c8f0 msgr2=0x7fb55006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb55006c8f0 0x7fb55006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb5700cabf0 tx=0x7fb558009040 comp rx=0 tx=0).stop 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5700d0cb0 msgr2=0x7fb5700b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5700d0cb0 0x7fb5700b9030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c440 tx=0x7fb56000c900 comp rx=0 tx=0).stop 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 shutdown_connections 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb55006c8f0 0x7fb55006edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57015e6d0 0x7fb570153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5700d4760 0x7fb5700cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 --2- 172.21.15.120:0/91349745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb5700d0cb0 0x7fb5700b9030 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 >> 172.21.15.120:0/91349745 conn(0x7fb57009d7b0 msgr2=0x7fb57006de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 shutdown_connections 2024-03-31T16:35:40.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.185+0000 7fb574bba640 1 -- 172.21.15.120:0/91349745 wait complete. 2024-03-31T16:35:40.200 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-31T16:35:39.859356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001790"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629943+0000","last_change":"2024-03-31T16:35:32.082188+0000","last_active":"2024-03-31T16:35:33.629943+0000","last_peered":"2024-03-31T16:35:33.629943+0000","last_clean":"2024-03-31T16:35:33.629943+0000","last_became_active":"2024-03-31T16:35:32.081925+0000","last_became_peered":"2024-03-31T16:35:32.081925+0000","last_unstale":"2024-03-31T16:35:33.629943+0000","last_undegraded":"2024-03-31T16:35:33.629943+0000","last_fullsized":"2024-03-31T16:35:33.629943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074810+0000","last_change":"2024-03-31T16:35:32.070694+0000","last_active":"2024-03-31T16:35:33.074810+0000","last_peered":"2024-03-31T16:35:33.074810+0000","last_clean":"2024-03-31T16:35:33.074810+0000","last_became_active":"2024-03-31T16:35:32.070442+0000","last_became_peered":"2024-03-31T16:35:32.070442+0000","last_unstale":"2024-03-31T16:35:33.074810+0000","last_undegraded":"2024-03-31T16:35:33.074810+0000","last_fullsized":"2024-03-31T16:35:33.074810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629856+0000","last_change":"2024-03-31T16:35:32.069876+0000","last_active":"2024-03-31T16:35:33.629856+0000","last_peered":"2024-03-31T16:35:33.629856+0000","last_clean":"2024-03-31T16:35:33.629856+0000","last_became_active":"2024-03-31T16:35:32.069638+0000","last_became_peered":"2024-03-31T16:35:32.069638+0000","last_unstale":"2024-03-31T16:35:33.629856+0000","last_undegraded":"2024-03-31T16:35:33.629856+0000","last_fullsized":"2024-03-31T16:35:33.629856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079518+0000","last_change":"2024-03-31T16:35:32.076897+0000","last_active":"2024-03-31T16:35:33.079518+0000","last_peered":"2024-03-31T16:35:33.079518+0000","last_clean":"2024-03-31T16:35:33.079518+0000","last_became_active":"2024-03-31T16:35:32.076633+0000","last_became_peered":"2024-03-31T16:35:32.076633+0000","last_unstale":"2024-03-31T16:35:33.079518+0000","last_undegraded":"2024-03-31T16:35:33.079518+0000","last_fullsized":"2024-03-31T16:35:33.079518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629757+0000","last_change":"2024-03-31T16:35:32.081370+0000","last_active":"2024-03-31T16:35:33.629757+0000","last_peered":"2024-03-31T16:35:33.629757+0000","last_clean":"2024-03-31T16:35:33.629757+0000","last_became_active":"2024-03-31T16:35:32.080814+0000","last_became_peered":"2024-03-31T16:35:32.080814+0000","last_unstale":"2024-03-31T16:35:33.629757+0000","last_undegraded":"2024-03-31T16:35:33.629757+0000","last_fullsized":"2024-03-31T16:35:33.629757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079237+0000","last_change":"2024-03-31T16:35:32.070742+0000","last_active":"2024-03-31T16:35:33.079237+0000","last_peered":"2024-03-31T16:35:33.079237+0000","last_clean":"2024-03-31T16:35:33.079237+0000","last_became_active":"2024-03-31T16:35:32.070264+0000","last_became_peered":"2024-03-31T16:35:32.070264+0000","last_unstale":"2024-03-31T16:35:33.079237+0000","last_undegraded":"2024-03-31T16:35:33.079237+0000","last_fullsized":"2024-03-31T16:35:33.079237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629493+0000","last_change":"2024-03-31T16:35:32.081753+0000","last_active":"2024-03-31T16:35:33.629493+0000","last_peered":"2024-03-31T16:35:33.629493+0000","last_clean":"2024-03-31T16:35:33.629493+0000","last_became_active":"2024-03-31T16:35:32.081453+0000","last_became_peered":"2024-03-31T16:35:32.081453+0000","last_unstale":"2024-03-31T16:35:33.629493+0000","last_undegraded":"2024-03-31T16:35:33.629493+0000","last_fullsized":"2024-03-31T16:35:33.629493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311273+0000","last_change":"2024-03-31T16:35:32.080813+0000","last_active":"2024-03-31T16:35:33.311273+0000","last_peered":"2024-03-31T16:35:33.311273+0000","last_clean":"2024-03-31T16:35:33.311273+0000","last_became_active":"2024-03-31T16:35:32.080309+0000","last_became_peered":"2024-03-31T16:35:32.080309+0000","last_unstale":"2024-03-31T16:35:33.311273+0000","last_undegraded":"2024-03-31T16:35:33.311273+0000","last_fullsized":"2024-03-31T16:35:33.311273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629958+0000","last_change":"2024-03-31T16:35:32.083450+0000","last_active":"2024-03-31T16:35:33.629958+0000","last_peered":"2024-03-31T16:35:33.629958+0000","last_clean":"2024-03-31T16:35:33.629958+0000","last_became_active":"2024-03-31T16:35:32.083187+0000","last_became_peered":"2024-03-31T16:35:32.083187+0000","last_unstale":"2024-03-31T16:35:33.629958+0000","last_undegraded":"2024-03-31T16:35:33.629958+0000","last_fullsized":"2024-03-31T16:35:33.629958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078571+0000","last_change":"2024-03-31T16:35:32.084349+0000","last_active":"2024-03-31T16:35:33.078571+0000","last_peered":"2024-03-31T16:35:33.078571+0000","last_clean":"2024-03-31T16:35:33.078571+0000","last_became_active":"2024-03-31T16:35:32.084055+0000","last_became_peered":"2024-03-31T16:35:32.084055+0000","last_unstale":"2024-03-31T16:35:33.078571+0000","last_undegraded":"2024-03-31T16:35:33.078571+0000","last_fullsized":"2024-03-31T16:35:33.078571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078081+0000","last_change":"2024-03-31T16:35:32.081612+0000","last_active":"2024-03-31T16:35:33.078081+0000","last_peered":"2024-03-31T16:35:33.078081+0000","last_clean":"2024-03-31T16:35:33.078081+0000","last_became_active":"2024-03-31T16:35:32.081288+0000","last_became_peered":"2024-03-31T16:35:32.081288+0000","last_unstale":"2024-03-31T16:35:33.078081+0000","last_undegraded":"2024-03-31T16:35:33.078081+0000","last_fullsized":"2024-03-31T16:35:33.078081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078261+0000","last_change":"2024-03-31T16:35:32.080466+0000","last_active":"2024-03-31T16:35:33.078261+0000","last_peered":"2024-03-31T16:35:33.078261+0000","last_clean":"2024-03-31T16:35:33.078261+0000","last_became_active":"2024-03-31T16:35:32.080192+0000","last_became_peered":"2024-03-31T16:35:32.080192+0000","last_unstale":"2024-03-31T16:35:33.078261+0000","last_undegraded":"2024-03-31T16:35:33.078261+0000","last_fullsized":"2024-03-31T16:35:33.078261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:56.678344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311515+0000","last_change":"2024-03-31T16:35:32.077617+0000","last_active":"2024-03-31T16:35:33.311515+0000","last_peered":"2024-03-31T16:35:33.311515+0000","last_clean":"2024-03-31T16:35:33.311515+0000","last_became_active":"2024-03-31T16:35:32.077017+0000","last_became_peered":"2024-03-31T16:35:32.077017+0000","last_unstale":"2024-03-31T16:35:33.311515+0000","last_undegraded":"2024-03-31T16:35:33.311515+0000","last_fullsized":"2024-03-31T16:35:33.311515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629702+0000","last_change":"2024-03-31T16:35:32.069024+0000","last_active":"2024-03-31T16:35:33.629702+0000","last_peered":"2024-03-31T16:35:33.629702+0000","last_clean":"2024-03-31T16:35:33.629702+0000","last_became_active":"2024-03-31T16:35:32.068738+0000","last_became_peered":"2024-03-31T16:35:32.068738+0000","last_unstale":"2024-03-31T16:35:33.629702+0000","last_undegraded":"2024-03-31T16:35:33.629702+0000","last_fullsized":"2024-03-31T16:35:33.629702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074478+0000","last_change":"2024-03-31T16:35:32.073796+0000","last_active":"2024-03-31T16:35:33.074478+0000","last_peered":"2024-03-31T16:35:33.074478+0000","last_clean":"2024-03-31T16:35:33.074478+0000","last_became_active":"2024-03-31T16:35:32.073514+0000","last_became_peered":"2024-03-31T16:35:32.073514+0000","last_unstale":"2024-03-31T16:35:33.074478+0000","last_undegraded":"2024-03-31T16:35:33.074478+0000","last_fullsized":"2024-03-31T16:35:33.074478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078993+0000","last_change":"2024-03-31T16:35:32.071718+0000","last_active":"2024-03-31T16:35:33.078993+0000","last_peered":"2024-03-31T16:35:33.078993+0000","last_clean":"2024-03-31T16:35:33.078993+0000","last_became_active":"2024-03-31T16:35:32.071286+0000","last_became_peered":"2024-03-31T16:35:32.071286+0000","last_unstale":"2024-03-31T16:35:33.078993+0000","last_undegraded":"2024-03-31T16:35:33.078993+0000","last_fullsized":"2024-03-31T16:35:33.078993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078539+0000","last_change":"2024-03-31T16:35:32.076047+0000","last_active":"2024-03-31T16:35:33.078539+0000","last_peered":"2024-03-31T16:35:33.078539+0000","last_clean":"2024-03-31T16:35:33.078539+0000","last_became_active":"2024-03-31T16:35:32.075802+0000","last_became_peered":"2024-03-31T16:35:32.075802+0000","last_unstale":"2024-03-31T16:35:33.078539+0000","last_undegraded":"2024-03-31T16:35:33.078539+0000","last_fullsized":"2024-03-31T16:35:33.078539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128917+0000","last_change":"2024-03-31T16:35:32.080444+0000","last_active":"2024-03-31T16:35:33.128917+0000","last_peered":"2024-03-31T16:35:33.128917+0000","last_clean":"2024-03-31T16:35:33.128917+0000","last_became_active":"2024-03-31T16:35:32.080141+0000","last_became_peered":"2024-03-31T16:35:32.080141+0000","last_unstale":"2024-03-31T16:35:33.128917+0000","last_undegraded":"2024-03-31T16:35:33.128917+0000","last_fullsized":"2024-03-31T16:35:33.128917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629965+0000","last_change":"2024-03-31T16:35:32.083381+0000","last_active":"2024-03-31T16:35:33.629965+0000","last_peered":"2024-03-31T16:35:33.629965+0000","last_clean":"2024-03-31T16:35:33.629965+0000","last_became_active":"2024-03-31T16:35:32.083134+0000","last_became_peered":"2024-03-31T16:35:32.083134+0000","last_unstale":"2024-03-31T16:35:33.629965+0000","last_undegraded":"2024-03-31T16:35:33.629965+0000","last_fullsized":"2024-03-31T16:35:33.629965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078368+0000","last_change":"2024-03-31T16:35:32.079624+0000","last_active":"2024-03-31T16:35:33.078368+0000","last_peered":"2024-03-31T16:35:33.078368+0000","last_clean":"2024-03-31T16:35:33.078368+0000","last_became_active":"2024-03-31T16:35:32.079376+0000","last_became_peered":"2024-03-31T16:35:32.079376+0000","last_unstale":"2024-03-31T16:35:33.078368+0000","last_undegraded":"2024-03-31T16:35:33.078368+0000","last_fullsized":"2024-03-31T16:35:33.078368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630066+0000","last_change":"2024-03-31T16:35:32.070619+0000","last_active":"2024-03-31T16:35:33.630066+0000","last_peered":"2024-03-31T16:35:33.630066+0000","last_clean":"2024-03-31T16:35:33.630066+0000","last_became_active":"2024-03-31T16:35:32.070240+0000","last_became_peered":"2024-03-31T16:35:32.070240+0000","last_unstale":"2024-03-31T16:35:33.630066+0000","last_undegraded":"2024-03-31T16:35:33.630066+0000","last_fullsized":"2024-03-31T16:35:33.630066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079368+0000","last_change":"2024-03-31T16:35:32.069561+0000","last_active":"2024-03-31T16:35:33.079368+0000","last_peered":"2024-03-31T16:35:33.079368+0000","last_clean":"2024-03-31T16:35:33.079368+0000","last_became_active":"2024-03-31T16:35:32.069299+0000","last_became_peered":"2024-03-31T16:35:32.069299+0000","last_unstale":"2024-03-31T16:35:33.079368+0000","last_undegraded":"2024-03-31T16:35:33.079368+0000","last_fullsized":"2024-03-31T16:35:33.079368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311327+0000","last_change":"2024-03-31T16:35:32.077589+0000","last_active":"2024-03-31T16:35:33.311327+0000","last_peered":"2024-03-31T16:35:33.311327+0000","last_clean":"2024-03-31T16:35:33.311327+0000","last_became_active":"2024-03-31T16:35:32.077321+0000","last_became_peered":"2024-03-31T16:35:32.077321+0000","last_unstale":"2024-03-31T16:35:33.311327+0000","last_undegraded":"2024-03-31T16:35:33.311327+0000","last_fullsized":"2024-03-31T16:35:33.311327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078983+0000","last_change":"2024-03-31T16:35:32.077562+0000","last_active":"2024-03-31T16:35:33.078983+0000","last_peered":"2024-03-31T16:35:33.078983+0000","last_clean":"2024-03-31T16:35:33.078983+0000","last_became_active":"2024-03-31T16:35:32.077275+0000","last_became_peered":"2024-03-31T16:35:32.077275+0000","last_unstale":"2024-03-31T16:35:33.078983+0000","last_undegraded":"2024-03-31T16:35:33.078983+0000","last_fullsized":"2024-03-31T16:35:33.078983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311700+0000","last_change":"2024-03-31T16:35:32.086200+0000","last_active":"2024-03-31T16:35:33.311700+0000","last_peered":"2024-03-31T16:35:33.311700+0000","last_clean":"2024-03-31T16:35:33.311700+0000","last_became_active":"2024-03-31T16:35:32.085924+0000","last_became_peered":"2024-03-31T16:35:32.085924+0000","last_unstale":"2024-03-31T16:35:33.311700+0000","last_undegraded":"2024-03-31T16:35:33.311700+0000","last_fullsized":"2024-03-31T16:35:33.311700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078702+0000","last_change":"2024-03-31T16:35:32.088160+0000","last_active":"2024-03-31T16:35:33.078702+0000","last_peered":"2024-03-31T16:35:33.078702+0000","last_clean":"2024-03-31T16:35:33.078702+0000","last_became_active":"2024-03-31T16:35:32.087875+0000","last_became_peered":"2024-03-31T16:35:32.087875+0000","last_unstale":"2024-03-31T16:35:33.078702+0000","last_undegraded":"2024-03-31T16:35:33.078702+0000","last_fullsized":"2024-03-31T16:35:33.078702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:32.075010+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:32.074715+0000","last_became_peered":"2024-03-31T16:35:32.074715+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311571+0000","last_change":"2024-03-31T16:35:32.077435+0000","last_active":"2024-03-31T16:35:33.311571+0000","last_peered":"2024-03-31T16:35:33.311571+0000","last_clean":"2024-03-31T16:35:33.311571+0000","last_became_active":"2024-03-31T16:35:32.077163+0000","last_became_peered":"2024-03-31T16:35:32.077163+0000","last_unstale":"2024-03-31T16:35:33.311571+0000","last_undegraded":"2024-03-31T16:35:33.311571+0000","last_fullsized":"2024-03-31T16:35:33.311571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630102+0000","last_change":"2024-03-31T16:35:32.076462+0000","last_active":"2024-03-31T16:35:33.630102+0000","last_peered":"2024-03-31T16:35:33.630102+0000","last_clean":"2024-03-31T16:35:33.630102+0000","last_became_active":"2024-03-31T16:35:32.076201+0000","last_became_peered":"2024-03-31T16:35:32.076201+0000","last_unstale":"2024-03-31T16:35:33.630102+0000","last_undegraded":"2024-03-31T16:35:33.630102+0000","last_fullsized":"2024-03-31T16:35:33.630102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079461+0000","last_change":"2024-03-31T16:35:32.074783+0000","last_active":"2024-03-31T16:35:33.079461+0000","last_peered":"2024-03-31T16:35:33.079461+0000","last_clean":"2024-03-31T16:35:33.079461+0000","last_became_active":"2024-03-31T16:35:32.074536+0000","last_became_peered":"2024-03-31T16:35:32.074536+0000","last_unstale":"2024-03-31T16:35:33.079461+0000","last_undegraded":"2024-03-31T16:35:33.079461+0000","last_fullsized":"2024-03-31T16:35:33.079461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128826+0000","last_change":"2024-03-31T16:35:32.077326+0000","last_active":"2024-03-31T16:35:33.128826+0000","last_peered":"2024-03-31T16:35:33.128826+0000","last_clean":"2024-03-31T16:35:33.128826+0000","last_became_active":"2024-03-31T16:35:32.077039+0000","last_became_peered":"2024-03-31T16:35:32.077039+0000","last_unstale":"2024-03-31T16:35:33.128826+0000","last_undegraded":"2024-03-31T16:35:33.128826+0000","last_fullsized":"2024-03-31T16:35:33.128826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077057+0000","last_change":"2024-03-31T16:35:32.085061+0000","last_active":"2024-03-31T16:35:33.077057+0000","last_peered":"2024-03-31T16:35:33.077057+0000","last_clean":"2024-03-31T16:35:33.077057+0000","last_became_active":"2024-03-31T16:35:32.084792+0000","last_became_peered":"2024-03-31T16:35:32.084792+0000","last_unstale":"2024-03-31T16:35:33.077057+0000","last_undegraded":"2024-03-31T16:35:33.077057+0000","last_fullsized":"2024-03-31T16:35:33.077057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078221+0000","last_change":"2024-03-31T16:35:32.074311+0000","last_active":"2024-03-31T16:35:33.078221+0000","last_peered":"2024-03-31T16:35:33.078221+0000","last_clean":"2024-03-31T16:35:33.078221+0000","last_became_active":"2024-03-31T16:35:32.074039+0000","last_became_peered":"2024-03-31T16:35:32.074039+0000","last_unstale":"2024-03-31T16:35:33.078221+0000","last_undegraded":"2024-03-31T16:35:33.078221+0000","last_fullsized":"2024-03-31T16:35:33.078221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:44.307915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311618+0000","last_change":"2024-03-31T16:35:31.078753+0000","last_active":"2024-03-31T16:35:33.311618+0000","last_peered":"2024-03-31T16:35:33.311618+0000","last_clean":"2024-03-31T16:35:33.311618+0000","last_became_active":"2024-03-31T16:35:31.078408+0000","last_became_peered":"2024-03-31T16:35:31.078408+0000","last_unstale":"2024-03-31T16:35:33.311618+0000","last_undegraded":"2024-03-31T16:35:33.311618+0000","last_fullsized":"2024-03-31T16:35:33.311618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630191+0000","last_change":"2024-03-31T16:35:32.070960+0000","last_active":"2024-03-31T16:35:33.630191+0000","last_peered":"2024-03-31T16:35:33.630191+0000","last_clean":"2024-03-31T16:35:33.630191+0000","last_became_active":"2024-03-31T16:35:32.070713+0000","last_became_peered":"2024-03-31T16:35:32.070713+0000","last_unstale":"2024-03-31T16:35:33.630191+0000","last_undegraded":"2024-03-31T16:35:33.630191+0000","last_fullsized":"2024-03-31T16:35:33.630191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077405+0000","last_change":"2024-03-31T16:35:31.076917+0000","last_active":"2024-03-31T16:35:33.077405+0000","last_peered":"2024-03-31T16:35:33.077405+0000","last_clean":"2024-03-31T16:35:33.077405+0000","last_became_active":"2024-03-31T16:35:31.076373+0000","last_became_peered":"2024-03-31T16:35:31.076373+0000","last_unstale":"2024-03-31T16:35:33.077405+0000","last_undegraded":"2024-03-31T16:35:33.077405+0000","last_fullsized":"2024-03-31T16:35:33.077405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311424+0000","last_change":"2024-03-31T16:35:31.072420+0000","last_active":"2024-03-31T16:35:33.311424+0000","last_peered":"2024-03-31T16:35:33.311424+0000","last_clean":"2024-03-31T16:35:33.311424+0000","last_became_active":"2024-03-31T16:35:31.071802+0000","last_became_peered":"2024-03-31T16:35:31.071802+0000","last_unstale":"2024-03-31T16:35:33.311424+0000","last_undegraded":"2024-03-31T16:35:33.311424+0000","last_fullsized":"2024-03-31T16:35:33.311424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311331+0000","last_change":"2024-03-31T16:35:32.074735+0000","last_active":"2024-03-31T16:35:33.311331+0000","last_peered":"2024-03-31T16:35:33.311331+0000","last_clean":"2024-03-31T16:35:33.311331+0000","last_became_active":"2024-03-31T16:35:32.074093+0000","last_became_peered":"2024-03-31T16:35:32.074093+0000","last_unstale":"2024-03-31T16:35:33.311331+0000","last_undegraded":"2024-03-31T16:35:33.311331+0000","last_fullsized":"2024-03-31T16:35:33.311331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079036+0000","last_change":"2024-03-31T16:35:31.073148+0000","last_active":"2024-03-31T16:35:33.079036+0000","last_peered":"2024-03-31T16:35:33.079036+0000","last_clean":"2024-03-31T16:35:33.079036+0000","last_became_active":"2024-03-31T16:35:31.072813+0000","last_became_peered":"2024-03-31T16:35:31.072813+0000","last_unstale":"2024-03-31T16:35:33.079036+0000","last_undegraded":"2024-03-31T16:35:33.079036+0000","last_fullsized":"2024-03-31T16:35:33.079036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074452+0000","last_change":"2024-03-31T16:35:32.076380+0000","last_active":"2024-03-31T16:35:33.074452+0000","last_peered":"2024-03-31T16:35:33.074452+0000","last_clean":"2024-03-31T16:35:33.074452+0000","last_became_active":"2024-03-31T16:35:32.076113+0000","last_became_peered":"2024-03-31T16:35:32.076113+0000","last_unstale":"2024-03-31T16:35:33.074452+0000","last_undegraded":"2024-03-31T16:35:33.074452+0000","last_fullsized":"2024-03-31T16:35:33.074452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078091+0000","last_change":"2024-03-31T16:35:31.075070+0000","last_active":"2024-03-31T16:35:33.078091+0000","last_peered":"2024-03-31T16:35:33.078091+0000","last_clean":"2024-03-31T16:35:33.078091+0000","last_became_active":"2024-03-31T16:35:31.074753+0000","last_became_peered":"2024-03-31T16:35:31.074753+0000","last_unstale":"2024-03-31T16:35:33.078091+0000","last_undegraded":"2024-03-31T16:35:33.078091+0000","last_fullsized":"2024-03-31T16:35:33.078091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078764+0000","last_change":"2024-03-31T16:35:32.067130+0000","last_active":"2024-03-31T16:35:33.078764+0000","last_peered":"2024-03-31T16:35:33.078764+0000","last_clean":"2024-03-31T16:35:33.078764+0000","last_became_active":"2024-03-31T16:35:32.066719+0000","last_became_peered":"2024-03-31T16:35:32.066719+0000","last_unstale":"2024-03-31T16:35:33.078764+0000","last_undegraded":"2024-03-31T16:35:33.078764+0000","last_fullsized":"2024-03-31T16:35:33.078764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078833+0000","last_change":"2024-03-31T16:35:31.074858+0000","last_active":"2024-03-31T16:35:33.078833+0000","last_peered":"2024-03-31T16:35:33.078833+0000","last_clean":"2024-03-31T16:35:33.078833+0000","last_became_active":"2024-03-31T16:35:31.074274+0000","last_became_peered":"2024-03-31T16:35:31.074274+0000","last_unstale":"2024-03-31T16:35:33.078833+0000","last_undegraded":"2024-03-31T16:35:33.078833+0000","last_fullsized":"2024-03-31T16:35:33.078833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629883+0000","last_change":"2024-03-31T16:35:32.069889+0000","last_active":"2024-03-31T16:35:33.629883+0000","last_peered":"2024-03-31T16:35:33.629883+0000","last_clean":"2024-03-31T16:35:33.629883+0000","last_became_active":"2024-03-31T16:35:32.069595+0000","last_became_peered":"2024-03-31T16:35:32.069595+0000","last_unstale":"2024-03-31T16:35:33.629883+0000","last_undegraded":"2024-03-31T16:35:33.629883+0000","last_fullsized":"2024-03-31T16:35:33.629883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:31.075199+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:31.074912+0000","last_became_peered":"2024-03-31T16:35:31.074912+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078396+0000","last_change":"2024-03-31T16:35:32.075288+0000","last_active":"2024-03-31T16:35:33.078396+0000","last_peered":"2024-03-31T16:35:33.078396+0000","last_clean":"2024-03-31T16:35:33.078396+0000","last_became_active":"2024-03-31T16:35:32.074982+0000","last_became_peered":"2024-03-31T16:35:32.074982+0000","last_unstale":"2024-03-31T16:35:33.078396+0000","last_undegraded":"2024-03-31T16:35:33.078396+0000","last_fullsized":"2024-03-31T16:35:33.078396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078276+0000","last_change":"2024-03-31T16:35:31.071044+0000","last_active":"2024-03-31T16:35:33.078276+0000","last_peered":"2024-03-31T16:35:33.078276+0000","last_clean":"2024-03-31T16:35:33.078276+0000","last_became_active":"2024-03-31T16:35:31.070775+0000","last_became_peered":"2024-03-31T16:35:31.070775+0000","last_unstale":"2024-03-31T16:35:33.078276+0000","last_undegraded":"2024-03-31T16:35:33.078276+0000","last_fullsized":"2024-03-31T16:35:33.078276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629719+0000","last_change":"2024-03-31T16:35:32.082874+0000","last_active":"2024-03-31T16:35:33.629719+0000","last_peered":"2024-03-31T16:35:33.629719+0000","last_clean":"2024-03-31T16:35:33.629719+0000","last_became_active":"2024-03-31T16:35:32.082582+0000","last_became_peered":"2024-03-31T16:35:32.082582+0000","last_unstale":"2024-03-31T16:35:33.629719+0000","last_undegraded":"2024-03-31T16:35:33.629719+0000","last_fullsized":"2024-03-31T16:35:33.629719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630199+0000","last_change":"2024-03-31T16:35:31.072679+0000","last_active":"2024-03-31T16:35:33.630199+0000","last_peered":"2024-03-31T16:35:33.630199+0000","last_clean":"2024-03-31T16:35:33.630199+0000","last_became_active":"2024-03-31T16:35:31.072349+0000","last_became_peered":"2024-03-31T16:35:31.072349+0000","last_unstale":"2024-03-31T16:35:33.630199+0000","last_undegraded":"2024-03-31T16:35:33.630199+0000","last_fullsized":"2024-03-31T16:35:33.630199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629731+0000","last_change":"2024-03-31T16:35:32.072536+0000","last_active":"2024-03-31T16:35:33.629731+0000","last_peered":"2024-03-31T16:35:33.629731+0000","last_clean":"2024-03-31T16:35:33.629731+0000","last_became_active":"2024-03-31T16:35:32.072299+0000","last_became_peered":"2024-03-31T16:35:32.072299+0000","last_unstale":"2024-03-31T16:35:33.629731+0000","last_undegraded":"2024-03-31T16:35:33.629731+0000","last_fullsized":"2024-03-31T16:35:33.629731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079455+0000","last_change":"2024-03-31T16:35:31.071681+0000","last_active":"2024-03-31T16:35:33.079455+0000","last_peered":"2024-03-31T16:35:33.079455+0000","last_clean":"2024-03-31T16:35:33.079455+0000","last_became_active":"2024-03-31T16:35:31.071425+0000","last_became_peered":"2024-03-31T16:35:31.071425+0000","last_unstale":"2024-03-31T16:35:33.079455+0000","last_undegraded":"2024-03-31T16:35:33.079455+0000","last_fullsized":"2024-03-31T16:35:33.079455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629860+0000","last_change":"2024-03-31T16:35:32.081639+0000","last_active":"2024-03-31T16:35:33.629860+0000","last_peered":"2024-03-31T16:35:33.629860+0000","last_clean":"2024-03-31T16:35:33.629860+0000","last_became_active":"2024-03-31T16:35:32.081101+0000","last_became_peered":"2024-03-31T16:35:32.081101+0000","last_unstale":"2024-03-31T16:35:33.629860+0000","last_undegraded":"2024-03-31T16:35:33.629860+0000","last_fullsized":"2024-03-31T16:35:33.629860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077272+0000","last_change":"2024-03-31T16:35:31.076342+0000","last_active":"2024-03-31T16:35:33.077272+0000","last_peered":"2024-03-31T16:35:33.077272+0000","last_clean":"2024-03-31T16:35:33.077272+0000","last_became_active":"2024-03-31T16:35:31.075546+0000","last_became_peered":"2024-03-31T16:35:31.075546+0000","last_unstale":"2024-03-31T16:35:33.077272+0000","last_undegraded":"2024-03-31T16:35:33.077272+0000","last_fullsized":"2024-03-31T16:35:33.077272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077346+0000","last_change":"2024-03-31T16:35:32.077698+0000","last_active":"2024-03-31T16:35:33.077346+0000","last_peered":"2024-03-31T16:35:33.077346+0000","last_clean":"2024-03-31T16:35:33.077346+0000","last_became_active":"2024-03-31T16:35:32.077415+0000","last_became_peered":"2024-03-31T16:35:32.077415+0000","last_unstale":"2024-03-31T16:35:33.077346+0000","last_undegraded":"2024-03-31T16:35:33.077346+0000","last_fullsized":"2024-03-31T16:35:33.077346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128862+0000","last_change":"2024-03-31T16:35:31.066612+0000","last_active":"2024-03-31T16:35:33.128862+0000","last_peered":"2024-03-31T16:35:33.128862+0000","last_clean":"2024-03-31T16:35:33.128862+0000","last_became_active":"2024-03-31T16:35:31.066089+0000","last_became_peered":"2024-03-31T16:35:31.066089+0000","last_unstale":"2024-03-31T16:35:33.128862+0000","last_undegraded":"2024-03-31T16:35:33.128862+0000","last_fullsized":"2024-03-31T16:35:33.128862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629500+0000","last_change":"2024-03-31T16:35:32.078195+0000","last_active":"2024-03-31T16:35:33.629500+0000","last_peered":"2024-03-31T16:35:33.629500+0000","last_clean":"2024-03-31T16:35:33.629500+0000","last_became_active":"2024-03-31T16:35:32.077878+0000","last_became_peered":"2024-03-31T16:35:32.077878+0000","last_unstale":"2024-03-31T16:35:33.629500+0000","last_undegraded":"2024-03-31T16:35:33.629500+0000","last_fullsized":"2024-03-31T16:35:33.629500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078606+0000","last_change":"2024-03-31T16:35:31.073893+0000","last_active":"2024-03-31T16:35:33.078606+0000","last_peered":"2024-03-31T16:35:33.078606+0000","last_clean":"2024-03-31T16:35:33.078606+0000","last_became_active":"2024-03-31T16:35:31.073625+0000","last_became_peered":"2024-03-31T16:35:31.073625+0000","last_unstale":"2024-03-31T16:35:33.078606+0000","last_undegraded":"2024-03-31T16:35:33.078606+0000","last_fullsized":"2024-03-31T16:35:33.078606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:09:31.419651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629895+0000","last_change":"2024-03-31T16:35:32.082027+0000","last_active":"2024-03-31T16:35:33.629895+0000","last_peered":"2024-03-31T16:35:33.629895+0000","last_clean":"2024-03-31T16:35:33.629895+0000","last_became_active":"2024-03-31T16:35:32.080888+0000","last_became_peered":"2024-03-31T16:35:32.080888+0000","last_unstale":"2024-03-31T16:35:33.629895+0000","last_undegraded":"2024-03-31T16:35:33.629895+0000","last_fullsized":"2024-03-31T16:35:33.629895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128888+0000","last_change":"2024-03-31T16:35:31.071984+0000","last_active":"2024-03-31T16:35:33.128888+0000","last_peered":"2024-03-31T16:35:33.128888+0000","last_clean":"2024-03-31T16:35:33.128888+0000","last_became_active":"2024-03-31T16:35:31.071703+0000","last_became_peered":"2024-03-31T16:35:31.071703+0000","last_unstale":"2024-03-31T16:35:33.128888+0000","last_undegraded":"2024-03-31T16:35:33.128888+0000","last_fullsized":"2024-03-31T16:35:33.128888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630062+0000","last_change":"2024-03-31T16:35:32.081372+0000","last_active":"2024-03-31T16:35:33.630062+0000","last_peered":"2024-03-31T16:35:33.630062+0000","last_clean":"2024-03-31T16:35:33.630062+0000","last_became_active":"2024-03-31T16:35:32.081052+0000","last_became_peered":"2024-03-31T16:35:32.081052+0000","last_unstale":"2024-03-31T16:35:33.630062+0000","last_undegraded":"2024-03-31T16:35:33.630062+0000","last_fullsized":"2024-03-31T16:35:33.630062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:11:37.125510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074783+0000","last_change":"2024-03-31T16:35:31.071727+0000","last_active":"2024-03-31T16:35:33.074783+0000","last_peered":"2024-03-31T16:35:33.074783+0000","last_clean":"2024-03-31T16:35:33.074783+0000","last_became_active":"2024-03-31T16:35:31.071417+0000","last_became_peered":"2024-03-31T16:35:31.071417+0000","last_unstale":"2024-03-31T16:35:33.074783+0000","last_undegraded":"2024-03-31T16:35:33.074783+0000","last_fullsized":"2024-03-31T16:35:33.074783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079593+0000","last_change":"2024-03-31T16:35:32.075436+0000","last_active":"2024-03-31T16:35:33.079593+0000","last_peered":"2024-03-31T16:35:33.079593+0000","last_clean":"2024-03-31T16:35:33.079593+0000","last_became_active":"2024-03-31T16:35:32.075165+0000","last_became_peered":"2024-03-31T16:35:32.075165+0000","last_unstale":"2024-03-31T16:35:33.079593+0000","last_undegraded":"2024-03-31T16:35:33.079593+0000","last_fullsized":"2024-03-31T16:35:33.079593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128801+0000","last_change":"2024-03-31T16:35:31.075714+0000","last_active":"2024-03-31T16:35:33.128801+0000","last_peered":"2024-03-31T16:35:33.128801+0000","last_clean":"2024-03-31T16:35:33.128801+0000","last_became_active":"2024-03-31T16:35:31.075208+0000","last_became_peered":"2024-03-31T16:35:31.075208+0000","last_unstale":"2024-03-31T16:35:33.128801+0000","last_undegraded":"2024-03-31T16:35:33.128801+0000","last_fullsized":"2024-03-31T16:35:33.128801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629869+0000","last_change":"2024-03-31T16:35:32.083722+0000","last_active":"2024-03-31T16:35:33.629869+0000","last_peered":"2024-03-31T16:35:33.629869+0000","last_clean":"2024-03-31T16:35:33.629869+0000","last_became_active":"2024-03-31T16:35:32.082940+0000","last_became_peered":"2024-03-31T16:35:32.082940+0000","last_unstale":"2024-03-31T16:35:33.629869+0000","last_undegraded":"2024-03-31T16:35:33.629869+0000","last_fullsized":"2024-03-31T16:35:33.629869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629462+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:35:33.629462+0000","last_peered":"2024-03-31T16:35:33.629462+0000","last_clean":"2024-03-31T16:35:33.629462+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:35:33.629462+0000","last_undegraded":"2024-03-31T16:35:33.629462+0000","last_fullsized":"2024-03-31T16:35:33.629462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077654+0000","last_change":"2024-03-31T16:35:31.067899+0000","last_active":"2024-03-31T16:35:33.077654+0000","last_peered":"2024-03-31T16:35:33.077654+0000","last_clean":"2024-03-31T16:35:33.077654+0000","last_became_active":"2024-03-31T16:35:31.067599+0000","last_became_peered":"2024-03-31T16:35:31.067599+0000","last_unstale":"2024-03-31T16:35:33.077654+0000","last_undegraded":"2024-03-31T16:35:33.077654+0000","last_fullsized":"2024-03-31T16:35:33.077654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311433+0000","last_change":"2024-03-31T16:35:32.075582+0000","last_active":"2024-03-31T16:35:33.311433+0000","last_peered":"2024-03-31T16:35:33.311433+0000","last_clean":"2024-03-31T16:35:33.311433+0000","last_became_active":"2024-03-31T16:35:32.075305+0000","last_became_peered":"2024-03-31T16:35:32.075305+0000","last_unstale":"2024-03-31T16:35:33.311433+0000","last_undegraded":"2024-03-31T16:35:33.311433+0000","last_fullsized":"2024-03-31T16:35:33.311433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629405+0000","last_change":"2024-03-31T16:35:31.077578+0000","last_active":"2024-03-31T16:35:33.629405+0000","last_peered":"2024-03-31T16:35:33.629405+0000","last_clean":"2024-03-31T16:35:33.629405+0000","last_became_active":"2024-03-31T16:35:31.076918+0000","last_became_peered":"2024-03-31T16:35:31.076918+0000","last_unstale":"2024-03-31T16:35:33.629405+0000","last_undegraded":"2024-03-31T16:35:33.629405+0000","last_fullsized":"2024-03-31T16:35:33.629405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629665+0000","last_change":"2024-03-31T16:35:32.071942+0000","last_active":"2024-03-31T16:35:33.629665+0000","last_peered":"2024-03-31T16:35:33.629665+0000","last_clean":"2024-03-31T16:35:33.629665+0000","last_became_active":"2024-03-31T16:35:32.071670+0000","last_became_peered":"2024-03-31T16:35:32.071670+0000","last_unstale":"2024-03-31T16:35:33.629665+0000","last_undegraded":"2024-03-31T16:35:33.629665+0000","last_fullsized":"2024-03-31T16:35:33.629665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:25:21.037477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128907+0000","last_change":"2024-03-31T16:35:31.070684+0000","last_active":"2024-03-31T16:35:33.128907+0000","last_peered":"2024-03-31T16:35:33.128907+0000","last_clean":"2024-03-31T16:35:33.128907+0000","last_became_active":"2024-03-31T16:35:31.070356+0000","last_became_peered":"2024-03-31T16:35:31.070356+0000","last_unstale":"2024-03-31T16:35:33.128907+0000","last_undegraded":"2024-03-31T16:35:33.128907+0000","last_fullsized":"2024-03-31T16:35:33.128907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074515+0000","last_change":"2024-03-31T16:35:32.069540+0000","last_active":"2024-03-31T16:35:33.074515+0000","last_peered":"2024-03-31T16:35:33.074515+0000","last_clean":"2024-03-31T16:35:33.074515+0000","last_became_active":"2024-03-31T16:35:32.069256+0000","last_became_peered":"2024-03-31T16:35:32.069256+0000","last_unstale":"2024-03-31T16:35:33.074515+0000","last_undegraded":"2024-03-31T16:35:33.074515+0000","last_fullsized":"2024-03-31T16:35:33.074515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079522+0000","last_change":"2024-03-31T16:35:31.069729+0000","last_active":"2024-03-31T16:35:33.079522+0000","last_peered":"2024-03-31T16:35:33.079522+0000","last_clean":"2024-03-31T16:35:33.079522+0000","last_became_active":"2024-03-31T16:35:31.069435+0000","last_became_peered":"2024-03-31T16:35:31.069435+0000","last_unstale":"2024-03-31T16:35:33.079522+0000","last_undegraded":"2024-03-31T16:35:33.079522+0000","last_fullsized":"2024-03-31T16:35:33.079522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078662+0000","last_change":"2024-03-31T16:35:32.072296+0000","last_active":"2024-03-31T16:35:33.078662+0000","last_peered":"2024-03-31T16:35:33.078662+0000","last_clean":"2024-03-31T16:35:33.078662+0000","last_became_active":"2024-03-31T16:35:32.071947+0000","last_became_peered":"2024-03-31T16:35:32.071947+0000","last_unstale":"2024-03-31T16:35:33.078662+0000","last_undegraded":"2024-03-31T16:35:33.078662+0000","last_fullsized":"2024-03-31T16:35:33.078662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074675+0000","last_change":"2024-03-31T16:35:31.070142+0000","last_active":"2024-03-31T16:35:33.074675+0000","last_peered":"2024-03-31T16:35:33.074675+0000","last_clean":"2024-03-31T16:35:33.074675+0000","last_became_active":"2024-03-31T16:35:31.069855+0000","last_became_peered":"2024-03-31T16:35:31.069855+0000","last_unstale":"2024-03-31T16:35:33.074675+0000","last_undegraded":"2024-03-31T16:35:33.074675+0000","last_fullsized":"2024-03-31T16:35:33.074675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079469+0000","last_change":"2024-03-31T16:35:32.076452+0000","last_active":"2024-03-31T16:35:33.079469+0000","last_peered":"2024-03-31T16:35:33.079469+0000","last_clean":"2024-03-31T16:35:33.079469+0000","last_became_active":"2024-03-31T16:35:32.076176+0000","last_became_peered":"2024-03-31T16:35:32.076176+0000","last_unstale":"2024-03-31T16:35:33.079469+0000","last_undegraded":"2024-03-31T16:35:33.079469+0000","last_fullsized":"2024-03-31T16:35:33.079469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629942+0000","last_change":"2024-03-31T16:35:31.077517+0000","last_active":"2024-03-31T16:35:33.629942+0000","last_peered":"2024-03-31T16:35:33.629942+0000","last_clean":"2024-03-31T16:35:33.629942+0000","last_became_active":"2024-03-31T16:35:31.077239+0000","last_became_peered":"2024-03-31T16:35:31.077239+0000","last_unstale":"2024-03-31T16:35:33.629942+0000","last_undegraded":"2024-03-31T16:35:33.629942+0000","last_fullsized":"2024-03-31T16:35:33.629942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074667+0000","last_change":"2024-03-31T16:35:32.070836+0000","last_active":"2024-03-31T16:35:33.074667+0000","last_peered":"2024-03-31T16:35:33.074667+0000","last_clean":"2024-03-31T16:35:33.074667+0000","last_became_active":"2024-03-31T16:35:32.070521+0000","last_became_peered":"2024-03-31T16:35:32.070521+0000","last_unstale":"2024-03-31T16:35:33.074667+0000","last_undegraded":"2024-03-31T16:35:33.074667+0000","last_fullsized":"2024-03-31T16:35:33.074667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077062+0000","last_change":"2024-03-31T16:35:31.074489+0000","last_active":"2024-03-31T16:35:33.077062+0000","last_peered":"2024-03-31T16:35:33.077062+0000","last_clean":"2024-03-31T16:35:33.077062+0000","last_became_active":"2024-03-31T16:35:31.074195+0000","last_became_peered":"2024-03-31T16:35:31.074195+0000","last_unstale":"2024-03-31T16:35:33.077062+0000","last_undegraded":"2024-03-31T16:35:33.077062+0000","last_fullsized":"2024-03-31T16:35:33.077062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311754+0000","last_change":"2024-03-31T16:35:32.083120+0000","last_active":"2024-03-31T16:35:33.311754+0000","last_peered":"2024-03-31T16:35:33.311754+0000","last_clean":"2024-03-31T16:35:33.311754+0000","last_became_active":"2024-03-31T16:35:32.082841+0000","last_became_peered":"2024-03-31T16:35:32.082841+0000","last_unstale":"2024-03-31T16:35:33.311754+0000","last_undegraded":"2024-03-31T16:35:33.311754+0000","last_fullsized":"2024-03-31T16:35:33.311754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078173+0000","last_change":"2024-03-31T16:35:31.076558+0000","last_active":"2024-03-31T16:35:33.078173+0000","last_peered":"2024-03-31T16:35:33.078173+0000","last_clean":"2024-03-31T16:35:33.078173+0000","last_became_active":"2024-03-31T16:35:31.075298+0000","last_became_peered":"2024-03-31T16:35:31.075298+0000","last_unstale":"2024-03-31T16:35:33.078173+0000","last_undegraded":"2024-03-31T16:35:33.078173+0000","last_fullsized":"2024-03-31T16:35:33.078173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629833+0000","last_change":"2024-03-31T16:35:32.069455+0000","last_active":"2024-03-31T16:35:33.629833+0000","last_peered":"2024-03-31T16:35:33.629833+0000","last_clean":"2024-03-31T16:35:33.629833+0000","last_became_active":"2024-03-31T16:35:32.069153+0000","last_became_peered":"2024-03-31T16:35:32.069153+0000","last_unstale":"2024-03-31T16:35:33.629833+0000","last_undegraded":"2024-03-31T16:35:33.629833+0000","last_fullsized":"2024-03-31T16:35:33.629833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629400+0000","last_change":"2024-03-31T16:35:31.078800+0000","last_active":"2024-03-31T16:35:33.629400+0000","last_peered":"2024-03-31T16:35:33.629400+0000","last_clean":"2024-03-31T16:35:33.629400+0000","last_became_active":"2024-03-31T16:35:31.078459+0000","last_became_peered":"2024-03-31T16:35:31.078459+0000","last_unstale":"2024-03-31T16:35:33.629400+0000","last_undegraded":"2024-03-31T16:35:33.629400+0000","last_fullsized":"2024-03-31T16:35:33.629400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078033+0000","last_change":"2024-03-31T16:35:32.069622+0000","last_active":"2024-03-31T16:35:33.078033+0000","last_peered":"2024-03-31T16:35:33.078033+0000","last_clean":"2024-03-31T16:35:33.078033+0000","last_became_active":"2024-03-31T16:35:32.069306+0000","last_became_peered":"2024-03-31T16:35:32.069306+0000","last_unstale":"2024-03-31T16:35:33.078033+0000","last_undegraded":"2024-03-31T16:35:33.078033+0000","last_fullsized":"2024-03-31T16:35:33.078033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:09.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074545+0000","last_change":"2024-03-31T16:35:31.075114+0000","last_active":"2024-03-31T16:35:33.074545+0000","last_peered":"2024-03-31T16:35:33.074545+0000","last_clean":"2024-03-31T16:35:33.074545+0000","last_became_active":"2024-03-31T16:35:31.074806+0000","last_became_peered":"2024-03-31T16:35:31.074806+0000","last_unstale":"2024-03-31T16:35:33.074545+0000","last_undegraded":"2024-03-31T16:35:33.074545+0000","last_fullsized":"2024-03-31T16:35:33.074545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311430+0000","last_change":"2024-03-31T16:35:32.074953+0000","last_active":"2024-03-31T16:35:33.311430+0000","last_peered":"2024-03-31T16:35:33.311430+0000","last_clean":"2024-03-31T16:35:33.311430+0000","last_became_active":"2024-03-31T16:35:32.074427+0000","last_became_peered":"2024-03-31T16:35:32.074427+0000","last_unstale":"2024-03-31T16:35:33.311430+0000","last_undegraded":"2024-03-31T16:35:33.311430+0000","last_fullsized":"2024-03-31T16:35:33.311430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074527+0000","last_change":"2024-03-31T16:35:31.075011+0000","last_active":"2024-03-31T16:35:33.074527+0000","last_peered":"2024-03-31T16:35:33.074527+0000","last_clean":"2024-03-31T16:35:33.074527+0000","last_became_active":"2024-03-31T16:35:31.074731+0000","last_became_peered":"2024-03-31T16:35:31.074731+0000","last_unstale":"2024-03-31T16:35:33.074527+0000","last_undegraded":"2024-03-31T16:35:33.074527+0000","last_fullsized":"2024-03-31T16:35:33.074527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311546+0000","last_change":"2024-03-31T16:35:32.075723+0000","last_active":"2024-03-31T16:35:33.311546+0000","last_peered":"2024-03-31T16:35:33.311546+0000","last_clean":"2024-03-31T16:35:33.311546+0000","last_became_active":"2024-03-31T16:35:32.075324+0000","last_became_peered":"2024-03-31T16:35:32.075324+0000","last_unstale":"2024-03-31T16:35:33.311546+0000","last_undegraded":"2024-03-31T16:35:33.311546+0000","last_fullsized":"2024-03-31T16:35:33.311546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629868+0000","last_change":"2024-03-31T16:35:31.077732+0000","last_active":"2024-03-31T16:35:33.629868+0000","last_peered":"2024-03-31T16:35:33.629868+0000","last_clean":"2024-03-31T16:35:33.629868+0000","last_became_active":"2024-03-31T16:35:31.076950+0000","last_became_peered":"2024-03-31T16:35:31.076950+0000","last_unstale":"2024-03-31T16:35:33.629868+0000","last_undegraded":"2024-03-31T16:35:33.629868+0000","last_fullsized":"2024-03-31T16:35:33.629868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077294+0000","last_change":"2024-03-31T16:35:32.078813+0000","last_active":"2024-03-31T16:35:33.077294+0000","last_peered":"2024-03-31T16:35:33.077294+0000","last_clean":"2024-03-31T16:35:33.077294+0000","last_became_active":"2024-03-31T16:35:32.078564+0000","last_became_peered":"2024-03-31T16:35:32.078564+0000","last_unstale":"2024-03-31T16:35:33.077294+0000","last_undegraded":"2024-03-31T16:35:33.077294+0000","last_fullsized":"2024-03-31T16:35:33.077294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079367+0000","last_change":"2024-03-31T16:35:32.070433+0000","last_active":"2024-03-31T16:35:33.079367+0000","last_peered":"2024-03-31T16:35:33.079367+0000","last_clean":"2024-03-31T16:35:33.079367+0000","last_became_active":"2024-03-31T16:35:32.070040+0000","last_became_peered":"2024-03-31T16:35:32.070040+0000","last_unstale":"2024-03-31T16:35:33.079367+0000","last_undegraded":"2024-03-31T16:35:33.079367+0000","last_fullsized":"2024-03-31T16:35:33.079367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629671+0000","last_change":"2024-03-31T16:35:31.077383+0000","last_active":"2024-03-31T16:35:33.629671+0000","last_peered":"2024-03-31T16:35:33.629671+0000","last_clean":"2024-03-31T16:35:33.629671+0000","last_became_active":"2024-03-31T16:35:31.076971+0000","last_became_peered":"2024-03-31T16:35:31.076971+0000","last_unstale":"2024-03-31T16:35:33.629671+0000","last_undegraded":"2024-03-31T16:35:33.629671+0000","last_fullsized":"2024-03-31T16:35:33.629671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079595+0000","last_change":"2024-03-31T16:35:32.070447+0000","last_active":"2024-03-31T16:35:33.079595+0000","last_peered":"2024-03-31T16:35:33.079595+0000","last_clean":"2024-03-31T16:35:33.079595+0000","last_became_active":"2024-03-31T16:35:32.070062+0000","last_became_peered":"2024-03-31T16:35:32.070062+0000","last_unstale":"2024-03-31T16:35:33.079595+0000","last_undegraded":"2024-03-31T16:35:33.079595+0000","last_fullsized":"2024-03-31T16:35:33.079595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629811+0000","last_change":"2024-03-31T16:35:31.078244+0000","last_active":"2024-03-31T16:35:33.629811+0000","last_peered":"2024-03-31T16:35:33.629811+0000","last_clean":"2024-03-31T16:35:33.629811+0000","last_became_active":"2024-03-31T16:35:31.077952+0000","last_became_peered":"2024-03-31T16:35:31.077952+0000","last_unstale":"2024-03-31T16:35:33.629811+0000","last_undegraded":"2024-03-31T16:35:33.629811+0000","last_fullsized":"2024-03-31T16:35:33.629811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629875+0000","last_change":"2024-03-31T16:35:32.072440+0000","last_active":"2024-03-31T16:35:33.629875+0000","last_peered":"2024-03-31T16:35:33.629875+0000","last_clean":"2024-03-31T16:35:33.629875+0000","last_became_active":"2024-03-31T16:35:32.072156+0000","last_became_peered":"2024-03-31T16:35:32.072156+0000","last_unstale":"2024-03-31T16:35:33.629875+0000","last_undegraded":"2024-03-31T16:35:33.629875+0000","last_fullsized":"2024-03-31T16:35:33.629875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311695+0000","last_change":"2024-03-31T16:35:31.073210+0000","last_active":"2024-03-31T16:35:33.311695+0000","last_peered":"2024-03-31T16:35:33.311695+0000","last_clean":"2024-03-31T16:35:33.311695+0000","last_became_active":"2024-03-31T16:35:31.072922+0000","last_became_peered":"2024-03-31T16:35:31.072922+0000","last_unstale":"2024-03-31T16:35:33.311695+0000","last_undegraded":"2024-03-31T16:35:33.311695+0000","last_fullsized":"2024-03-31T16:35:33.311695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311639+0000","last_change":"2024-03-31T16:35:32.080402+0000","last_active":"2024-03-31T16:35:33.311639+0000","last_peered":"2024-03-31T16:35:33.311639+0000","last_clean":"2024-03-31T16:35:33.311639+0000","last_became_active":"2024-03-31T16:35:32.080137+0000","last_became_peered":"2024-03-31T16:35:32.080137+0000","last_unstale":"2024-03-31T16:35:33.311639+0000","last_undegraded":"2024-03-31T16:35:33.311639+0000","last_fullsized":"2024-03-31T16:35:33.311639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630039+0000","last_change":"2024-03-31T16:35:31.076017+0000","last_active":"2024-03-31T16:35:33.630039+0000","last_peered":"2024-03-31T16:35:33.630039+0000","last_clean":"2024-03-31T16:35:33.630039+0000","last_became_active":"2024-03-31T16:35:31.075647+0000","last_became_peered":"2024-03-31T16:35:31.075647+0000","last_unstale":"2024-03-31T16:35:33.630039+0000","last_undegraded":"2024-03-31T16:35:33.630039+0000","last_fullsized":"2024-03-31T16:35:33.630039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:35:40.204 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-31T16:35:40.204 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-31T16:35:40.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-31T16:35:40.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-31T16:35:40.205 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-31T16:35:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.335+0000 7f7d66b2b640 1 Processor -- start 2024-03-31T16:35:40.340 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.336+0000 7f7d66b2b640 1 -- start start 2024-03-31T16:35:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.336+0000 7f7d66b2b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7d600d06c0 0x7f7d60169260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.341 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.336+0000 7f7d66b2b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6006dfa0 con 0x7f7d6015e860 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.336+0000 7f7d66b2b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6006e240 con 0x7f7d600d43d0 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.336+0000 7f7d66b2b640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7d600cf220 con 0x7f7d600d06c0 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.336+0000 7f7d648c7640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f7d6015e860 0x7f7d6006d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53172/0 (socket says 172.21.15.120:53172) 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.336+0000 7f7d648c7640 1 -- 172.21.15.120:0/480098638 learned_addr learned my addr 172.21.15.120:0/480098638 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d650c8640 1 --2- 172.21.15.120:0/480098638 >> v2:172.21.15.203:3300/0 conn(0x7f7d600d06c0 0x7f7d60169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d5f7fe640 1 -- 172.21.15.120:0/480098638 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997023266 0 0) 0x7f7d6006dfa0 con 0x7f7d6015e860 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d5f7fe640 1 -- 172.21.15.120:0/480098638 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d48003520 con 0x7f7d6015e860 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d5f7fe640 1 -- 172.21.15.120:0/480098638 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789331741 0 0) 0x7f7d6006e240 con 0x7f7d600d43d0 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d5f7fe640 1 -- 172.21.15.120:0/480098638 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d6006dfa0 con 0x7f7d600d43d0 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d5f7fe640 1 -- 172.21.15.120:0/480098638 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 760287427 0 0) 0x7f7d48003520 con 0x7f7d6015e860 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d650c8640 1 -- 172.21.15.120:0/480098638 >> v1:172.21.15.203:6789/0 conn(0x7f7d600d43d0 legacy=0x7f7d600d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.342 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d650c8640 1 -- 172.21.15.120:0/480098638 >> v1:172.21.15.120:6789/0 conn(0x7f7d6015e860 legacy=0x7f7d6006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.337+0000 7f7d650c8640 1 -- 172.21.15.120:0/480098638 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6006e520 con 0x7f7d600d06c0 2024-03-31T16:35:40.343 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d650c8640 1 --2- 172.21.15.120:0/480098638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d600d06c0 0x7f7d60169260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009d90 tx=0x7f7d5802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e25dc9e9704226 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d5f7fe640 1 -- 172.21.15.120:0/480098638 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58039070 con 0x7f7d600d06c0 2024-03-31T16:35:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d5f7fe640 1 -- 172.21.15.120:0/480098638 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5802c940 con 0x7f7d600d06c0 2024-03-31T16:35:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d5f7fe640 1 -- 172.21.15.120:0/480098638 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50001690 con 0x7f7d600d06c0 2024-03-31T16:35:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d66b2b640 1 -- 172.21.15.120:0/480098638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d600d06c0 msgr2=0x7f7d60169260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d66b2b640 1 --2- 172.21.15.120:0/480098638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d600d06c0 0x7f7d60169260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009d90 tx=0x7f7d5802be10 comp rx=0 tx=0).stop 2024-03-31T16:35:40.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d66b2b640 1 -- 172.21.15.120:0/480098638 shutdown_connections 2024-03-31T16:35:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d66b2b640 1 --2- 172.21.15.120:0/480098638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d600d06c0 0x7f7d60169260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.338+0000 7f7d66b2b640 1 -- 172.21.15.120:0/480098638 >> 172.21.15.120:0/480098638 conn(0x7f7d6009d7d0 msgr2=0x7f7d6008bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.339+0000 7f7d66b2b640 1 -- 172.21.15.120:0/480098638 shutdown_connections 2024-03-31T16:35:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.339+0000 7f7d66b2b640 1 -- 172.21.15.120:0/480098638 wait complete. 2024-03-31T16:35:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.340+0000 7f7d66b2b640 1 Processor -- start 2024-03-31T16:35:40.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.340+0000 7f7d66b2b640 1 -- start start 2024-03-31T16:35:40.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d66b2b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d06c0 0x7f7d600c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d66b2b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d600d43d0 0x7f7d600cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d66b2b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d6015e860 0x7f7d601edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d66b2b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6006dd80 con 0x7f7d600d06c0 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d66b2b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6006dc00 con 0x7f7d6015e860 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d66b2b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d600cedb0 con 0x7f7d600d43d0 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d06c0 0x7f7d600c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d06c0 0x7f7d600c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52230/0 (socket says 172.21.15.120:52230) 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 -- 172.21.15.120:0/3259353387 learned_addr learned my addr 172.21.15.120:0/3259353387 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d650c8640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d6015e860 0x7f7d601edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d5ffff640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d600d43d0 0x7f7d600cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 -- 172.21.15.120:0/3259353387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d600d43d0 msgr2=0x7f7d600cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d600d43d0 0x7f7d600cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 -- 172.21.15.120:0/3259353387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d6015e860 msgr2=0x7f7d601edc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d6015e860 0x7f7d601edc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 -- 172.21.15.120:0/3259353387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d600c8830 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d648c7640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d06c0 0x7f7d600c7f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c700 tx=0x7f7d5000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d5d7fa640 1 -- 172.21.15.120:0/3259353387 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50018070 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d5d7fa640 1 -- 172.21.15.120:0/3259353387 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d500072d0 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d600c8b10 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d5d7fa640 1 -- 172.21.15.120:0/3259353387 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d500047e0 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.341+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d600c90d0 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.342+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d600685c0 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.343+0000 7f7d5d7fa640 1 -- 172.21.15.120:0/3259353387 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d5001b070 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.343+0000 7f7d5d7fa640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7d4c06c8f0 0x7f7d4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.343+0000 7f7d5ffff640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7d4c06c8f0 0x7f7d4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.343+0000 7f7d5d7fa640 1 -- 172.21.15.120:0/3259353387 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7d5008afc0 con 0x7f7d600d06c0 2024-03-31T16:35:40.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.344+0000 7f7d5ffff640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7d4c06c8f0 0x7f7d4c06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d600c9cc0 tx=0x7f7d54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.348+0000 7f7d5d7fa640 1 -- 172.21.15.120:0/3259353387 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7d50058da0 con 0x7f7d600d06c0 2024-03-31T16:35:40.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.571+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7d600b4470 con 0x7f7d600d06c0 2024-03-31T16:35:40.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.573+0000 7f7d5d7fa640 1 -- 172.21.15.120:0/3259353387 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174144 (secure 0 0 0) 0x7f7d5005d0a0 con 0x7f7d600d06c0 2024-03-31T16:35:40.580 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:40.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7d4c06c8f0 msgr2=0x7f7d4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7d4c06c8f0 0x7f7d4c06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d600c9cc0 tx=0x7f7d54009040 comp rx=0 tx=0).stop 2024-03-31T16:35:40.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d06c0 msgr2=0x7f7d600c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d06c0 0x7f7d600c7f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c700 tx=0x7f7d5000cbc0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 shutdown_connections 2024-03-31T16:35:40.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f7d4c06c8f0 0x7f7d4c06edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d6015e860 0x7f7d601edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d600d43d0 0x7f7d600cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 --2- 172.21.15.120:0/3259353387 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d600d06c0 0x7f7d600c7f30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 >> 172.21.15.120:0/3259353387 conn(0x7f7d6009d7d0 msgr2=0x7f7d600b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:40.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 shutdown_connections 2024-03-31T16:35:40.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.576+0000 7f7d66b2b640 1 -- 172.21.15.120:0/3259353387 wait complete. 2024-03-31T16:35:40.591 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":1293298103},{"type":"v1","addr":"172.21.15.120:6833","nonce":1293298103}]},"active_addr":"172.21.15.120:6833/1293298103","active_change":"2024-03-31T16:35:11.847554+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":1084719157}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":1408030350}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":2371635233}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":3827897968}]}]} 2024-03-31T16:35:40.594 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-31T16:35:40.594 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-31T16:35:40.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:40.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.690+0000 7ff130d5f640 1 Processor -- start 2024-03-31T16:35:40.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.690+0000 7ff130d5f640 1 -- start start 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.690+0000 7ff130d5f640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff12c0d43d0 0x7ff12c0d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.690+0000 7ff130d5f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff12c0cf6b0 0x7ff12c0cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.690+0000 7ff130d5f640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12c0d4d20 con 0x7ff12c15e860 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.690+0000 7ff130d5f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff12c0cf220 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.690+0000 7ff130d5f640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff12c06dfa0 con 0x7ff12c0d43d0 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff12ad9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff12c0cf6b0 0x7ff12c0cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff12ad9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff12c0cf6b0 0x7ff12c0cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52242/0 (socket says 172.21.15.120:52242) 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff12ad9d640 1 -- 172.21.15.120:0/2498465196 learned_addr learned my addr 172.21.15.120:0/2498465196 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff123fff640 1 --2- 172.21.15.120:0/2498465196 >> v2:172.21.15.203:3300/0 conn(0x7ff12c0d43d0 0x7ff12c0d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff12ad9d640 1 -- 172.21.15.120:0/2498465196 >> v2:172.21.15.203:3300/0 conn(0x7ff12c0d43d0 msgr2=0x7ff12c0d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:40.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff129d9b640 1 -- 172.21.15.120:0/2498465196 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088818789 0 0) 0x7ff11c001110 con 0x7ff12c15e860 2024-03-31T16:35:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff12ad9d640 1 --2- 172.21.15.120:0/2498465196 >> v2:172.21.15.203:3300/0 conn(0x7ff12c0d43d0 0x7ff12c0d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff12ad9d640 1 -- 172.21.15.120:0/2498465196 >> v1:172.21.15.203:6789/0 conn(0x7ff12c15e860 legacy=0x7ff12c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff12ad9d640 1 -- 172.21.15.120:0/2498465196 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c06e240 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.691+0000 7ff123fff640 1 --2- 172.21.15.120:0/2498465196 >> v2:172.21.15.203:3300/0 conn(0x7ff12c0d43d0 0x7ff12c0d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff12ad9d640 1 --2- 172.21.15.120:0/2498465196 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cfa90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff12c162160 tx=0x7ff12402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb66328c17aab8 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff129d9b640 1 -- 172.21.15.120:0/2498465196 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12402cb20 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff129d9b640 1 -- 172.21.15.120:0/2498465196 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12402ccc0 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff129d9b640 1 -- 172.21.15.120:0/2498465196 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124034610 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff130d5f640 1 -- 172.21.15.120:0/2498465196 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 msgr2=0x7ff12c0cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2498465196 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cfa90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff12c162160 tx=0x7ff12402bf80 comp rx=0 tx=0).stop 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff130d5f640 1 -- 172.21.15.120:0/2498465196 shutdown_connections 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2498465196 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cfa90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2498465196 >> v2:172.21.15.203:3300/0 conn(0x7ff12c0d43d0 0x7ff12c0d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff130d5f640 1 -- 172.21.15.120:0/2498465196 >> 172.21.15.120:0/2498465196 conn(0x7ff12c09d7d0 msgr2=0x7ff12c08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff130d5f640 1 -- 172.21.15.120:0/2498465196 shutdown_connections 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.692+0000 7ff130d5f640 1 -- 172.21.15.120:0/2498465196 wait complete. 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff130d5f640 1 Processor -- start 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff130d5f640 1 -- start start 2024-03-31T16:35:40.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff130d5f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff130d5f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff12c0d43d0 0x7ff12c0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff130d5f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c15e860 0x7ff12c0c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff130d5f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c06dc00 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff130d5f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c0d2c50 con 0x7ff12c15e860 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff130d5f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff12c06dd80 con 0x7ff12c0d43d0 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff12a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff12a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52246/0 (socket says 172.21.15.120:52246) 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.694+0000 7ff12a59c640 1 -- 172.21.15.120:0/2994098058 learned_addr learned my addr 172.21.15.120:0/2994098058 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff12ad9d640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c15e860 0x7ff12c0c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff123fff640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff12c0d43d0 0x7ff12c0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff12a59c640 1 -- 172.21.15.120:0/2994098058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff12c0d43d0 msgr2=0x7ff12c0c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff12a59c640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff12c0d43d0 0x7ff12c0c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff12a59c640 1 -- 172.21.15.120:0/2994098058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c15e860 msgr2=0x7ff12c0c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff12a59c640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c15e860 0x7ff12c0c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff12a59c640 1 -- 172.21.15.120:0/2994098058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c15b110 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff12a59c640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cdaf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c410 tx=0x7ff11c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff122ffd640 1 -- 172.21.15.120:0/2994098058 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c017070 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff122ffd640 1 -- 172.21.15.120:0/2994098058 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11c0035f0 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c0b9f30 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff122ffd640 1 -- 172.21.15.120:0/2994098058 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0039e0 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.695+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c0cd2f0 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.696+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12c0685c0 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.697+0000 7ff122ffd640 1 -- 172.21.15.120:0/2994098058 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff11c01a070 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.697+0000 7ff122ffd640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff10c06c8f0 0x7ff10c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.697+0000 7ff122ffd640 1 -- 172.21.15.120:0/2994098058 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff11c08af30 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.697+0000 7ff123fff640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff10c06c8f0 0x7ff10c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.697+0000 7ff123fff640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff10c06c8f0 0x7ff10c06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0732c0 tx=0x7ff114009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.701+0000 7ff122ffd640 1 -- 172.21.15.120:0/2994098058 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff12c0d4d20 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.877+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff12c0d1730 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.879+0000 7ff122ffd640 1 -- 172.21.15.120:0/2994098058 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7ff11c058d10 con 0x7ff12c0cf6b0 2024-03-31T16:35:40.883 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:40.883 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:40.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.880+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff10c06c8f0 msgr2=0x7ff10c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.880+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff10c06c8f0 0x7ff10c06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0732c0 tx=0x7ff114009190 comp rx=0 tx=0).stop 2024-03-31T16:35:40.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.880+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 msgr2=0x7ff12c0cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.880+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cdaf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c410 tx=0x7ff11c00c8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.881+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 shutdown_connections 2024-03-31T16:35:40.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.881+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff10c06c8f0 0x7ff10c06edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.881+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff12c15e860 0x7ff12c0c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.881+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff12c0d43d0 0x7ff12c0c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.881+0000 7ff130d5f640 1 --2- 172.21.15.120:0/2994098058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff12c0cf6b0 0x7ff12c0cdaf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.881+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 >> 172.21.15.120:0/2994098058 conn(0x7ff12c09d7d0 msgr2=0x7ff12c0b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:40.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.881+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 shutdown_connections 2024-03-31T16:35:40.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.881+0000 7ff130d5f640 1 -- 172.21.15.120:0/2994098058 wait complete. 2024-03-31T16:35:40.896 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-31T16:35:40.896 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:40.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.991+0000 7f09872d9640 1 Processor -- start 2024-03-31T16:35:40.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.991+0000 7f09872d9640 1 -- start start 2024-03-31T16:35:40.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f09872d9640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0980070170 0x7f098006b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f09872d9640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800705f0 0x7f098006bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:40.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f09872d9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f098015edc0 con 0x7f09800d1bf0 2024-03-31T16:35:40.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f09872d9640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f09800d1fd0 con 0x7f0980070170 2024-03-31T16:35:40.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f09872d9640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f098015eb80 con 0x7f09800705f0 2024-03-31T16:35:40.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0985075640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f09800d1bf0 0x7f098015f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53174/0 (socket says 172.21.15.120:53174) 2024-03-31T16:35:40.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0985075640 1 -- 172.21.15.120:0/3563859559 learned_addr learned my addr 172.21.15.120:0/3563859559 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0985876640 1 --2- 172.21.15.120:0/3563859559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800705f0 0x7f098006bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0984874640 1 --2- 172.21.15.120:0/3563859559 >> v2:172.21.15.203:3300/0 conn(0x7f0980070170 0x7f098006b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0977fff640 1 -- 172.21.15.120:0/3563859559 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244321987 0 0) 0x7f098015edc0 con 0x7f09800d1bf0 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0977fff640 1 -- 172.21.15.120:0/3563859559 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f096c003520 con 0x7f09800d1bf0 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0985876640 1 -- 172.21.15.120:0/3563859559 >> v2:172.21.15.203:3300/0 conn(0x7f0980070170 msgr2=0x7f098006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0985876640 1 --2- 172.21.15.120:0/3563859559 >> v2:172.21.15.203:3300/0 conn(0x7f0980070170 0x7f098006b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0985876640 1 -- 172.21.15.120:0/3563859559 >> v1:172.21.15.120:6789/0 conn(0x7f09800d1bf0 legacy=0x7f098015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.992+0000 7f0985876640 1 -- 172.21.15.120:0/3563859559 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09800b5e60 con 0x7f09800705f0 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.993+0000 7f0985876640 1 --2- 172.21.15.120:0/3563859559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800705f0 0x7f098006bab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0978009d90 tx=0x7f097802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d90ae548d07e1139 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.993+0000 7f0977fff640 1 -- 172.21.15.120:0/3563859559 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0978039070 con 0x7f09800705f0 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.993+0000 7f0977fff640 1 -- 172.21.15.120:0/3563859559 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f097802cbc0 con 0x7f09800705f0 2024-03-31T16:35:40.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.993+0000 7f0977fff640 1 -- 172.21.15.120:0/3563859559 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0978034440 con 0x7f09800705f0 2024-03-31T16:35:41.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.994+0000 7f09872d9640 1 -- 172.21.15.120:0/3563859559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800705f0 msgr2=0x7f098006bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.994+0000 7f09872d9640 1 --2- 172.21.15.120:0/3563859559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800705f0 0x7f098006bab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0978009d90 tx=0x7f097802be10 comp rx=0 tx=0).stop 2024-03-31T16:35:41.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.994+0000 7f09872d9640 1 -- 172.21.15.120:0/3563859559 shutdown_connections 2024-03-31T16:35:41.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.994+0000 7f09872d9640 1 --2- 172.21.15.120:0/3563859559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800705f0 0x7f098006bab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.994+0000 7f09872d9640 1 --2- 172.21.15.120:0/3563859559 >> v2:172.21.15.203:3300/0 conn(0x7f0980070170 0x7f098006b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.994+0000 7f09872d9640 1 -- 172.21.15.120:0/3563859559 >> 172.21.15.120:0/3563859559 conn(0x7f09800b6560 msgr2=0x7f09800b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.994+0000 7f09872d9640 1 -- 172.21.15.120:0/3563859559 shutdown_connections 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.994+0000 7f09872d9640 1 -- 172.21.15.120:0/3563859559 wait complete. 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.995+0000 7f09872d9640 1 Processor -- start 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.995+0000 7f09872d9640 1 -- start start 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f09872d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0980070170 0x7f098013c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f09872d9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09800705f0 0x7f0980142560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f09872d9640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800d1bf0 0x7f09801562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f09872d9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f09800b5b10 con 0x7f0980070170 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f09872d9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f098015f080 con 0x7f09800705f0 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f09872d9640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f09800b4220 con 0x7f09800d1bf0 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0980070170 0x7f098013c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0980070170 0x7f098013c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52262/0 (socket says 172.21.15.120:52262) 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 -- 172.21.15.120:0/52367436 learned_addr learned my addr 172.21.15.120:0/52367436 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0984874640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09800705f0 0x7f0980142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985876640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800d1bf0 0x7f09801562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 -- 172.21.15.120:0/52367436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800d1bf0 msgr2=0x7f09801562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800d1bf0 0x7f09801562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 -- 172.21.15.120:0/52367436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09800705f0 msgr2=0x7f0980142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09800705f0 0x7f0980142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 -- 172.21.15.120:0/52367436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f098013ea90 con 0x7f0980070170 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0985075640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0980070170 0x7f098013c160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c390 tx=0x7f097c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0975ffb640 1 -- 172.21.15.120:0/52367436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c017070 con 0x7f0980070170 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0975ffb640 1 -- 172.21.15.120:0/52367436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f097c005ce0 con 0x7f0980070170 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f098013ed30 con 0x7f0980070170 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.996+0000 7f0975ffb640 1 -- 172.21.15.120:0/52367436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0072f0 con 0x7f0980070170 2024-03-31T16:35:41.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.997+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f098013f2f0 con 0x7f0980070170 2024-03-31T16:35:41.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.998+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09800685c0 con 0x7f0980070170 2024-03-31T16:35:41.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.998+0000 7f0975ffb640 1 -- 172.21.15.120:0/52367436 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f097c01a070 con 0x7f0980070170 2024-03-31T16:35:41.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.998+0000 7f0975ffb640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f096406c920 0x7f096406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.998+0000 7f0975ffb640 1 -- 172.21.15.120:0/52367436 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f097c08ae40 con 0x7f0980070170 2024-03-31T16:35:41.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.998+0000 7f0984874640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f096406c920 0x7f096406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:40.998+0000 7f0984874640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f096406c920 0x7f096406ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0980075a50 tx=0x7f0970009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.002+0000 7f0975ffb640 1 -- 172.21.15.120:0/52367436 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f097c058c20 con 0x7f0980070170 2024-03-31T16:35:41.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.181+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09800afad0 con 0x7f0980070170 2024-03-31T16:35:41.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.182+0000 7f0975ffb640 1 -- 172.21.15.120:0/52367436 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f097c05cf20 con 0x7f0980070170 2024-03-31T16:35:41.186 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:41.186 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:41.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f096406c920 msgr2=0x7f096406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f096406c920 0x7f096406ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0980075a50 tx=0x7f0970009190 comp rx=0 tx=0).stop 2024-03-31T16:35:41.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0980070170 msgr2=0x7f098013c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0980070170 0x7f098013c160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c390 tx=0x7f097c00c850 comp rx=0 tx=0).stop 2024-03-31T16:35:41.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 shutdown_connections 2024-03-31T16:35:41.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f096406c920 0x7f096406ede0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09800d1bf0 0x7f09801562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09800705f0 0x7f0980142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 --2- 172.21.15.120:0/52367436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0980070170 0x7f098013c160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 >> 172.21.15.120:0/52367436 conn(0x7f09800b6560 msgr2=0x7f098015fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 shutdown_connections 2024-03-31T16:35:41.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.184+0000 7f09872d9640 1 -- 172.21.15.120:0/52367436 wait complete. 2024-03-31T16:35:41.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-31T16:35:41.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-31T16:35:41.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-31T16:35:41.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-31T16:35:41.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-31T16:35:41.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-31T16:35:41.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-31T16:35:41.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-31T16:35:41.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7f111f43a640 1 Processor -- start 2024-03-31T16:35:41.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7f111f43a640 1 -- start start 2024-03-31T16:35:41.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7f556ceeb640 1 Processor -- start 2024-03-31T16:35:41.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7f556ceeb640 1 -- start start 2024-03-31T16:35:41.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7f401bb11640 1 Processor -- start 2024-03-31T16:35:41.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7fb3d0e90640 1 Processor -- start 2024-03-31T16:35:41.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7fb3d0e90640 1 -- start start 2024-03-31T16:35:41.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7f18fb0fd640 1 Processor -- start 2024-03-31T16:35:41.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.369+0000 7fcc1d31a640 1 Processor -- start 2024-03-31T16:35:41.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.369+0000 7fcc1d31a640 1 -- start start 2024-03-31T16:35:41.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.369+0000 7f401bb11640 1 -- start start 2024-03-31T16:35:41.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.368+0000 7f18fb0fd640 1 -- start start 2024-03-31T16:35:41.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f8b7359e640 1 Processor -- start 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fcc1d31a640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcc100dfeb0 0x7fcc100525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fcc1d31a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcc10050260 0x7fcc100506e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fcc1d31a640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc10039dc0 con 0x7fcc100398c0 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fcc1d31a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1003a0a0 con 0x7fcc10050260 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fcc1d31a640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcc1004f070 con 0x7fcc100dfeb0 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fcc177fe640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fcc100398c0 0x7fcc1004fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:49820/0 (socket says 172.21.15.120:49820) 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fcc177fe640 1 -- 172.21.15.120:0/873709520 learned_addr learned my addr 172.21.15.120:0/873709520 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fcc17fff640 1 --2- 172.21.15.120:0/873709520 >> v2:172.21.15.203:3300/0 conn(0x7fcc100dfeb0 0x7fcc100525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f111f43a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11181472e0 0x7f1118147890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f111f43a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f111806f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f111d1d6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f11181472e0 0x7f1118147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f111c9d5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f111806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f111c9d5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f111806f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60580/0 (socket says 172.21.15.120:60580) 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f111c9d5640 1 -- 172.21.15.120:0/3909924452 learned_addr learned my addr 172.21.15.120:0/3909924452 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f111f43a640 1 -- 172.21.15.120:0/3909924452 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1118162f40 con 0x7f111806fe70 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f111f43a640 1 -- 172.21.15.120:0/3909924452 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f11181623c0 con 0x7f11181472e0 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f111f43a640 1 -- 172.21.15.120:0/3909924452 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11181626a0 con 0x7f1118147dd0 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f110ffff640 1 -- 172.21.15.120:0/3909924452 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943465983 0 0) 0x7f1118162f40 con 0x7f111806fe70 2024-03-31T16:35:41.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f110ffff640 1 -- 172.21.15.120:0/3909924452 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1104003520 con 0x7f111806fe70 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fdd20dcd640 1 Processor -- start 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f556ceeb640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f556815a1a0 0x7f55680722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f556ceeb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f556815a580 0x7f55680d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f556ceeb640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5568071500 con 0x7f55680b4d10 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f556ceeb640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f55680717e0 con 0x7f556815a1a0 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f556659c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f556815a1a0 0x7f55680722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f556659c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f556815a1a0 0x7f55680722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43880/0 (socket says 172.21.15.120:43880) 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f556659c640 1 -- 172.21.15.120:0/2673606810 learned_addr learned my addr 172.21.15.120:0/2673606810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f556ceeb640 1 -- 172.21.15.120:0/2673606810 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5568071ac0 con 0x7f556815a580 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f556659c640 1 -- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f556815a580 msgr2=0x7f55680d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f5565d9b640 1 --2- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f556815a580 0x7f55680d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f401bb11640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f40140d43d0 0x7f40140d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f401bb11640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140cf6b0 0x7f40140cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f401bb11640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40140d4d20 con 0x7f401415e860 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f401bb11640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f40140cf220 con 0x7f40140d43d0 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f401bb11640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f401406dfa0 con 0x7f40140cf6b0 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f40198ad640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f401415e860 0x7f401406d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:49810/0 (socket says 172.21.15.120:49810) 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f40198ad640 1 -- 172.21.15.120:0/839265684 learned_addr learned my addr 172.21.15.120:0/839265684 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:41.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f40190ac640 1 --2- 172.21.15.120:0/839265684 >> v2:172.21.15.203:3300/0 conn(0x7f40140d43d0 0x7f40140d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f401a0ae640 1 --2- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140cf6b0 0x7f40140cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f40188ab640 1 -- 172.21.15.120:0/839265684 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 534600989 0 0) 0x7f400c001490 con 0x7f401415e860 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f40188ab640 1 -- 172.21.15.120:0/839265684 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4000003520 con 0x7f401415e860 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f40190ac640 1 -- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140cf6b0 msgr2=0x7f40140cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f40190ac640 1 --2- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140cf6b0 0x7f40140cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f40190ac640 1 -- 172.21.15.120:0/839265684 >> v1:172.21.15.203:6789/0 conn(0x7f401415e860 legacy=0x7f401406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fb3d0e90640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3cc15fe90 0x7fb3cc1602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fb3d0e90640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb3cc0b56d0 0x7fb3cc0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fb3caffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3cc15fe90 0x7fb3cc1602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fb3caffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3cc15fe90 0x7fb3cc1602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52276/0 (socket says 172.21.15.120:52276) 2024-03-31T16:35:41.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fb3caffd640 1 -- 172.21.15.120:0/303219538 learned_addr learned my addr 172.21.15.120:0/303219538 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fb3d0e90640 1 -- 172.21.15.120:0/303219538 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3cc0d2400 con 0x7fb3cc145cd0 2024-03-31T16:35:41.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fb3cbfff640 1 --2- 172.21.15.120:0/303219538 >> v2:172.21.15.203:3300/0 conn(0x7fb3cc0b56d0 0x7fb3cc0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fb3d0e90640 1 -- 172.21.15.120:0/303219538 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb3cc1460b0 con 0x7fb3cc15fe90 2024-03-31T16:35:41.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fb3d0e90640 1 -- 172.21.15.120:0/303219538 --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb3cc0b5240 con 0x7fb3cc0b56d0 2024-03-31T16:35:41.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f18fb0fd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4160360 0x7f18f40713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f18fb0fd640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f18f4162de0 0x7f18f4071920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f18fb0fd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f40b3920 con 0x7f18f40735c0 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f18fb0fd640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f18f40b36d0 con 0x7f18f4162de0 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f18fb0fd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f18f40b4530 con 0x7f18f4160360 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f18fa8fc640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f18f4162de0 0x7f18f4071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f18fa8fc640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f18f4162de0 0x7f18f4071920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43904/0 (socket says 172.21.15.120:43904) 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f18fa8fc640 1 -- 172.21.15.120:0/2673977187 learned_addr learned my addr 172.21.15.120:0/2673977187 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f18fa0fb640 1 --2- 172.21.15.120:0/2673977187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4160360 0x7f18f40713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f18fa8fc640 1 -- 172.21.15.120:0/2673977187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4160360 msgr2=0x7f18f40713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f18fa8fc640 1 --2- 172.21.15.120:0/2673977187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4160360 0x7f18f40713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f18fa8fc640 1 -- 172.21.15.120:0/2673977187 >> v1:172.21.15.120:6789/0 conn(0x7f18f40735c0 legacy=0x7f18f41663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f18fa8fc640 1 -- 172.21.15.120:0/2673977187 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f40b3c00 con 0x7f18f4162de0 2024-03-31T16:35:41.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7fdd20dcd640 1 -- start start 2024-03-31T16:35:41.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f556659c640 1 --2- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f556815a580 0x7f55680d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f556659c640 1 -- 172.21.15.120:0/2673606810 >> v1:172.21.15.120:6789/0 conn(0x7f55680b4d10 legacy=0x7f55680b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f556659c640 1 -- 172.21.15.120:0/2673606810 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5568071da0 con 0x7f556815a1a0 2024-03-31T16:35:41.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f40190ac640 1 -- 172.21.15.120:0/839265684 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401406e240 con 0x7f40140d43d0 2024-03-31T16:35:41.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.370+0000 7f8b7359e640 1 -- start start 2024-03-31T16:35:41.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f8b7359e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8b740d3e40 0x7f8b740b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f8b7359e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b740d2da0 con 0x7f8b7415e460 2024-03-31T16:35:41.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f8b7359e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b740d3080 con 0x7f8b740cef20 2024-03-31T16:35:41.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f8b7359e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f8b740d3360 con 0x7f8b740d3e40 2024-03-31T16:35:41.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f5565d9b640 1 --2- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f556815a580 0x7f55680d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f401a0ae640 1 --2- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140cf6b0 0x7f40140cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f40190ac640 1 --2- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40140d43d0 0x7f40140d47e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f40100097a0 tx=0x7f401002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aa4c51a847de624 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fdd20dcd640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdd1c15e6d0 0x7fdd1c0d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fdd20dcd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdd1c0d0cb0 0x7fdd1c0d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fdd20dcd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c0ceef0 con 0x7fdd1c0d4590 2024-03-31T16:35:41.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fdd20dcd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fdd1c15eab0 con 0x7fdd1c0d0cb0 2024-03-31T16:35:41.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fdd20dcd640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fdd1c0d1220 con 0x7fdd1c15e6d0 2024-03-31T16:35:41.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fb3cbfff640 1 -- 172.21.15.120:0/303219538 >> v2:172.21.15.120:3300/0 conn(0x7fb3cc15fe90 msgr2=0x7fb3cc1602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fb3cbfff640 1 --2- 172.21.15.120:0/303219538 >> v2:172.21.15.120:3300/0 conn(0x7fb3cc15fe90 0x7fb3cc1602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fb3cbfff640 1 -- 172.21.15.120:0/303219538 >> v1:172.21.15.120:6789/0 conn(0x7fb3cc145cd0 legacy=0x7fb3cc0c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7fb3cbfff640 1 -- 172.21.15.120:0/303219538 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3cc0d26e0 con 0x7fb3cc0b56d0 2024-03-31T16:35:41.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f111c9d5640 1 -- 172.21.15.120:0/3909924452 >> v2:172.21.15.120:3300/0 conn(0x7f11181472e0 msgr2=0x7f1118147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f111c9d5640 1 --2- 172.21.15.120:0/3909924452 >> v2:172.21.15.120:3300/0 conn(0x7f11181472e0 0x7f1118147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f111c9d5640 1 -- 172.21.15.120:0/3909924452 >> v1:172.21.15.120:6789/0 conn(0x7f111806fe70 legacy=0x7f1118070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.371+0000 7f111c9d5640 1 -- 172.21.15.120:0/3909924452 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1118162980 con 0x7f1118147dd0 2024-03-31T16:35:41.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7fdd19d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdd1c0d0cb0 0x7fdd1c0d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7fdd19d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdd1c0d0cb0 0x7fdd1c0d4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52312/0 (socket says 172.21.15.120:52312) 2024-03-31T16:35:41.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7fdd19d9b640 1 -- 172.21.15.120:0/1090766444 learned_addr learned my addr 172.21.15.120:0/1090766444 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f8b7259c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8b7415e460 0x7f8b740d2550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53228/0 (socket says 172.21.15.120:53228) 2024-03-31T16:35:41.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f8b7259c640 1 -- 172.21.15.120:0/1328577636 learned_addr learned my addr 172.21.15.120:0/1328577636 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:41.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f8b71d9b640 1 --2- 172.21.15.120:0/1328577636 >> v2:172.21.15.120:3300/0 conn(0x7f8b740d3e40 0x7f8b740b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7fdd1a59c640 1 --2- 172.21.15.120:0/1090766444 >> v2:172.21.15.203:3300/0 conn(0x7fdd1c15e6d0 0x7fdd1c0d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7fb3cbfff640 1 --2- 172.21.15.120:0/303219538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 0x7fb3cc0b5b40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0c88d0 tx=0x7fb3c402bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=227234bae5ff540a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7fcc1cb19640 1 --2- 172.21.15.120:0/873709520 >> v2:172.21.15.120:3300/0 conn(0x7fcc10050260 0x7fcc100506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fcc16ffd640 1 -- 172.21.15.120:0/873709520 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709648823 0 0) 0x7fcc10039dc0 con 0x7fcc100398c0 2024-03-31T16:35:41.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fcc16ffd640 1 -- 172.21.15.120:0/873709520 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc08003520 con 0x7fcc100398c0 2024-03-31T16:35:41.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fcc17fff640 1 -- 172.21.15.120:0/873709520 >> v2:172.21.15.120:3300/0 conn(0x7fcc10050260 msgr2=0x7fcc100506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fcc17fff640 1 --2- 172.21.15.120:0/873709520 >> v2:172.21.15.120:3300/0 conn(0x7fcc10050260 0x7fcc100506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fcc17fff640 1 -- 172.21.15.120:0/873709520 >> v1:172.21.15.203:6789/0 conn(0x7fcc100398c0 legacy=0x7fcc1004fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fcc17fff640 1 -- 172.21.15.120:0/873709520 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1004f350 con 0x7fcc100dfeb0 2024-03-31T16:35:41.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f111c9d5640 1 --2- 172.21.15.120:0/3909924452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f111806f930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1114009870 tx=0x7f111402b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58731d88f96505ed server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fdd1a59c640 1 -- 172.21.15.120:0/1090766444 >> v2:172.21.15.120:3300/0 conn(0x7fdd1c0d0cb0 msgr2=0x7fdd1c0d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fdd1a59c640 1 --2- 172.21.15.120:0/1090766444 >> v2:172.21.15.120:3300/0 conn(0x7fdd1c0d0cb0 0x7fdd1c0d4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fdd1a59c640 1 -- 172.21.15.120:0/1090766444 >> v1:172.21.15.120:6789/0 conn(0x7fdd1c0d4590 legacy=0x7fdd1c1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fdd1a59c640 1 -- 172.21.15.120:0/1090766444 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c0d1500 con 0x7fdd1c15e6d0 2024-03-31T16:35:41.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f556659c640 1 --2- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f556815a1a0 0x7f55680722c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5558007360 tx=0x7f555802c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbbe3c6a1deac40e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f556559a640 1 -- 172.21.15.120:0/2673606810 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558035020 con 0x7f556815a1a0 2024-03-31T16:35:41.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f556559a640 1 -- 172.21.15.120:0/2673606810 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5558008df0 con 0x7f556815a1a0 2024-03-31T16:35:41.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f556559a640 1 -- 172.21.15.120:0/2673606810 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555800a2d0 con 0x7f556815a1a0 2024-03-31T16:35:41.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f40188ab640 1 -- 172.21.15.120:0/839265684 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010035020 con 0x7f40140d43d0 2024-03-31T16:35:41.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f40188ab640 1 -- 172.21.15.120:0/839265684 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4010031830 con 0x7f40140d43d0 2024-03-31T16:35:41.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f40188ab640 1 -- 172.21.15.120:0/839265684 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010031be0 con 0x7f40140d43d0 2024-03-31T16:35:41.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f401bb11640 1 -- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40140d43d0 msgr2=0x7f40140d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f401bb11640 1 --2- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40140d43d0 0x7f40140d47e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f40100097a0 tx=0x7f401002b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f401bb11640 1 -- 172.21.15.120:0/839265684 shutdown_connections 2024-03-31T16:35:41.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f401bb11640 1 --2- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140cf6b0 0x7f40140cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f401bb11640 1 --2- 172.21.15.120:0/839265684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40140d43d0 0x7f40140d47e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f401bb11640 1 -- 172.21.15.120:0/839265684 >> 172.21.15.120:0/839265684 conn(0x7f401409d7d0 msgr2=0x7f401408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f401bb11640 1 -- 172.21.15.120:0/839265684 shutdown_connections 2024-03-31T16:35:41.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fb3ca7fc640 1 -- 172.21.15.120:0/303219538 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4039070 con 0x7fb3cc0b56d0 2024-03-31T16:35:41.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fb3ca7fc640 1 -- 172.21.15.120:0/303219538 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c402cc70 con 0x7fb3cc0b56d0 2024-03-31T16:35:41.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7fb3ca7fc640 1 -- 172.21.15.120:0/303219538 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4034660 con 0x7fb3cc0b56d0 2024-03-31T16:35:41.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f18fa8fc640 1 --2- 172.21.15.120:0/2673977187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f4162de0 0x7f18f4071920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009870 tx=0x7f18e402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=539d067205b18f51 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f18f90f9640 1 -- 172.21.15.120:0/2673977187 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4034070 con 0x7f18f4162de0 2024-03-31T16:35:41.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f18f90f9640 1 -- 172.21.15.120:0/2673977187 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e4030840 con 0x7f18f4162de0 2024-03-31T16:35:41.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.372+0000 7f8b71d9b640 1 -- 172.21.15.120:0/1328577636 >> v1:172.21.15.203:6789/0 conn(0x7f8b740cef20 legacy=0x7f8b740b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f8b7159a640 1 -- 172.21.15.120:0/1328577636 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1922457126 0 0) 0x7f8b740d3080 con 0x7f8b740cef20 2024-03-31T16:35:41.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f8b71d9b640 1 -- 172.21.15.120:0/1328577636 >> v1:172.21.15.120:6789/0 conn(0x7f8b7415e460 legacy=0x7f8b740d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f8b71d9b640 1 -- 172.21.15.120:0/1328577636 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b740d3640 con 0x7f8b740d3e40 2024-03-31T16:35:41.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f110ffff640 1 -- 172.21.15.120:0/3909924452 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114035020 con 0x7f1118147dd0 2024-03-31T16:35:41.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f110ffff640 1 -- 172.21.15.120:0/3909924452 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1114031870 con 0x7f1118147dd0 2024-03-31T16:35:41.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f110ffff640 1 -- 172.21.15.120:0/3909924452 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114031c80 con 0x7f1118147dd0 2024-03-31T16:35:41.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fcc17fff640 1 --2- 172.21.15.120:0/873709520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc100dfeb0 0x7fcc100525f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc18000b60 tx=0x7fcc180a6d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3da52cc157d083b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f111f43a640 1 -- 172.21.15.120:0/3909924452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 msgr2=0x7f111806f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fb3d0e90640 1 -- 172.21.15.120:0/303219538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 msgr2=0x7fb3cc0b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fb3d0e90640 1 --2- 172.21.15.120:0/303219538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 0x7fb3cc0b5b40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0c88d0 tx=0x7fb3c402bec0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fb3d0e90640 1 -- 172.21.15.120:0/303219538 shutdown_connections 2024-03-31T16:35:41.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fb3d0e90640 1 --2- 172.21.15.120:0/303219538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 0x7fb3cc0b5b40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fb3d0e90640 1 --2- 172.21.15.120:0/303219538 >> v2:172.21.15.120:3300/0 conn(0x7fb3cc15fe90 0x7fb3cc1602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fb3d0e90640 1 -- 172.21.15.120:0/303219538 >> 172.21.15.120:0/303219538 conn(0x7fb3cc067280 msgr2=0x7fb3cc067660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18f90f9640 1 -- 172.21.15.120:0/2673977187 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4030c10 con 0x7f18f4162de0 2024-03-31T16:35:41.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fdd1a59c640 1 --2- 172.21.15.120:0/1090766444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd1c15e6d0 0x7fdd1c0d21e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c08cdc0 tx=0x7fdd1002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ef68512f9850c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fcc16ffd640 1 -- 172.21.15.120:0/873709520 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc180b4070 con 0x7fcc100dfeb0 2024-03-31T16:35:41.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f111f43a640 1 --2- 172.21.15.120:0/3909924452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f111806f930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1114009870 tx=0x7f111402b910 comp rx=0 tx=0).stop 2024-03-31T16:35:41.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fcc16ffd640 1 -- 172.21.15.120:0/873709520 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc180a7940 con 0x7fcc100dfeb0 2024-03-31T16:35:41.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18fb0fd640 1 -- 172.21.15.120:0/2673977187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f4162de0 msgr2=0x7f18f4071920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18fb0fd640 1 --2- 172.21.15.120:0/2673977187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f4162de0 0x7f18f4071920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009870 tx=0x7f18e402b980 comp rx=0 tx=0).stop 2024-03-31T16:35:41.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fcc16ffd640 1 -- 172.21.15.120:0/873709520 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c001670 con 0x7fcc100dfeb0 2024-03-31T16:35:41.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.373+0000 7f401bb11640 1 -- 172.21.15.120:0/839265684 wait complete. 2024-03-31T16:35:41.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f111f43a640 1 -- 172.21.15.120:0/3909924452 shutdown_connections 2024-03-31T16:35:41.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f111f43a640 1 --2- 172.21.15.120:0/3909924452 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f111806f930 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f111f43a640 1 --2- 172.21.15.120:0/3909924452 >> v2:172.21.15.120:3300/0 conn(0x7f11181472e0 0x7f1118147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f111f43a640 1 -- 172.21.15.120:0/3909924452 >> 172.21.15.120:0/3909924452 conn(0x7f11180b3ca0 msgr2=0x7f11180b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fb3d0e90640 1 -- 172.21.15.120:0/303219538 shutdown_connections 2024-03-31T16:35:41.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18fb0fd640 1 -- 172.21.15.120:0/2673977187 shutdown_connections 2024-03-31T16:35:41.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18fb0fd640 1 --2- 172.21.15.120:0/2673977187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f4162de0 0x7f18f4071920 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18fb0fd640 1 --2- 172.21.15.120:0/2673977187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4160360 0x7f18f40713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18fb0fd640 1 -- 172.21.15.120:0/2673977187 >> 172.21.15.120:0/2673977187 conn(0x7f18f40b1ba0 msgr2=0x7f18f40b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f8b71d9b640 1 --2- 172.21.15.120:0/1328577636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b740d3e40 0x7f8b740b9e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009790 tx=0x7f8b6402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e56c999ee40d7c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7fb3d0e90640 1 -- 172.21.15.120:0/303219538 wait complete. 2024-03-31T16:35:41.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18fb0fd640 1 -- 172.21.15.120:0/2673977187 shutdown_connections 2024-03-31T16:35:41.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f556ceeb640 1 -- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f556815a1a0 msgr2=0x7f55680722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7f111f43a640 1 -- 172.21.15.120:0/3909924452 shutdown_connections 2024-03-31T16:35:41.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fdd1959a640 1 -- 172.21.15.120:0/1090766444 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd10035020 con 0x7fdd1c15e6d0 2024-03-31T16:35:41.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.374+0000 7f18fb0fd640 1 -- 172.21.15.120:0/2673977187 wait complete. 2024-03-31T16:35:41.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fdd1959a640 1 -- 172.21.15.120:0/1090766444 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd10031640 con 0x7fdd1c15e6d0 2024-03-31T16:35:41.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fdd1959a640 1 -- 172.21.15.120:0/1090766444 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1002d040 con 0x7fdd1c15e6d0 2024-03-31T16:35:41.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7f111f43a640 1 -- 172.21.15.120:0/3909924452 wait complete. 2024-03-31T16:35:41.403 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7f8b7159a640 1 -- 172.21.15.120:0/1328577636 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64034070 con 0x7f8b740d3e40 2024-03-31T16:35:41.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7f556ceeb640 1 --2- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f556815a1a0 0x7f55680722c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5558007360 tx=0x7f555802c9a0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fcc1d31a640 1 -- 172.21.15.120:0/873709520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc100dfeb0 msgr2=0x7fcc100525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fcc1d31a640 1 --2- 172.21.15.120:0/873709520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc100dfeb0 0x7fcc100525f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc18000b60 tx=0x7fcc180a6d50 comp rx=0 tx=0).stop 2024-03-31T16:35:41.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fcc1d31a640 1 -- 172.21.15.120:0/873709520 shutdown_connections 2024-03-31T16:35:41.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fcc1d31a640 1 --2- 172.21.15.120:0/873709520 >> v2:172.21.15.120:3300/0 conn(0x7fcc10050260 0x7fcc100506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fcc1d31a640 1 --2- 172.21.15.120:0/873709520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc100dfeb0 0x7fcc100525f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fcc1d31a640 1 -- 172.21.15.120:0/873709520 >> 172.21.15.120:0/873709520 conn(0x7fcc10009fa0 msgr2=0x7fcc1000a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fcc1d31a640 1 -- 172.21.15.120:0/873709520 shutdown_connections 2024-03-31T16:35:41.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7fcc1d31a640 1 -- 172.21.15.120:0/873709520 wait complete. 2024-03-31T16:35:41.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7f401bb11640 1 Processor -- start 2024-03-31T16:35:41.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7f401bb11640 1 -- start start 2024-03-31T16:35:41.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.375+0000 7f8b7159a640 1 -- 172.21.15.120:0/1328577636 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b64030610 con 0x7f8b740d3e40 2024-03-31T16:35:41.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fdd20dcd640 1 -- 172.21.15.120:0/1090766444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd1c15e6d0 msgr2=0x7fdd1c0d21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fdd20dcd640 1 --2- 172.21.15.120:0/1090766444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd1c15e6d0 0x7fdd1c0d21e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c08cdc0 tx=0x7fdd1002b8f0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f8b7359e640 1 -- 172.21.15.120:0/1328577636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b740d3e40 msgr2=0x7f8b740b9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f8b7359e640 1 --2- 172.21.15.120:0/1328577636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b740d3e40 0x7f8b740b9e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009790 tx=0x7f8b6402b960 comp rx=0 tx=0).stop 2024-03-31T16:35:41.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fdd20dcd640 1 -- 172.21.15.120:0/1090766444 shutdown_connections 2024-03-31T16:35:41.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fdd20dcd640 1 --2- 172.21.15.120:0/1090766444 >> v2:172.21.15.120:3300/0 conn(0x7fdd1c0d0cb0 0x7fdd1c0d4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fdd20dcd640 1 --2- 172.21.15.120:0/1090766444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd1c15e6d0 0x7fdd1c0d21e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fdd20dcd640 1 -- 172.21.15.120:0/1090766444 >> 172.21.15.120:0/1090766444 conn(0x7fdd1c09d7b0 msgr2=0x7fdd1c08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f18fb0fd640 1 Processor -- start 2024-03-31T16:35:41.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f8b7359e640 1 -- 172.21.15.120:0/1328577636 shutdown_connections 2024-03-31T16:35:41.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f8b7359e640 1 --2- 172.21.15.120:0/1328577636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b740d3e40 0x7f8b740b9e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f8b7359e640 1 -- 172.21.15.120:0/1328577636 >> 172.21.15.120:0/1328577636 conn(0x7f8b740678b0 msgr2=0x7f8b740d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fdd20dcd640 1 -- 172.21.15.120:0/1090766444 shutdown_connections 2024-03-31T16:35:41.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f8b7359e640 1 -- 172.21.15.120:0/1328577636 shutdown_connections 2024-03-31T16:35:41.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f401bb11640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40140cf6b0 0x7f40140ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fb3d0e90640 1 Processor -- start 2024-03-31T16:35:41.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f401bb11640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140d43d0 0x7f40140cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f18fb0fd640 1 -- start start 2024-03-31T16:35:41.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f401bb11640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f401415e860 0x7f40141f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f401bb11640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f401406dc00 con 0x7f40140cf6b0 2024-03-31T16:35:41.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f401bb11640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40140d2c50 con 0x7f401415e860 2024-03-31T16:35:41.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f556ceeb640 1 -- 172.21.15.120:0/2673606810 shutdown_connections 2024-03-31T16:35:41.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f556ceeb640 1 --2- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f556815a580 0x7f55680d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7fcc1d31a640 1 Processor -- start 2024-03-31T16:35:41.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f556ceeb640 1 --2- 172.21.15.120:0/2673606810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f556815a1a0 0x7f55680722c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f556ceeb640 1 -- 172.21.15.120:0/2673606810 >> 172.21.15.120:0/2673606810 conn(0x7f556806b960 msgr2=0x7f556806bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f401bb11640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f401406dd80 con 0x7f40140d43d0 2024-03-31T16:35:41.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7fb3d0e90640 1 -- start start 2024-03-31T16:35:41.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7fdd20dcd640 1 -- 172.21.15.120:0/1090766444 wait complete. 2024-03-31T16:35:41.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f401a0ae640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f401415e860 0x7f40141f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f401a0ae640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f401415e860 0x7f40141f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43930/0 (socket says 172.21.15.120:43930) 2024-03-31T16:35:41.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f401a0ae640 1 -- 172.21.15.120:0/3791612268 learned_addr learned my addr 172.21.15.120:0/3791612268 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f556ceeb640 1 -- 172.21.15.120:0/2673606810 shutdown_connections 2024-03-31T16:35:41.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7fcc1d31a640 1 -- start start 2024-03-31T16:35:41.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f40198ad640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40140cf6b0 0x7f40140ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.377+0000 7f111f43a640 1 Processor -- start 2024-03-31T16:35:41.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f556ceeb640 1 -- 172.21.15.120:0/2673606810 wait complete. 2024-03-31T16:35:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f40190ac640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140d43d0 0x7f40140cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f401a0ae640 1 -- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140d43d0 msgr2=0x7f40140cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.376+0000 7f8b7359e640 1 -- 172.21.15.120:0/1328577636 wait complete. 2024-03-31T16:35:41.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f401a0ae640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140d43d0 0x7f40140cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f401a0ae640 1 -- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40140cf6b0 msgr2=0x7f40140ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f401a0ae640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40140cf6b0 0x7f40140ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1d31a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc100398c0 0x7fcc100485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1d31a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc10050260 0x7fcc100c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1d31a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc100dfeb0 0x7fcc100c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f401a0ae640 1 -- 172.21.15.120:0/3791612268 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40141f4f70 con 0x7f401415e860 2024-03-31T16:35:41.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1d31a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc10052b30 con 0x7fcc100398c0 2024-03-31T16:35:41.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f40198ad640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40140cf6b0 0x7f40140ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:41.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f40190ac640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40140d43d0 0x7f40140cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f111f43a640 1 -- start start 2024-03-31T16:35:41.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1d31a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc100e0290 con 0x7fcc10050260 2024-03-31T16:35:41.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1d31a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc10052cb0 con 0x7fcc100dfeb0 2024-03-31T16:35:41.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fb3d0e90640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 0x7fb3cc15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fb0fd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f40735c0 0x7f18f4201790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fb0fd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18f4160360 0x7f18f415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fb0fd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4162de0 0x7f18f415d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fb0fd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f18f40b49c0 con 0x7f18f4160360 2024-03-31T16:35:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fb0fd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18f40b41c0 con 0x7f18f40735c0 2024-03-31T16:35:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fb0fd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f18f406e630 con 0x7f18f4162de0 2024-03-31T16:35:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1cb19640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc100dfeb0 0x7fcc100c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1cb19640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc100dfeb0 0x7fcc100c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60604/0 (socket says 172.21.15.120:60604) 2024-03-31T16:35:41.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc1cb19640 1 -- 172.21.15.120:0/1211223574 learned_addr learned my addr 172.21.15.120:0/1211223574 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fb3d0e90640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3cc145cd0 0x7fb3cc13c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fa0fb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f40735c0 0x7f18f4201790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fa8fc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4162de0 0x7f18f415d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc177fe640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc10050260 0x7fcc100c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fb3d0e90640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb3cc15fe90 0x7fb3cc140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fcc17fff640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc100398c0 0x7fcc100485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fdd20dcd640 1 Processor -- start 2024-03-31T16:35:41.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fa0fb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f40735c0 0x7f18f4201790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43944/0 (socket says 172.21.15.120:43944) 2024-03-31T16:35:41.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7f18fa0fb640 1 -- 172.21.15.120:0/3561575113 learned_addr learned my addr 172.21.15.120:0/3561575113 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fb3cb7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 0x7fb3cc15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fb3cb7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 0x7fb3cc15b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43952/0 (socket says 172.21.15.120:43952) 2024-03-31T16:35:41.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fdd20dcd640 1 -- start start 2024-03-31T16:35:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fb3cb7fe640 1 -- 172.21.15.120:0/2422027860 learned_addr learned my addr 172.21.15.120:0/2422027860 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.378+0000 7fb3cbfff640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb3cc15fe90 0x7fb3cc140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc160bc0 con 0x7fb3cc145cd0 2024-03-31T16:35:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb3cc160810 con 0x7fb3cc0b56d0 2024-03-31T16:35:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb3cc0c7690 con 0x7fb3cc15fe90 2024-03-31T16:35:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f18fa0fb640 1 -- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4162de0 msgr2=0x7f18f415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f18fa0fb640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18f4162de0 0x7f18f415d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f18fa0fb640 1 -- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18f4160360 msgr2=0x7f18f415cf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T16:35:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fcc1cb19640 1 -- 172.21.15.120:0/1211223574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc10050260 msgr2=0x7fcc100c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3caffd640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3cc145cd0 0x7fb3cc13c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fcc1cb19640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc10050260 0x7fcc100c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f18f98fa640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18f4160360 0x7f18f415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f18fa0fb640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18f4160360 0x7f18f415cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f18fa0fb640 1 -- 172.21.15.120:0/3561575113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f40ad490 con 0x7f18f40735c0 2024-03-31T16:35:41.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fcc1cb19640 1 -- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc100398c0 msgr2=0x7fcc100485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f18f98fa640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18f4160360 0x7f18f415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fcc1cb19640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc100398c0 0x7fcc100485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fcc1cb19640 1 -- 172.21.15.120:0/1211223574 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100c8f90 con 0x7fcc100dfeb0 2024-03-31T16:35:41.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fcc17fff640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc100398c0 0x7fcc100485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:41.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f18fa0fb640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f40735c0 0x7f18f4201790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18f0007e40 tx=0x7f18f000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fcc1cb19640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc100dfeb0 0x7fcc100c9a50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400d5d0 tx=0x7fcc0400da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f401a0ae640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f401415e860 0x7f40141f4a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f400400c7f0 tx=0x7f400400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004015070 con 0x7f401415e860 2024-03-31T16:35:41.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4004007840 con 0x7f401415e860 2024-03-31T16:35:41.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004007c30 con 0x7f401415e860 2024-03-31T16:35:41.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f111f43a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111806fe70 0x7f1118161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f111f43a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11181472e0 0x7f1118140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7f111f43a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f11181452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fdd20dcd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd1c0d0cb0 0x7fdd1c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fdd20dcd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdd1c0d4590 0x7fdd1c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fdd20dcd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd1c15e6d0 0x7fdd1c0cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fdd20dcd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0d4a20 con 0x7fdd1c0d0cb0 2024-03-31T16:35:41.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fdd20dcd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0d1ac0 con 0x7fdd1c15e6d0 2024-03-31T16:35:41.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fdd20dcd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c0d2720 con 0x7fdd1c0d4590 2024-03-31T16:35:41.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3caffd640 1 -- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb3cc15fe90 msgr2=0x7fb3cc140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3caffd640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb3cc15fe90 0x7fb3cc140400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111f43a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f111806de80 con 0x7f11181472e0 2024-03-31T16:35:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3caffd640 1 -- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 msgr2=0x7fb3cc15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3caffd640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3cc0b56d0 0x7fb3cc15b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fb3caffd640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3cc13c9c0 con 0x7fb3cc145cd0 2024-03-31T16:35:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111f43a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1118162050 con 0x7f111806fe70 2024-03-31T16:35:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111f43a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f111806e000 con 0x7f1118147dd0 2024-03-31T16:35:41.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd19d9b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdd1c0d4590 0x7fdd1c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40140ce6b0 con 0x7f401415e860 2024-03-31T16:35:41.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40140cc860 con 0x7f401415e860 2024-03-31T16:35:41.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111d9d7640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f11181452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.379+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040125f0 con 0x7fcc100dfeb0 2024-03-31T16:35:41.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc04019070 con 0x7fcc100dfeb0 2024-03-31T16:35:41.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040129d0 con 0x7fcc100dfeb0 2024-03-31T16:35:41.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fb3caffd640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3cc145cd0 0x7fb3cc13c480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000e630 tx=0x7fb3c000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fcc1d31a640 1 -- 172.21.15.120:0/1211223574 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc10048bc0 con 0x7fcc100dfeb0 2024-03-31T16:35:41.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fcc1d31a640 1 -- 172.21.15.120:0/1211223574 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc10047a50 con 0x7fcc100dfeb0 2024-03-31T16:35:41.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111c9d5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11181472e0 0x7f1118140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111c9d5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11181472e0 0x7f1118140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52358/0 (socket says 172.21.15.120:52358) 2024-03-31T16:35:41.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111c9d5640 1 -- 172.21.15.120:0/2672403529 learned_addr learned my addr 172.21.15.120:0/2672403529 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f556ceeb640 1 Processor -- start 2024-03-31T16:35:41.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f556ceeb640 1 -- start start 2024-03-31T16:35:41.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f8b7359e640 1 Processor -- start 2024-03-31T16:35:41.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111c9d5640 1 -- 172.21.15.120:0/2672403529 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 msgr2=0x7f11181452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111c9d5640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1118147dd0 0x7f11181452e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111c9d5640 1 -- 172.21.15.120:0/2672403529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111806fe70 msgr2=0x7f1118161030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T16:35:41.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f111c9d5640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111806fe70 0x7f1118161030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7f111c9d5640 1 -- 172.21.15.120:0/2672403529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1118146250 con 0x7f11181472e0 2024-03-31T16:35:41.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0017070 con 0x7fb3cc145cd0 2024-03-31T16:35:41.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c000c620 con 0x7fb3cc145cd0 2024-03-31T16:35:41.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c000f040 con 0x7fb3cc145cd0 2024-03-31T16:35:41.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7fcc1d31a640 1 -- 172.21.15.120:0/1211223574 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc10048ea0 con 0x7fcc100dfeb0 2024-03-31T16:35:41.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0014620 con 0x7f18f40735c0 2024-03-31T16:35:41.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7f111c9d5640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11181472e0 0x7f1118140970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11140090b0 tx=0x7f11140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f0019070 con 0x7f18f40735c0 2024-03-31T16:35:41.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114040070 con 0x7f11181472e0 2024-03-31T16:35:41.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0014a00 con 0x7f18f40735c0 2024-03-31T16:35:41.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f18fb0fd640 1 -- 172.21.15.120:0/3561575113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f40ad770 con 0x7f18f40735c0 2024-03-31T16:35:41.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7f18fb0fd640 1 -- 172.21.15.120:0/3561575113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f40ae250 con 0x7f18f40735c0 2024-03-31T16:35:41.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7f556ceeb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55680b4d10 0x7f55681efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1114030af0 con 0x7f11181472e0 2024-03-31T16:35:41.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f556ceeb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f556815a1a0 0x7f55680cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f556659c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55680b4d10 0x7f55681efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f556659c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55680b4d10 0x7f55681efae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60642/0 (socket says 172.21.15.120:60642) 2024-03-31T16:35:41.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7f8b7359e640 1 -- start start 2024-03-31T16:35:41.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f40140685c0 con 0x7f401415e860 2024-03-31T16:35:41.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f556659c640 1 -- 172.21.15.120:0/1249136135 learned_addr learned my addr 172.21.15.120:0/1249136135 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f18fb0fd640 1 -- 172.21.15.120:0/3561575113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18dc001030 con 0x7f18f40735c0 2024-03-31T16:35:41.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f556ceeb640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f556815a580 0x7f5568142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f5565d9b640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f556815a1a0 0x7f55680cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f556806f5f0 con 0x7f556815a580 2024-03-31T16:35:41.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f556806f470 con 0x7f556815a1a0 2024-03-31T16:35:41.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f556815e980 con 0x7f55680b4d10 2024-03-31T16:35:41.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f8b7359e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b740cef20 0x7f8b7415d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f5566d9d640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f556815a580 0x7f5568142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f8b7359e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b740d3e40 0x7f8b74071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.382+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18f0014ba0 con 0x7f18f40735c0 2024-03-31T16:35:41.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b7359e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b7415e460 0x7f8b7406f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc04012b70 con 0x7fcc100dfeb0 2024-03-31T16:35:41.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b7359e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b740cf510 con 0x7f8b740cef20 2024-03-31T16:35:41.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b7359e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8b740cf390 con 0x7f8b740d3e40 2024-03-31T16:35:41.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b7359e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b740cf690 con 0x7f8b7415e460 2024-03-31T16:35:41.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f556659c640 1 -- 172.21.15.120:0/1249136135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f556815a1a0 msgr2=0x7f55680cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f556659c640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f556815a1a0 0x7f55680cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f556659c640 1 -- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f556815a580 msgr2=0x7f5568142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f556659c640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f556815a580 0x7f5568142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f556659c640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55681f0ca0 con 0x7f55680b4d10 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd1ad9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd1c15e6d0 0x7fdd1c0cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd19d9b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdd1c0d4590 0x7fdd1c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60626/0 (socket says 172.21.15.120:60626) 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd19d9b640 1 -- 172.21.15.120:0/86472780 learned_addr learned my addr 172.21.15.120:0/86472780 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd19d9b640 1 -- 172.21.15.120:0/86472780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd1c15e6d0 msgr2=0x7fdd1c0cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd19d9b640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdd1c15e6d0 0x7fdd1c0cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd19d9b640 1 -- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd1c0d0cb0 msgr2=0x7fdd1c0b3eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd19d9b640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdd1c0d0cb0 0x7fdd1c0b3eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.380+0000 7fdd19d9b640 1 -- 172.21.15.120:0/86472780 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c1f83e0 con 0x7fdd1c0d4590 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7fdd19d9b640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdd1c0d4590 0x7fdd1c0b43f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e7d0 tx=0x7fdd0c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c01d920 con 0x7fdd1c0d4590 2024-03-31T16:35:41.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c022070 con 0x7fdd1c0d4590 2024-03-31T16:35:41.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.381+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c01dce0 con 0x7fdd1c0d4590 2024-03-31T16:35:41.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f18eaffd640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18d806c9c0 0x7f18d806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b71d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b740d3e40 0x7f8b74071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b71d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b740d3e40 0x7f8b74071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43982/0 (socket says 172.21.15.120:43982) 2024-03-31T16:35:41.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b71d9b640 1 -- 172.21.15.120:0/953653701 learned_addr learned my addr 172.21.15.120:0/953653701 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f18f008c290 con 0x7f18f40735c0 2024-03-31T16:35:41.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f18f98fa640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18d806c9c0 0x7f18d806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b7259c640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b740cef20 0x7f8b7415d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fcc14ff9640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcbfc06c9f0 0x7fcbfc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fcc17fff640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcbfc06c9f0 0x7fcbfc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcc0408bff0 con 0x7fcc100dfeb0 2024-03-31T16:35:41.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fcc14ff9640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7fcbfc074c70 0x7fcbfc077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 --> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc0400af30 con 0x7fcbfc074c70 2024-03-31T16:35:41.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcc0408c3e0 con 0x7fcc100dfeb0 2024-03-31T16:35:41.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3cc13cc40 con 0x7fb3cc145cd0 2024-03-31T16:35:41.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3cc1e6040 con 0x7fb3cc145cd0 2024-03-31T16:35:41.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f18eaffd640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f18d8074c40 0x7f18d8077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 --> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18f000ce50 con 0x7f18d8074c40 2024-03-31T16:35:41.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f18f0093050 con 0x7f18f40735c0 2024-03-31T16:35:41.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f18fa8fc640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f18d8074c40 0x7f18d8077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b71d9b640 1 -- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b7415e460 msgr2=0x7f8b7406f2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-31T16:35:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b71d9b640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b7415e460 0x7f8b7406f2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b71d9b640 1 -- 172.21.15.120:0/953653701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b740cef20 msgr2=0x7f8b7415d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b71d9b640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b740cef20 0x7f8b7415d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f8b71d9b640 1 -- 172.21.15.120:0/953653701 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b74070f50 con 0x7f8b740d3e40 2024-03-31T16:35:41.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7fcc177fe640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7fcbfc074c70 0x7fcbfc077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f556659c640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55680b4d10 0x7f55681efae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5558000c00 tx=0x7f55580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f18f98fa640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18d806c9c0 0x7f18d806ee80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18f4163eb0 tx=0x7f18ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c1f86c0 con 0x7fdd1c0d4590 2024-03-31T16:35:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4004018070 con 0x7f401415e860 2024-03-31T16:35:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.383+0000 7f400a7fc640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3ff806c9f0 0x7f3ff806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f400408b9f0 con 0x7f401415e860 2024-03-31T16:35:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f400a7fc640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f3ff8074c70 0x7f3ff8077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 --> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ff8077740 con 0x7f3ff8074c70 2024-03-31T16:35:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f40040902a0 con 0x7f401415e860 2024-03-31T16:35:41.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c1f8c80 con 0x7fdd1c0d4590 2024-03-31T16:35:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114035040 con 0x7f11181472e0 2024-03-31T16:35:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f40198ad640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3ff806c9f0 0x7f3ff806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f8b71d9b640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b740d3e40 0x7f8b74071ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b640098b0 tx=0x7f8b640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111815ff90 con 0x7f11181472e0 2024-03-31T16:35:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f18fa8fc640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f18d8074c40 0x7f18d8077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1118160550 con 0x7f11181472e0 2024-03-31T16:35:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558035040 con 0x7f55680b4d10 2024-03-31T16:35:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55580078d0 con 0x7f55680b4d10 2024-03-31T16:35:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558007cc0 con 0x7f55680b4d10 2024-03-31T16:35:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f40190ac640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f3ff8074c70 0x7f3ff8077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3cc075940 con 0x7fb3cc145cd0 2024-03-31T16:35:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7fcc17fff640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcbfc06c9f0 0x7fcbfc06eeb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc1004f1f0 tx=0x7fcc180ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64049070 con 0x7f8b740d3e40 2024-03-31T16:35:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.385+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b64039c90 con 0x7f8b740d3e40 2024-03-31T16:35:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.385+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 <== osd.6 v2:172.21.15.203:6824/3768882466 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18f000ce50 con 0x7f18d8074c40 2024-03-31T16:35:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.385+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64034040 con 0x7f8b740d3e40 2024-03-31T16:35:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1118075940 con 0x7f11181472e0 2024-03-31T16:35:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.384+0000 7fcc177fe640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7fcbfc074c70 0x7fcbfc077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd1c1f8190 con 0x7fdd1c0d4590 2024-03-31T16:35:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7f40198ad640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3ff806c9f0 0x7f3ff806eeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f400c001630 tx=0x7f400c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7f8b7359e640 1 -- 172.21.15.120:0/953653701 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b74071230 con 0x7f8b740d3e40 2024-03-31T16:35:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 <== osd.0 v2:172.21.15.120:6808/220044353 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc0400af30 con 0x7fcbfc074c70 2024-03-31T16:35:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7f8b7359e640 1 -- 172.21.15.120:0/953653701 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b740717f0 con 0x7f8b740d3e40 2024-03-31T16:35:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3c001a070 con 0x7fb3cc145cd0 2024-03-31T16:35:41.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd0c00c940 con 0x7fdd1c0d4590 2024-03-31T16:35:41.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55681f01a0 con 0x7f55680b4d10 2024-03-31T16:35:41.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55681f0760 con 0x7f55680b4d10 2024-03-31T16:35:41.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7f40190ac640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f3ff8074c70 0x7f3ff8077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fdd0affd640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcfc06c9c0 0x7fdcfc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdd0c094670 con 0x7fdd1c0d4590 2024-03-31T16:35:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.386+0000 7fb3b3fff640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb3b8070d50 0x7fb3b8073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fb3cb7fe640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb3b8070d50 0x7fb3b8073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb3c0057a00 con 0x7fb3cc145cd0 2024-03-31T16:35:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fb3b3fff640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fb3b8079b80 0x7fb3b807c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3b807c6f0 con 0x7fb3b8079b80 2024-03-31T16:35:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb3c0056390 con 0x7fb3cc145cd0 2024-03-31T16:35:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fdd0affd640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fdcfc074c40 0x7fdcfc077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fb3cbfff640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fb3b8079b80 0x7fb3b807c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fdd1a59c640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcfc06c9c0 0x7fdcfc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 --> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd0c028e50 con 0x7fdcfc074c40 2024-03-31T16:35:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdd0c09b050 con 0x7fdd1c0d4590 2024-03-31T16:35:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fdd1ad9d640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fdcfc074c40 0x7fdcfc077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5568075940 con 0x7f55680b4d10 2024-03-31T16:35:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7fb3cb7fe640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb3b8070d50 0x7fb3b8073210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0cf3e0 tx=0x7fb3bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.387+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b74075940 con 0x7f8b740d3e40 2024-03-31T16:35:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f111404b060 con 0x7f11181472e0 2024-03-31T16:35:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7fb3cbfff640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fb3b8079b80 0x7fb3b807c020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7fdd1ad9d640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fdcfc074c40 0x7fdcfc077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7fdd1a59c640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcfc06c9c0 0x7fdcfc06ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd10036000 tx=0x7fdd10008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 <== osd.4 v2:172.21.15.203:6800/1708181719 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ff8077740 con 0x7f3ff8074c70 2024-03-31T16:35:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7f110dffb640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f10fc06c970 0x7f10fc06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5558038020 con 0x7f55680b4d10 2024-03-31T16:35:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b6404c070 con 0x7f8b740d3e40 2024-03-31T16:35:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7f8b62ffd640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b5406c9c0 0x7f8b5406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8b640ad900 con 0x7f8b740d3e40 2024-03-31T16:35:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7f8b62ffd640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7f8b54074b60 0x7f8b54076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 --> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b54077630 con 0x7f8b54074b60 2024-03-31T16:35:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 <== osd.5 v2:172.21.15.203:6808/887331617 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3b807c6f0 con 0x7fb3b8079b80 2024-03-31T16:35:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 <== osd.2 v2:172.21.15.120:6820/261148039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd0c028e50 con 0x7fdcfc074c40 2024-03-31T16:35:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.390+0000 7f5556ffd640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f554806c9c0 0x7f554806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.390+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f55580ae5f0 con 0x7f55680b4d10 2024-03-31T16:35:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.390+0000 7f5556ffd640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f5548074be0 0x7f5548077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.390+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55480776b0 con 0x7f5548074be0 2024-03-31T16:35:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.390+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f55580ae9e0 con 0x7f55680b4d10 2024-03-31T16:35:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.390+0000 7f5565d9b640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f554806c9c0 0x7f554806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1114079a90 con 0x7f11181472e0 2024-03-31T16:35:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7f111d1d6640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f10fc06c970 0x7f10fc06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7f110dffb640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f10fc0757a0 0x7f10fc077c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.388+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 --> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10fc078310 con 0x7f10fc0757a0 2024-03-31T16:35:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.390+0000 7f5566d9d640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f5548074be0 0x7f5548077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.391+0000 7f5565d9b640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f554806c9c0 0x7f554806ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5568154720 tx=0x7f5560007770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7f111d9d7640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f10fc0757a0 0x7f10fc077c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7f111d1d6640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f10fc06c970 0x7f10fc06ee30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1110000b60 tx=0x7f111000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.391+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8b640779f0 con 0x7f8b740d3e40 2024-03-31T16:35:41.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.389+0000 7f111d9d7640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f10fc0757a0 0x7f10fc077c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.391+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1114078420 con 0x7f11181472e0 2024-03-31T16:35:41.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.391+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 <== osd.1 v2:172.21.15.120:6800/2143054953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10fc078310 con 0x7f10fc0757a0 2024-03-31T16:35:41.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.391+0000 7f8b7259c640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b5406c9c0 0x7f8b5406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.392+0000 7f8b7259c640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b5406c9c0 0x7f8b5406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c005c00 tx=0x7f8b6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.391+0000 7f5566d9d640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f5548074be0 0x7f5548077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.392+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 <== osd.3 v2:172.21.15.120:6816/404626686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f55480776b0 con 0x7f5548074be0 2024-03-31T16:35:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.392+0000 7f8b72d9d640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7f8b54074b60 0x7f8b54076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.393+0000 7f8b72d9d640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7f8b54074b60 0x7f8b54076f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.393+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 <== osd.7 v2:172.21.15.203:6816/2676384654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b54077630 con 0x7f8b54074b60 2024-03-31T16:35:41.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.415+0000 7f18fb0fd640 1 -- 172.21.15.120:0/3561575113 --> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18dc002dd0 con 0x7f18d8074c40 2024-03-31T16:35:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.416+0000 7f18eaffd640 1 -- 172.21.15.120:0/3561575113 <== osd.6 v2:172.21.15.203:6824/3768882466 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f18dc002dd0 con 0x7f18d8074c40 2024-03-31T16:35:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.416+0000 7f18e8ff9640 1 -- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f18d8074c40 msgr2=0x7f18d8077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.416+0000 7f18e8ff9640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f18d8074c40 0x7f18d8077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.416+0000 7f18e8ff9640 1 -- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18d806c9c0 msgr2=0x7f18d806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.416+0000 7f18e8ff9640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18d806c9c0 0x7f18d806ee80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18f4163eb0 tx=0x7f18ec009040 comp rx=0 tx=0).stop 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.416+0000 7f18e8ff9640 1 -- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f40735c0 msgr2=0x7f18f4201790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.416+0000 7f18e8ff9640 1 --2- 172.21.15.120:0/3561575113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f40735c0 0x7f18f4201790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18f0007e40 tx=0x7f18f000e4b0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.416+0000 7f18fa8fc640 1 -- 172.21.15.120:0/3561575113 reap_dead start 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.417+0000 7f18e8ff9640 1 -- 172.21.15.120:0/3561575113 shutdown_connections 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.417+0000 7f18e8ff9640 1 -- 172.21.15.120:0/3561575113 >> 172.21.15.120:0/3561575113 conn(0x7f18f40b1ba0 msgr2=0x7f18f4164950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.418+0000 7f18e8ff9640 1 -- 172.21.15.120:0/3561575113 shutdown_connections 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.418+0000 7f18e8ff9640 1 -- 172.21.15.120:0/3561575113 wait complete. 2024-03-31T16:35:41.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.418+0000 7fcc1d31a640 1 -- 172.21.15.120:0/1211223574 --> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc10005380 con 0x7fcbfc074c70 2024-03-31T16:35:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.418+0000 7fcc14ff9640 1 -- 172.21.15.120:0/1211223574 <== osd.0 v2:172.21.15.120:6808/220044353 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc10005380 con 0x7fcbfc074c70 2024-03-31T16:35:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 --> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f40140cccf0 con 0x7f3ff8074c70 2024-03-31T16:35:41.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7fcc027fc640 1 -- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7fcbfc074c70 msgr2=0x7fcbfc077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7fcc027fc640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7fcbfc074c70 0x7fcbfc077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7fcc027fc640 1 -- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcbfc06c9f0 msgr2=0x7fcbfc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7fcc027fc640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcbfc06c9f0 0x7fcbfc06eeb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc1004f1f0 tx=0x7fcc180ab000 comp rx=0 tx=0).stop 2024-03-31T16:35:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7fcc027fc640 1 -- 172.21.15.120:0/1211223574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc100dfeb0 msgr2=0x7fcc100c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7fcc027fc640 1 --2- 172.21.15.120:0/1211223574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc100dfeb0 0x7fcc100c9a50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400d5d0 tx=0x7fcc0400da90 comp rx=0 tx=0).stop 2024-03-31T16:35:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7fcc1cb19640 1 -- 172.21.15.120:0/1211223574 reap_dead start 2024-03-31T16:35:41.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.420+0000 7f400a7fc640 1 -- 172.21.15.120:0/3791612268 <== osd.4 v2:172.21.15.203:6800/1708181719 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f40140cccf0 con 0x7f3ff8074c70 2024-03-31T16:35:41.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7fcc027fc640 1 -- 172.21.15.120:0/1211223574 shutdown_connections 2024-03-31T16:35:41.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7fcc027fc640 1 -- 172.21.15.120:0/1211223574 >> 172.21.15.120:0/1211223574 conn(0x7fcc10009fa0 msgr2=0x7fcc100506e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 --> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb3cc13e070 con 0x7fb3b8079b80 2024-03-31T16:35:41.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 --> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd1c0b6c70 con 0x7fdcfc074c40 2024-03-31T16:35:41.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f3ff8074c70 msgr2=0x7f3ff8077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7f401bb11640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f3ff8074c70 0x7f3ff8077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7fb3b3fff640 1 -- 172.21.15.120:0/2422027860 <== osd.5 v2:172.21.15.203:6808/887331617 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb3cc13e070 con 0x7fb3b8079b80 2024-03-31T16:35:41.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 --> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b740d02b0 con 0x7f8b54074b60 2024-03-31T16:35:41.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3ff806c9f0 msgr2=0x7f3ff806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7f401bb11640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3ff806c9f0 0x7f3ff806eeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f400c001630 tx=0x7f400c009040 comp rx=0 tx=0).stop 2024-03-31T16:35:41.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f401415e860 msgr2=0x7f40141f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.421+0000 7f401bb11640 1 --2- 172.21.15.120:0/3791612268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f401415e860 0x7f40141f4a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f400400c7f0 tx=0x7f400400ccb0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7f401a0ae640 1 -- 172.21.15.120:0/3791612268 reap_dead start 2024-03-31T16:35:41.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 shutdown_connections 2024-03-31T16:35:41.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 >> 172.21.15.120:0/3791612268 conn(0x7f401409d7d0 msgr2=0x7f40140b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fdd0affd640 1 -- 172.21.15.120:0/86472780 <== osd.2 v2:172.21.15.120:6820/261148039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdd1c0b6c70 con 0x7fdcfc074c40 2024-03-31T16:35:41.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 shutdown_connections 2024-03-31T16:35:41.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7f401bb11640 1 -- 172.21.15.120:0/3791612268 wait complete. 2024-03-31T16:35:41.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fb3b8079b80 msgr2=0x7fb3b807c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3d0e90640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fb3b8079b80 0x7fb3b807c020 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fcc027fc640 1 -- 172.21.15.120:0/1211223574 shutdown_connections 2024-03-31T16:35:41.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fcc027fc640 1 -- 172.21.15.120:0/1211223574 wait complete. 2024-03-31T16:35:41.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb3b8070d50 msgr2=0x7fb3b8073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3d0e90640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb3b8070d50 0x7fb3b8073210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0cf3e0 tx=0x7fb3bc009040 comp rx=0 tx=0).stop 2024-03-31T16:35:41.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7f8b62ffd640 1 -- 172.21.15.120:0/953653701 <== osd.7 v2:172.21.15.203:6816/2676384654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b740d02b0 con 0x7f8b54074b60 2024-03-31T16:35:41.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3cc145cd0 msgr2=0x7fb3cc13c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3d0e90640 1 --2- 172.21.15.120:0/2422027860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3cc145cd0 0x7fb3cc13c480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000e630 tx=0x7fb3c000eaf0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fdcfc074c40 msgr2=0x7fdcfc077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fdd20dcd640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fdcfc074c40 0x7fdcfc077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3cbfff640 1 -- 172.21.15.120:0/2422027860 reap_dead start 2024-03-31T16:35:41.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 shutdown_connections 2024-03-31T16:35:41.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 >> 172.21.15.120:0/2422027860 conn(0x7fb3cc067280 msgr2=0x7fb3cc143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcfc06c9c0 msgr2=0x7fdcfc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.422+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7f8b54074b60 msgr2=0x7f8b54076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7f8b54074b60 0x7f8b54076f80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fdd20dcd640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcfc06c9c0 0x7fdcfc06ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd10036000 tx=0x7fdd10008030 comp rx=0 tx=0).stop 2024-03-31T16:35:41.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdd1c0d4590 msgr2=0x7fdd1c0b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fdd20dcd640 1 --2- 172.21.15.120:0/86472780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdd1c0d4590 0x7fdd1c0b43f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e7d0 tx=0x7fdd0c00ec90 comp rx=0 tx=0).stop 2024-03-31T16:35:41.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fdd1ad9d640 1 -- 172.21.15.120:0/86472780 reap_dead start 2024-03-31T16:35:41.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b5406c9c0 msgr2=0x7f8b5406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b5406c9c0 0x7f8b5406ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c005c00 tx=0x7f8b6c009040 comp rx=0 tx=0).stop 2024-03-31T16:35:41.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b740d3e40 msgr2=0x7f8b74071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 --2- 172.21.15.120:0/953653701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b740d3e40 0x7f8b74071ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b640098b0 tx=0x7f8b640046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b72d9d640 1 -- 172.21.15.120:0/953653701 reap_dead start 2024-03-31T16:35:41.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 shutdown_connections 2024-03-31T16:35:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 >> 172.21.15.120:0/953653701 conn(0x7f8b740678b0 msgr2=0x7f8b740b8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 shutdown_connections 2024-03-31T16:35:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 >> 172.21.15.120:0/86472780 conn(0x7fdd1c09d7b0 msgr2=0x7fdd1c0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 shutdown_connections 2024-03-31T16:35:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 --> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1118075940 con 0x7f10fc0757a0 2024-03-31T16:35:41.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7f8b60ff9640 1 -- 172.21.15.120:0/953653701 wait complete. 2024-03-31T16:35:41.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 shutdown_connections 2024-03-31T16:35:41.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.423+0000 7fb3d0e90640 1 -- 172.21.15.120:0/2422027860 wait complete. 2024-03-31T16:35:41.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.424+0000 7f110dffb640 1 -- 172.21.15.120:0/2672403529 <== osd.1 v2:172.21.15.120:6800/2143054953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1118075940 con 0x7f10fc0757a0 2024-03-31T16:35:41.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.424+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 shutdown_connections 2024-03-31T16:35:41.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.424+0000 7fdd20dcd640 1 -- 172.21.15.120:0/86472780 wait complete. 2024-03-31T16:35:41.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.425+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 --> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5568075940 con 0x7f5548074be0 2024-03-31T16:35:41.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.425+0000 7f5556ffd640 1 -- 172.21.15.120:0/1249136135 <== osd.3 v2:172.21.15.120:6816/404626686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5568075940 con 0x7f5548074be0 2024-03-31T16:35:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.426+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f10fc0757a0 msgr2=0x7f10fc077c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.426+0000 7f111f43a640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f10fc0757a0 0x7f10fc077c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.426+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f10fc06c970 msgr2=0x7f10fc06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.426+0000 7f111f43a640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f10fc06c970 0x7f10fc06ee30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1110000b60 tx=0x7f111000b040 comp rx=0 tx=0).stop 2024-03-31T16:35:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.426+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11181472e0 msgr2=0x7f1118140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.426+0000 7f111f43a640 1 --2- 172.21.15.120:0/2672403529 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f11181472e0 0x7f1118140970 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11140090b0 tx=0x7f11140046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.426+0000 7f111d9d7640 1 -- 172.21.15.120:0/2672403529 reap_dead start 2024-03-31T16:35:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.426+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f5548074be0 msgr2=0x7f5548077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 shutdown_connections 2024-03-31T16:35:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 >> 172.21.15.120:0/2672403529 conn(0x7f11180b3ca0 msgr2=0x7f11180715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f556ceeb640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f5548074be0 0x7f5548077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f554806c9c0 msgr2=0x7f554806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f556ceeb640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f554806c9c0 0x7f554806ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5568154720 tx=0x7f5560007770 comp rx=0 tx=0).stop 2024-03-31T16:35:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55680b4d10 msgr2=0x7f55681efae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f556ceeb640 1 --2- 172.21.15.120:0/1249136135 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f55680b4d10 0x7f55681efae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5558000c00 tx=0x7f55580046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f5566d9d640 1 -- 172.21.15.120:0/1249136135 reap_dead start 2024-03-31T16:35:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 shutdown_connections 2024-03-31T16:35:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 >> 172.21.15.120:0/1249136135 conn(0x7f556806b960 msgr2=0x7f5568157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.427+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 shutdown_connections 2024-03-31T16:35:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.428+0000 7f111f43a640 1 -- 172.21.15.120:0/2672403529 wait complete. 2024-03-31T16:35:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.428+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 shutdown_connections 2024-03-31T16:35:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.428+0000 7f556ceeb640 1 -- 172.21.15.120:0/1249136135 wait complete. 2024-03-31T16:35:41.490 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-03-31T16:35:41.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-31T16:35:41.491 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-03-31T16:35:41.491 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-31T16:35:41.492 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2024-03-31T16:35:41.493 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-31T16:35:41.493 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-03-31T16:35:41.493 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-31T16:35:41.494 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-03-31T16:35:41.494 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-31T16:35:41.495 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2024-03-31T16:35:41.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-31T16:35:41.496 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2024-03-31T16:35:41.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-31T16:35:41.497 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2024-03-31T16:35:41.497 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-31T16:35:41.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.697+0000 7fe32a738640 1 Processor -- start 2024-03-31T16:35:41.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.697+0000 7fe32a738640 1 -- start start 2024-03-31T16:35:41.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7fe32a738640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe32415e860 0x7fe32406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7fe32a738640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe32406da30 0x7fe3240d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7fe32a738640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32406dfa0 con 0x7fe3240d4910 2024-03-31T16:35:41.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7fe32a738640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe3240d4d60 con 0x7fe32415e860 2024-03-31T16:35:41.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7fe32a738640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240cf220 con 0x7fe32406da30 2024-03-31T16:35:41.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7efd7721b640 1 Processor -- start 2024-03-31T16:35:41.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7fe328cd5640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe3240d4910 0x7fe3240d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53252/0 (socket says 172.21.15.120:53252) 2024-03-31T16:35:41.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7fe328cd5640 1 -- 172.21.15.120:0/748373581 learned_addr learned my addr 172.21.15.120:0/748373581 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:41.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fe323fff640 1 --2- 172.21.15.120:0/748373581 >> v2:172.21.15.203:3300/0 conn(0x7fe32415e860 0x7fe32406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fe3237fe640 1 --2- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe32406da30 0x7fe3240d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.698+0000 7efd7721b640 1 -- start start 2024-03-31T16:35:41.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7f0a1b59e640 1 Processor -- start 2024-03-31T16:35:41.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7f0a1b59e640 1 -- start start 2024-03-31T16:35:41.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fe323fff640 1 -- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe32406da30 msgr2=0x7fe3240d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fe323fff640 1 --2- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe32406da30 0x7fe3240d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fe323fff640 1 -- 172.21.15.120:0/748373581 >> v1:172.21.15.120:6789/0 conn(0x7fe3240d4910 legacy=0x7fe3240d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fe323fff640 1 -- 172.21.15.120:0/748373581 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32406e240 con 0x7fe32415e860 2024-03-31T16:35:41.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fabee4d3640 1 Processor -- start 2024-03-31T16:35:41.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fabee4d3640 1 -- start start 2024-03-31T16:35:41.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fb693e55640 1 Processor -- start 2024-03-31T16:35:41.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7fe3237fe640 1 --2- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe32406da30 0x7fe3240d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7f9e28e43640 1 Processor -- start 2024-03-31T16:35:41.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7f9e28e43640 1 -- start start 2024-03-31T16:35:41.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd7721b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efd70162b80 0x7efd700cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd7721b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd700b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd7721b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd700d0470 con 0x7efd700b6750 2024-03-31T16:35:41.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd7721b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7efd70162f60 con 0x7efd70162b80 2024-03-31T16:35:41.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd7721b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd700cf700 con 0x7efd7006cc90 2024-03-31T16:35:41.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7fabee4d3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fabe815b260 0x7fabe80b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd6ffff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7efd700b6750 0x7efd7006c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53264/0 (socket says 172.21.15.120:53264) 2024-03-31T16:35:41.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd6ffff640 1 -- 172.21.15.120:0/3065872375 learned_addr learned my addr 172.21.15.120:0/3065872375 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:41.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd757b8640 1 --2- 172.21.15.120:0/3065872375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd700b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7fb693e55640 1 -- start start 2024-03-31T16:35:41.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7f2b01f6d640 1 Processor -- start 2024-03-31T16:35:41.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.699+0000 7f2b01f6d640 1 -- start start 2024-03-31T16:35:41.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7efd74fb7640 1 --2- 172.21.15.120:0/3065872375 >> v2:172.21.15.120:3300/0 conn(0x7efd70162b80 0x7efd700cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7f0a1b59e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a140e30c0 0x7f0a14057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7f0a1b59e640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0a1403e840 0x7f0a14053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7f0a1b59e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a140582d0 con 0x7f0a14054130 2024-03-31T16:35:41.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7f0a1b59e640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0a14058570 con 0x7f0a1403e840 2024-03-31T16:35:41.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7f0a1b59e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0a14058850 con 0x7f0a140e30c0 2024-03-31T16:35:41.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7f5323fff640 1 Processor -- start 2024-03-31T16:35:41.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7f5323fff640 1 -- start start 2024-03-31T16:35:41.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7f0a19d9b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0a1403e840 0x7f0a14053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7efd757b8640 1 -- 172.21.15.120:0/3065872375 >> v2:172.21.15.120:3300/0 conn(0x7efd70162b80 msgr2=0x7efd700cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7efd757b8640 1 --2- 172.21.15.120:0/3065872375 >> v2:172.21.15.120:3300/0 conn(0x7efd70162b80 0x7efd700cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7efd757b8640 1 -- 172.21.15.120:0/3065872375 >> v1:172.21.15.120:6789/0 conn(0x7efd700b6750 legacy=0x7efd7006c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7efd6f7fe640 1 -- 172.21.15.120:0/3065872375 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229018037 0 0) 0x7efd700d0470 con 0x7efd700b6750 2024-03-31T16:35:41.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f0a19d9b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0a1403e840 0x7f0a14053bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:44004/0 (socket says 172.21.15.120:44004) 2024-03-31T16:35:41.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7efd757b8640 1 -- 172.21.15.120:0/3065872375 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd700ce940 con 0x7efd7006cc90 2024-03-31T16:35:41.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fb693e55640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb68403e840 0x7fb684053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fb693e55640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb684058570 con 0x7fb6840e30c0 2024-03-31T16:35:41.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fb693e55640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb684058850 con 0x7fb684054130 2024-03-31T16:35:41.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fb693e55640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb6840545a0 con 0x7fb68403e840 2024-03-31T16:35:41.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e28e43640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c0ead00 0x7f9e1c04fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e28e43640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9e1c04ffd0 0x7f9e1c037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e28e43640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e1c053720 con 0x7f9e1c038110 2024-03-31T16:35:41.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e28e43640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9e1c054330 con 0x7f9e1c04ffd0 2024-03-31T16:35:41.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e28e43640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1c053a00 con 0x7f9e1c0ead00 2024-03-31T16:35:41.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fe323fff640 1 --2- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 0x7fe32406d4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3180097a0 tx=0x7fe31802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ac54201adce84e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fb6913f0640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb68403e840 0x7fb684053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e237fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c0ead00 0x7f9e1c04fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e237fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c0ead00 0x7f9e1c04fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60688/0 (socket says 172.21.15.120:60688) 2024-03-31T16:35:41.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e237fe640 1 -- 172.21.15.120:0/3721134483 learned_addr learned my addr 172.21.15.120:0/3721134483 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f9e22ffd640 1 --2- 172.21.15.120:0/3721134483 >> v2:172.21.15.203:3300/0 conn(0x7f9e1c04ffd0 0x7f9e1c037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fb6923f2640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fb684054130 0x7fb6840068d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:49852/0 (socket says 172.21.15.120:49852) 2024-03-31T16:35:41.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fb6913f0640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb68403e840 0x7fb684053bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:44018/0 (socket says 172.21.15.120:44018) 2024-03-31T16:35:41.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7fb6913f0640 1 -- 172.21.15.120:0/2061436054 learned_addr learned my addr 172.21.15.120:0/2061436054 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f0a19d9b640 1 -- 172.21.15.120:0/1125226227 learned_addr learned my addr 172.21.15.120:0/1125226227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f0a1a59c640 1 --2- 172.21.15.120:0/1125226227 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a140e30c0 0x7f0a14057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f0a19d9b640 1 -- 172.21.15.120:0/1125226227 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a140e30c0 msgr2=0x7f0a14057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f0a19d9b640 1 --2- 172.21.15.120:0/1125226227 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a140e30c0 0x7f0a14057d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f0a19d9b640 1 -- 172.21.15.120:0/1125226227 >> v1:172.21.15.203:6789/0 conn(0x7f0a14054130 legacy=0x7f0a140e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f0a19d9b640 1 -- 172.21.15.120:0/1125226227 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a14058b30 con 0x7f0a1403e840 2024-03-31T16:35:41.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f5323fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f531c054b30 0x7f531c054560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2b01f6d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2afc06fe30 0x7f2afc067280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2b01f6d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2afc1409f0 0x7f2afc06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2b01f6d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2afc06edf0 con 0x7f2afc06c580 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2b01f6d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f2afc06cf20 con 0x7f2afc1409f0 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2b01f6d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc070210 con 0x7f2afc06fe30 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2afbfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2afc1409f0 0x7f2afc06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2afbfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2afc1409f0 0x7f2afc06c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52394/0 (socket says 172.21.15.120:52394) 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2afbfff640 1 -- 172.21.15.120:0/1805445404 learned_addr learned my addr 172.21.15.120:0/1805445404 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2afaffd640 1 --1- 172.21.15.120:0/1805445404 >> v1:172.21.15.203:6789/0 conn(0x7f2afc06c580 0x7f2afc1402e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:49844/0 (socket says 172.21.15.120:49844) 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.701+0000 7f2afa7fc640 1 -- 172.21.15.120:0/1805445404 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3173239568 0 0) 0x7f2af0001110 con 0x7f2afc06c580 2024-03-31T16:35:41.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f2afa7fc640 1 -- 172.21.15.120:0/1805445404 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ae4003520 con 0x7f2afc06c580 2024-03-31T16:35:41.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f2afbfff640 1 -- 172.21.15.120:0/1805445404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2afc06fe30 msgr2=0x7f2afc067280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-31T16:35:41.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f2afbfff640 1 --2- 172.21.15.120:0/1805445404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2afc06fe30 0x7f2afc067280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f2afbfff640 1 -- 172.21.15.120:0/1805445404 >> v1:172.21.15.203:6789/0 conn(0x7f2afc06c580 legacy=0x7f2afc1402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f2afbfff640 1 -- 172.21.15.120:0/1805445404 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc06f070 con 0x7f2afc1409f0 2024-03-31T16:35:41.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fb6913f0640 1 -- 172.21.15.120:0/2061436054 >> v1:172.21.15.203:6789/0 conn(0x7fb684054130 legacy=0x7fb6840068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fb6913f0640 1 -- 172.21.15.120:0/2061436054 >> v1:172.21.15.120:6789/0 conn(0x7fb6840e30c0 legacy=0x7fb684057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fb6913f0640 1 -- 172.21.15.120:0/2061436054 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb684058b30 con 0x7fb68403e840 2024-03-31T16:35:41.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f9e237fe640 1 -- 172.21.15.120:0/3721134483 >> v2:172.21.15.203:3300/0 conn(0x7f9e1c04ffd0 msgr2=0x7f9e1c037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f9e237fe640 1 --2- 172.21.15.120:0/3721134483 >> v2:172.21.15.203:3300/0 conn(0x7f9e1c04ffd0 0x7f9e1c037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f9e237fe640 1 -- 172.21.15.120:0/3721134483 >> v1:172.21.15.120:6789/0 conn(0x7f9e1c038110 legacy=0x7f9e1c0385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f9e237fe640 1 -- 172.21.15.120:0/3721134483 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1c053ce0 con 0x7f9e1c0ead00 2024-03-31T16:35:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7efd74fb7640 1 --2- 172.21.15.120:0/3065872375 >> v2:172.21.15.120:3300/0 conn(0x7efd70162b80 0x7efd700cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:41.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f0a19d9b640 1 --2- 172.21.15.120:0/1125226227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a1403e840 0x7f0a14053bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009870 tx=0x7f0a1002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e507d9c538dc25 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fe322ffd640 1 -- 172.21.15.120:0/748373581 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318037070 con 0x7fe32415e860 2024-03-31T16:35:41.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fe322ffd640 1 -- 172.21.15.120:0/748373581 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe318030710 con 0x7fe32415e860 2024-03-31T16:35:41.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fe322ffd640 1 -- 172.21.15.120:0/748373581 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318030ae0 con 0x7fe32415e860 2024-03-31T16:35:41.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7efd757b8640 1 --2- 172.21.15.120:0/3065872375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd700b49b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd68009d90 tx=0x7efd6802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=671ee1219c22ea34 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f0a1959a640 1 -- 172.21.15.120:0/1125226227 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10038070 con 0x7f0a1403e840 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f0a1959a640 1 -- 172.21.15.120:0/1125226227 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10031520 con 0x7f0a1403e840 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f0a1959a640 1 -- 172.21.15.120:0/1125226227 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a100318f0 con 0x7f0a1403e840 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7fabee4d3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe815b640 0x7fabe80affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7fabee4d3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabe815ff50 con 0x7fabe80b45f0 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7fabee4d3640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fabe80afb70 con 0x7fabe815b260 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.700+0000 7fabee4d3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fabe815f340 con 0x7fabe815b640 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fabe7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fabe815b260 0x7fabe80b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fabe7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fabe815b260 0x7fabe80b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52406/0 (socket says 172.21.15.120:52406) 2024-03-31T16:35:41.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fabe7fff640 1 -- 172.21.15.120:0/3702078304 learned_addr learned my addr 172.21.15.120:0/3702078304 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7fabe77fe640 1 --2- 172.21.15.120:0/3702078304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe815b640 0x7fabe80affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fabe77fe640 1 -- 172.21.15.120:0/3702078304 >> v2:172.21.15.120:3300/0 conn(0x7fabe815b260 msgr2=0x7fabe80b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fabe77fe640 1 --2- 172.21.15.120:0/3702078304 >> v2:172.21.15.120:3300/0 conn(0x7fabe815b260 0x7fabe80b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fabe77fe640 1 -- 172.21.15.120:0/3702078304 >> v1:172.21.15.120:6789/0 conn(0x7fabe80b45f0 legacy=0x7fabe80d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f5323fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f5323fff640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531c050220 con 0x7f531c0e7640 2024-03-31T16:35:41.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fb6913f0640 1 --2- 172.21.15.120:0/2061436054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68403e840 0x7fb684053bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb68c063110 tx=0x7fb68c0a71d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62ae7619cd19553 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f5323fff640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f531c053970 con 0x7f531c054b30 2024-03-31T16:35:41.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f5323fff640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f531c054210 con 0x7f531c04fbe0 2024-03-31T16:35:41.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f53237fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f53237fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60706/0 (socket says 172.21.15.120:60706) 2024-03-31T16:35:41.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f53237fe640 1 -- 172.21.15.120:0/2821715663 learned_addr learned my addr 172.21.15.120:0/2821715663 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f9e237fe640 1 --2- 172.21.15.120:0/3721134483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c0ead00 0x7f9e1c04fa90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009870 tx=0x7f9e1802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4062aebe9bf34735 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f53227fc640 1 --2- 172.21.15.120:0/2821715663 >> v2:172.21.15.120:3300/0 conn(0x7f531c054b30 0x7f531c054560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f53227fc640 1 -- 172.21.15.120:0/2821715663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 msgr2=0x7f531c0063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:41.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f53227fc640 1 --2- 172.21.15.120:0/2821715663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f53227fc640 1 -- 172.21.15.120:0/2821715663 >> v1:172.21.15.120:6789/0 conn(0x7f531c0e7640 legacy=0x7f531c04f4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-31T16:35:41.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.702+0000 7f53227fc640 1 -- 172.21.15.120:0/2821715663 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0485c0 con 0x7f531c054b30 2024-03-31T16:35:41.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f53237fe640 1 --2- 172.21.15.120:0/2821715663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:41.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fabe77fe640 1 -- 172.21.15.120:0/3702078304 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe815f620 con 0x7fabe815b640 2024-03-31T16:35:41.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7efd6f7fe640 1 -- 172.21.15.120:0/3065872375 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68039070 con 0x7efd7006cc90 2024-03-31T16:35:41.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fb690bef640 1 -- 172.21.15.120:0/2061436054 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0b4070 con 0x7fb68403e840 2024-03-31T16:35:41.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fb690bef640 1 -- 172.21.15.120:0/2061436054 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c0af680 con 0x7fb68403e840 2024-03-31T16:35:41.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fb690bef640 1 -- 172.21.15.120:0/2061436054 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0afaf0 con 0x7fb68403e840 2024-03-31T16:35:41.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7efd6f7fe640 1 -- 172.21.15.120:0/3065872375 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6802cc80 con 0x7efd7006cc90 2024-03-31T16:35:41.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7efd6f7fe640 1 -- 172.21.15.120:0/3065872375 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68034660 con 0x7efd7006cc90 2024-03-31T16:35:41.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f9e227fc640 1 -- 172.21.15.120:0/3721134483 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18034070 con 0x7f9e1c0ead00 2024-03-31T16:35:41.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f9e227fc640 1 -- 172.21.15.120:0/3721134483 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e18030840 con 0x7f9e1c0ead00 2024-03-31T16:35:41.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f9e227fc640 1 -- 172.21.15.120:0/3721134483 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18030c10 con 0x7f9e1c0ead00 2024-03-31T16:35:41.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f2afbfff640 1 --2- 172.21.15.120:0/1805445404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc06c9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00ffd0 tx=0x7f2aec02c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498f6370a356a212 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f2afa7fc640 1 -- 172.21.15.120:0/1805445404 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec039070 con 0x7f2afc1409f0 2024-03-31T16:35:41.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f2afa7fc640 1 -- 172.21.15.120:0/1805445404 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aec034640 con 0x7f2afc1409f0 2024-03-31T16:35:41.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7f2afa7fc640 1 -- 172.21.15.120:0/1805445404 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec034a10 con 0x7f2afc1409f0 2024-03-31T16:35:41.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fabe7fff640 1 --2- 172.21.15.120:0/3702078304 >> v2:172.21.15.120:3300/0 conn(0x7fabe815b260 0x7fabe80b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:41.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f0a1b59e640 1 -- 172.21.15.120:0/1125226227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a1403e840 msgr2=0x7f0a14053bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/1125226227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a1403e840 0x7f0a14053bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009870 tx=0x7f0a1002b840 comp rx=0 tx=0).stop 2024-03-31T16:35:41.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f53227fc640 1 --2- 172.21.15.120:0/2821715663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 0x7f531c054560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5324050b20 tx=0x7f53240a6f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f834fdd7dd3ab92c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fe32a738640 1 -- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 msgr2=0x7fe32406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.703+0000 7fe32a738640 1 --2- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 0x7fe32406d4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3180097a0 tx=0x7fe31802b710 comp rx=0 tx=0).stop 2024-03-31T16:35:41.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f5321ffb640 1 -- 172.21.15.120:0/2821715663 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240b4070 con 0x7f531c054b30 2024-03-31T16:35:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f5321ffb640 1 -- 172.21.15.120:0/2821715663 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53240a7db0 con 0x7f531c054b30 2024-03-31T16:35:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f5321ffb640 1 -- 172.21.15.120:0/2821715663 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53240af640 con 0x7f531c054b30 2024-03-31T16:35:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f0a1b59e640 1 -- 172.21.15.120:0/1125226227 shutdown_connections 2024-03-31T16:35:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/1125226227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a1403e840 0x7f0a14053bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/1125226227 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a140e30c0 0x7f0a14057d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f0a1b59e640 1 -- 172.21.15.120:0/1125226227 >> 172.21.15.120:0/1125226227 conn(0x7f0a140559e0 msgr2=0x7f0a14055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f0a1b59e640 1 -- 172.21.15.120:0/1125226227 shutdown_connections 2024-03-31T16:35:41.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f0a1b59e640 1 -- 172.21.15.120:0/1125226227 wait complete. 2024-03-31T16:35:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fe32a738640 1 -- 172.21.15.120:0/748373581 shutdown_connections 2024-03-31T16:35:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fe32a738640 1 --2- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe32406da30 0x7fe3240d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fe32a738640 1 --2- 172.21.15.120:0/748373581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 0x7fe32406d4f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fe32a738640 1 -- 172.21.15.120:0/748373581 >> 172.21.15.120:0/748373581 conn(0x7fe32409d7d0 msgr2=0x7fe32408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f9e28e43640 1 -- 172.21.15.120:0/3721134483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c0ead00 msgr2=0x7f9e1c04fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f9e28e43640 1 --2- 172.21.15.120:0/3721134483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c0ead00 0x7f9e1c04fa90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009870 tx=0x7f9e1802b980 comp rx=0 tx=0).stop 2024-03-31T16:35:41.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fb693e55640 1 -- 172.21.15.120:0/2061436054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68403e840 msgr2=0x7fb684053bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fb693e55640 1 --2- 172.21.15.120:0/2061436054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68403e840 0x7fb684053bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb68c063110 tx=0x7fb68c0a71d0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f9e28e43640 1 -- 172.21.15.120:0/3721134483 shutdown_connections 2024-03-31T16:35:41.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f9e28e43640 1 --2- 172.21.15.120:0/3721134483 >> v2:172.21.15.203:3300/0 conn(0x7f9e1c04ffd0 0x7f9e1c037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f9e28e43640 1 --2- 172.21.15.120:0/3721134483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c0ead00 0x7f9e1c04fa90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f9e28e43640 1 -- 172.21.15.120:0/3721134483 >> 172.21.15.120:0/3721134483 conn(0x7f9e1c009fb0 msgr2=0x7f9e1c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f9e28e43640 1 -- 172.21.15.120:0/3721134483 shutdown_connections 2024-03-31T16:35:41.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fe32a738640 1 -- 172.21.15.120:0/748373581 shutdown_connections 2024-03-31T16:35:41.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7efd7721b640 1 -- 172.21.15.120:0/3065872375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 msgr2=0x7efd700b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7efd7721b640 1 --2- 172.21.15.120:0/3065872375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd700b49b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd68009d90 tx=0x7efd6802bed0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fe32a738640 1 -- 172.21.15.120:0/748373581 wait complete. 2024-03-31T16:35:41.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f9e28e43640 1 -- 172.21.15.120:0/3721134483 wait complete. 2024-03-31T16:35:41.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f2b01f6d640 1 -- 172.21.15.120:0/1805445404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 msgr2=0x7f2afc06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/1805445404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc06c9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00ffd0 tx=0x7f2aec02c260 comp rx=0 tx=0).stop 2024-03-31T16:35:41.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fb693e55640 1 -- 172.21.15.120:0/2061436054 shutdown_connections 2024-03-31T16:35:41.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fb693e55640 1 --2- 172.21.15.120:0/2061436054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb68403e840 0x7fb684053bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.704+0000 7fb693e55640 1 -- 172.21.15.120:0/2061436054 >> 172.21.15.120:0/2061436054 conn(0x7fb6840559e0 msgr2=0x7fb684055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7efd7721b640 1 -- 172.21.15.120:0/3065872375 shutdown_connections 2024-03-31T16:35:41.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7efd7721b640 1 --2- 172.21.15.120:0/3065872375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd700b49b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7efd7721b640 1 --2- 172.21.15.120:0/3065872375 >> v2:172.21.15.120:3300/0 conn(0x7efd70162b80 0x7efd700cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f2b01f6d640 1 -- 172.21.15.120:0/1805445404 shutdown_connections 2024-03-31T16:35:41.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/1805445404 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc06c9e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/1805445404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2afc06fe30 0x7f2afc067280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f2b01f6d640 1 -- 172.21.15.120:0/1805445404 >> 172.21.15.120:0/1805445404 conn(0x7f2afc071e70 msgr2=0x7f2afc072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7efd7721b640 1 -- 172.21.15.120:0/3065872375 >> 172.21.15.120:0/3065872375 conn(0x7efd70071e20 msgr2=0x7efd70072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7efd7721b640 1 -- 172.21.15.120:0/3065872375 shutdown_connections 2024-03-31T16:35:41.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7efd7721b640 1 -- 172.21.15.120:0/3065872375 wait complete. 2024-03-31T16:35:41.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f5323fff640 1 -- 172.21.15.120:0/2821715663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 msgr2=0x7f531c054560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f5323fff640 1 --2- 172.21.15.120:0/2821715663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 0x7f531c054560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5324050b20 tx=0x7f53240a6f00 comp rx=0 tx=0).stop 2024-03-31T16:35:41.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7fabe77fe640 1 --2- 172.21.15.120:0/3702078304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe815b640 0x7fabe80affa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabd800dbc0 tx=0x7fabd802b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db70c24b22083de8 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7f0a1b59e640 1 Processor -- start 2024-03-31T16:35:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7f0a1b59e640 1 -- start start 2024-03-31T16:35:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7fe32a738640 1 Processor -- start 2024-03-31T16:35:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7fe32a738640 1 -- start start 2024-03-31T16:35:41.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7fb693e55640 1 -- 172.21.15.120:0/2061436054 shutdown_connections 2024-03-31T16:35:41.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f5323fff640 1 -- 172.21.15.120:0/2821715663 shutdown_connections 2024-03-31T16:35:41.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f5323fff640 1 --2- 172.21.15.120:0/2821715663 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f5323fff640 1 --2- 172.21.15.120:0/2821715663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 0x7f531c054560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f5323fff640 1 -- 172.21.15.120:0/2821715663 >> 172.21.15.120:0/2821715663 conn(0x7f531c00a400 msgr2=0x7f531c00a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f5323fff640 1 -- 172.21.15.120:0/2821715663 shutdown_connections 2024-03-31T16:35:41.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f5323fff640 1 -- 172.21.15.120:0/2821715663 wait complete. 2024-03-31T16:35:41.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f2b01f6d640 1 -- 172.21.15.120:0/1805445404 shutdown_connections 2024-03-31T16:35:41.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7f2b01f6d640 1 -- 172.21.15.120:0/1805445404 wait complete. 2024-03-31T16:35:41.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.705+0000 7fb693e55640 1 -- 172.21.15.120:0/2061436054 wait complete. 2024-03-31T16:35:41.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7efd7721b640 1 Processor -- start 2024-03-31T16:35:41.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7fabe6ffd640 1 -- 172.21.15.120:0/3702078304 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8038070 con 0x7fabe815b640 2024-03-31T16:35:41.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7fabe6ffd640 1 -- 172.21.15.120:0/3702078304 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd8033680 con 0x7fabe815b640 2024-03-31T16:35:41.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7fabe6ffd640 1 -- 172.21.15.120:0/3702078304 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8033a50 con 0x7fabe815b640 2024-03-31T16:35:41.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7efd7721b640 1 -- start start 2024-03-31T16:35:41.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fb693e55640 1 Processor -- start 2024-03-31T16:35:41.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7f5323fff640 1 Processor -- start 2024-03-31T16:35:41.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fe32a738640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe32406da30 0x7fe3240b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7f0a1b59e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a1403e840 0x7f0a140d9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fe32a738640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3240d4910 0x7fe3240b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fe32a738640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 0x7fe3240cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fe32a738640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240cedb0 con 0x7fe32406da30 2024-03-31T16:35:41.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fe32a738640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240d2c50 con 0x7fe32415e860 2024-03-31T16:35:41.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fe32a738640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240cef30 con 0x7fe3240d4910 2024-03-31T16:35:41.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1b59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a14054130 0x7f0a140e1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1a59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a1403e840 0x7f0a140d9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe323fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe32406da30 0x7fe3240b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe323fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe32406da30 0x7fe3240b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52420/0 (socket says 172.21.15.120:52420) 2024-03-31T16:35:41.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe323fff640 1 -- 172.21.15.120:0/2954181953 learned_addr learned my addr 172.21.15.120:0/2954181953 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1a59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a1403e840 0x7f0a140d9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60710/0 (socket says 172.21.15.120:60710) 2024-03-31T16:35:41.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7f2b01f6d640 1 Processor -- start 2024-03-31T16:35:41.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7f2b01f6d640 1 -- start start 2024-03-31T16:35:41.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1a59c640 1 -- 172.21.15.120:0/2707986903 learned_addr learned my addr 172.21.15.120:0/2707986903 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a140e30c0 0x7f0a140e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe328cd5640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 0x7fe3240cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe3237fe640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3240d4910 0x7fe3240b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7f9e28e43640 1 Processor -- start 2024-03-31T16:35:41.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.706+0000 7f9e28e43640 1 -- start start 2024-03-31T16:35:41.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7f9e28e43640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c038110 0x7f9e1c0e8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e28e43640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e1c04ffd0 0x7f9e1c0366a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e28e43640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e1c0ead00 0x7f9e1c1890d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e28e43640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c0547c0 con 0x7f9e1c04ffd0 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e28e43640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c038cb0 con 0x7f9e1c0ead00 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e28e43640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1c054940 con 0x7f9e1c038110 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e237fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c038110 0x7f9e1c0e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fabee4d3640 1 -- 172.21.15.120:0/3702078304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe815b640 msgr2=0x7fabe80affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fabee4d3640 1 --2- 172.21.15.120:0/3702078304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe815b640 0x7fabe80affa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabd800dbc0 tx=0x7fabd802b830 comp rx=0 tx=0).stop 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fabee4d3640 1 -- 172.21.15.120:0/3702078304 shutdown_connections 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fabee4d3640 1 --2- 172.21.15.120:0/3702078304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe815b640 0x7fabe80affa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fabee4d3640 1 --2- 172.21.15.120:0/3702078304 >> v2:172.21.15.120:3300/0 conn(0x7fabe815b260 0x7fabe80b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fabee4d3640 1 -- 172.21.15.120:0/3702078304 >> 172.21.15.120:0/3702078304 conn(0x7fabe80b65a0 msgr2=0x7fabe80b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:41.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140e34a0 con 0x7f0a14054130 2024-03-31T16:35:41.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1403bfc0 con 0x7f0a140e30c0 2024-03-31T16:35:41.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0a140078e0 con 0x7f0a1403e840 2024-03-31T16:35:41.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe323fff640 1 -- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3240d4910 msgr2=0x7fe3240b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe323fff640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3240d4910 0x7fe3240b66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe323fff640 1 -- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 msgr2=0x7fe3240cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe323fff640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 0x7fe3240cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe323fff640 1 -- 172.21.15.120:0/2954181953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3240b9430 con 0x7fe32406da30 2024-03-31T16:35:41.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7fe328cd5640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 0x7fe3240cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:41.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f0a1ad9d640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a140e30c0 0x7f0a140e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7fb693e55640 1 -- start start 2024-03-31T16:35:41.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7efd7721b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd701f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fe323fff640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe32406da30 0x7fe3240b6190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe31802bd20 tx=0x7fe3180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fabee4d3640 1 -- 172.21.15.120:0/3702078304 shutdown_connections 2024-03-31T16:35:41.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fabee4d3640 1 -- 172.21.15.120:0/3702078304 wait complete. 2024-03-31T16:35:41.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7efd7721b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd700b6750 0x7efd7015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e23fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e1c0ead00 0x7f9e1c1890d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e23fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e1c0ead00 0x7f9e1c1890d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:44028/0 (socket says 172.21.15.120:44028) 2024-03-31T16:35:41.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.708+0000 7f9e23fff640 1 -- 172.21.15.120:0/1340423998 learned_addr learned my addr 172.21.15.120:0/1340423998 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e23fff640 1 -- 172.21.15.120:0/1340423998 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c038110 msgr2=0x7f9e1c0e8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e23fff640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c038110 0x7f9e1c0e8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e23fff640 1 -- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e1c04ffd0 msgr2=0x7f9e1c0366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e23fff640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e1c04ffd0 0x7f9e1c0366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e23fff640 1 -- 172.21.15.120:0/1340423998 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1c036000 con 0x7f9e1c0ead00 2024-03-31T16:35:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e23fff640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e1c0ead00 0x7f9e1c1890d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c3f0 tx=0x7f9e1000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7efd74fb7640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd701f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7efd74fb7640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd701f7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60732/0 (socket says 172.21.15.120:60732) 2024-03-31T16:35:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7efd74fb7640 1 -- 172.21.15.120:0/974765951 learned_addr learned my addr 172.21.15.120:0/974765951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd700b6750 0x7efd7015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7efd7721b640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd70162b80 0x7efd7015abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7efd7721b640 1 -- 172.21.15.120:0/974765951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efd700cf1e0 con 0x7efd700b6750 2024-03-31T16:35:41.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2b01f6d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2afc06c580 0x7f2afc1f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2b01f6d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2afc06fe30 0x7f2afc0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2b01f6d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc0b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fb693e55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68403e840 0x7fb68404ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fb693e55640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb684054130 0x7fb684052480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fb693e55640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6840e30c0 0x7fb6840529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fb693e55640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840e34a0 con 0x7fb68403e840 2024-03-31T16:35:41.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fb693e55640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb68403bfc0 con 0x7fb6840e30c0 2024-03-31T16:35:41.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fb693e55640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb684006fe0 con 0x7fb684054130 2024-03-31T16:35:41.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2afaffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2afc06fe30 0x7f2afc0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2afbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc0b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2afbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc0b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52440/0 (socket says 172.21.15.120:52440) 2024-03-31T16:35:41.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2afaffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2afc06fe30 0x7f2afc0b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:44042/0 (socket says 172.21.15.120:44042) 2024-03-31T16:35:41.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2afbfff640 1 -- 172.21.15.120:0/3412944367 learned_addr learned my addr 172.21.15.120:0/3412944367 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc06f910 con 0x7f2afc1409f0 2024-03-31T16:35:41.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc06f630 con 0x7f2afc06fe30 2024-03-31T16:35:41.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2afc0677c0 con 0x7f2afc06c580 2024-03-31T16:35:41.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e0ffff640 1 -- 172.21.15.120:0/1340423998 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e100052d0 con 0x7f9e1c0ead00 2024-03-31T16:35:41.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7efd757b8640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd70162b80 0x7efd7015abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e1c0e8540 con 0x7f9e1c0ead00 2024-03-31T16:35:41.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e1c035240 con 0x7f9e1c0ead00 2024-03-31T16:35:41.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fb691bf1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68403e840 0x7fb68404ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7fb691bf1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68403e840 0x7fb68404ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52462/0 (socket says 172.21.15.120:52462) 2024-03-31T16:35:41.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7fb691bf1640 1 -- 172.21.15.120:0/2552613760 learned_addr learned my addr 172.21.15.120:0/2552613760 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.707+0000 7f5323fff640 1 -- start start 2024-03-31T16:35:41.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f5323fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0d8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f5323fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 0x7f531c0e5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f5322ffd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f5322ffd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0d8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60740/0 (socket says 172.21.15.120:60740) 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f53227fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 0x7f531c0e5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f53227fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 0x7f531c0e5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52452/0 (socket says 172.21.15.120:52452) 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f5323fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f531c0e7640 0x7f531c04dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f5323fff640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f531c0e7a20 con 0x7f531c054b30 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f5323fff640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f531c053ea0 con 0x7f531c0e7640 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f5323fff640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f531c048270 con 0x7f531c04fbe0 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f5322ffd640 1 -- 172.21.15.120:0/751204738 learned_addr learned my addr 172.21.15.120:0/751204738 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7efd7721b640 1 -- 172.21.15.120:0/974765951 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd700cef00 con 0x7efd70162b80 2024-03-31T16:35:41.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7efd7721b640 1 -- 172.21.15.120:0/974765951 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd700d00d0 con 0x7efd7006cc90 2024-03-31T16:35:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f53237fe640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f531c0e7640 0x7f531c04dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f2afbfff640 1 -- 172.21.15.120:0/3412944367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2afc06c580 msgr2=0x7f2afc1f2f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-31T16:35:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f2afbfff640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2afc06c580 0x7f2afc1f2f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f2afbfff640 1 -- 172.21.15.120:0/3412944367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2afc06fe30 msgr2=0x7f2afc0b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f2afbfff640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2afc06fe30 0x7f2afc0b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f2afbfff640 1 -- 172.21.15.120:0/3412944367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc1f3490 con 0x7f2afc1409f0 2024-03-31T16:35:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f2afbfff640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc0b42c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2aec02c870 tx=0x7f2aec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f2afaffd640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2afc06fe30 0x7f2afc0b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7fabee4d3640 1 Processor -- start 2024-03-31T16:35:41.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f0a19d9b640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a14054130 0x7f0a140e1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f0a19d9b640 1 -- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a1403e840 msgr2=0x7f0a140d9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f0a19d9b640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a1403e840 0x7f0a140d9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f0a19d9b640 1 -- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a140e30c0 msgr2=0x7f0a140e18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f0a19d9b640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a140e30c0 0x7f0a140e18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f0a19d9b640 1 -- 172.21.15.120:0/2707986903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a14050c90 con 0x7f0a14054130 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f0a1ad9d640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a140e30c0 0x7f0a140e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7f0a19d9b640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a14054130 0x7f0a140e1370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0a14008630 tx=0x7f0a100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f0a0affd640 1 -- 172.21.15.120:0/2707986903 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10047070 con 0x7f0a14054130 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f0a0affd640 1 -- 172.21.15.120:0/2707986903 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10033410 con 0x7f0a14054130 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a14050f70 con 0x7f0a14054130 2024-03-31T16:35:41.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a14051530 con 0x7f0a14054130 2024-03-31T16:35:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.709+0000 7fe320ff9640 1 -- 172.21.15.120:0/2954181953 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318040020 con 0x7fe32406da30 2024-03-31T16:35:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7fe320ff9640 1 -- 172.21.15.120:0/2954181953 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe318032a90 con 0x7fe32406da30 2024-03-31T16:35:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7fe320ff9640 1 -- 172.21.15.120:0/2954181953 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318037040 con 0x7fe32406da30 2024-03-31T16:35:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.710+0000 7f9e0ffff640 1 -- 172.21.15.120:0/1340423998 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e10005490 con 0x7f9e1c0ead00 2024-03-31T16:35:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7f9e0ffff640 1 -- 172.21.15.120:0/1340423998 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e10007260 con 0x7f9e1c0ead00 2024-03-31T16:35:41.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7f2ae3fff640 1 -- 172.21.15.120:0/3412944367 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec044020 con 0x7f2afc1409f0 2024-03-31T16:35:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7efd757b8640 1 -- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 msgr2=0x7efd701f7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7efd757b8640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd701f7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7efd757b8640 1 -- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd700b6750 msgr2=0x7efd7015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7efd757b8640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd700b6750 0x7efd7015a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7efd757b8640 1 -- 172.21.15.120:0/974765951 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7015d440 con 0x7efd70162b80 2024-03-31T16:35:41.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e04005290 con 0x7f9e1c0ead00 2024-03-31T16:35:41.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fb6913f0640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb684054130 0x7fb684052480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2afc15df90 con 0x7f2afc1409f0 2024-03-31T16:35:41.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2afc13f560 con 0x7f2afc1409f0 2024-03-31T16:35:41.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7f2ae3fff640 1 -- 172.21.15.120:0/3412944367 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aec032570 con 0x7f2afc1409f0 2024-03-31T16:35:41.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7efd74fb7640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd701f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7efd6ffff640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd700b6750 0x7efd7015a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:35:41.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f5322ffd640 1 -- 172.21.15.120:0/751204738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f531c0e7640 msgr2=0x7f531c04dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f5322ffd640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f531c0e7640 0x7f531c04dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f5322ffd640 1 -- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 msgr2=0x7f531c0e5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f5322ffd640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 0x7f531c0e5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f5322ffd640 1 -- 172.21.15.120:0/751204738 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c0e4df0 con 0x7f531c04fbe0 2024-03-31T16:35:41.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7efd757b8640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd70162b80 0x7efd7015abc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd68033000 tx=0x7efd68004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fabee4d3640 1 -- start start 2024-03-31T16:35:41.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabee4d3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe80b45f0 0x7fabe815e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabee4d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe815b260 0x7fabe8149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabee4d3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe815b640 0x7fabe814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7f0a0affd640 1 -- 172.21.15.120:0/2707986903 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a10047070 con 0x7f0a14054130 2024-03-31T16:35:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fe32a738640 1 -- 172.21.15.120:0/2954181953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3240b96b0 con 0x7fe32406da30 2024-03-31T16:35:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fe32a738640 1 -- 172.21.15.120:0/2954181953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3240b9c70 con 0x7fe32406da30 2024-03-31T16:35:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fe30a7fc640 1 -- 172.21.15.120:0/2954181953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3240ce520 con 0x7fe32406da30 2024-03-31T16:35:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fb691bf1640 1 -- 172.21.15.120:0/2552613760 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb684054130 msgr2=0x7fb684052480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fb691bf1640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb684054130 0x7fb684052480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fb691bf1640 1 -- 172.21.15.120:0/2552613760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6840e30c0 msgr2=0x7fb6840529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fb691bf1640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6840e30c0 0x7fb6840529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.711+0000 7fb691bf1640 1 -- 172.21.15.120:0/2552613760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840519b0 con 0x7fb68403e840 2024-03-31T16:35:41.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fb691bf1640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68403e840 0x7fb68404ffa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c3c0 tx=0x7fb68800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f2ae3fff640 1 -- 172.21.15.120:0/3412944367 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aec039040 con 0x7f2afc1409f0 2024-03-31T16:35:41.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe7fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe80b45f0 0x7fabe815e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabee4d3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fabe815f010 con 0x7fabe815b260 2024-03-31T16:35:41.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabee4d3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fabe815fbe0 con 0x7fabe815b640 2024-03-31T16:35:41.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabee4d3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fabe806e770 con 0x7fabe80b45f0 2024-03-31T16:35:41.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe7fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe80b45f0 0x7fabe815e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60762/0 (socket says 172.21.15.120:60762) 2024-03-31T16:35:41.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe7fff640 1 -- 172.21.15.120:0/2096455395 learned_addr learned my addr 172.21.15.120:0/2096455395 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:41.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe77fe640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe815b260 0x7fabe8149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabeca70640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe815b640 0x7fabe814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2adc005290 con 0x7f2afc1409f0 2024-03-31T16:35:41.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a140057e0 con 0x7f0a14054130 2024-03-31T16:35:41.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe7fff640 1 -- 172.21.15.120:0/2096455395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe815b640 msgr2=0x7fabe814a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe7fff640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe815b640 0x7fabe814a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe7fff640 1 -- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe815b260 msgr2=0x7fabe8149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:41.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe7fff640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe815b260 0x7fabe8149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:41.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7fabe7fff640 1 -- 172.21.15.120:0/2096455395 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe814ad90 con 0x7fabe80b45f0 2024-03-31T16:35:41.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.712+0000 7f9e0ffff640 1 -- 172.21.15.120:0/1340423998 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e10007400 con 0x7f9e1c0ead00 2024-03-31T16:35:41.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7f5322ffd640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0d8570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f531800b410 tx=0x7f531800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7f9e0ffff640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9e0806c9c0 0x7f9e0806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7fabe7fff640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe80b45f0 0x7fabe815e7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fabe0007970 tx=0x7fabe0007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7f530b7fe640 1 -- 172.21.15.120:0/751204738 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5318015020 con 0x7f531c04fbe0 2024-03-31T16:35:41.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7f9e0ffff640 1 -- 172.21.15.120:0/1340423998 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9e1008af60 con 0x7f9e1c0ead00 2024-03-31T16:35:41.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7fb6827fc640 1 -- 172.21.15.120:0/2552613760 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688017070 con 0x7fb68403e840 2024-03-31T16:35:41.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c0e3d50 con 0x7f531c04fbe0 2024-03-31T16:35:41.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c0e4310 con 0x7f531c04fbe0 2024-03-31T16:35:41.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7f530b7fe640 1 -- 172.21.15.120:0/751204738 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5318011830 con 0x7f531c04fbe0 2024-03-31T16:35:41.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb684050910 con 0x7fb68403e840 2024-03-31T16:35:41.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb684050ed0 con 0x7fb68403e840 2024-03-31T16:35:41.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.713+0000 7f9e237fe640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9e0806c9c0 0x7f9e0806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7f9e237fe640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9e0806c9c0 0x7f9e0806ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e18036000 tx=0x7f9e1803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7f0a0affd640 1 -- 172.21.15.120:0/2707986903 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a100335c0 con 0x7f0a14054130 2024-03-31T16:35:41.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7f0a0affd640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f09fc06cd20 0x7f09fc06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7f530b7fe640 1 -- 172.21.15.120:0/751204738 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5318011c20 con 0x7f531c04fbe0 2024-03-31T16:35:41.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7f2ae3fff640 1 -- 172.21.15.120:0/3412944367 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2aec047020 con 0x7f2afc1409f0 2024-03-31T16:35:41.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7f0a0affd640 1 -- 172.21.15.120:0/2707986903 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0a10041c70 con 0x7f0a14054130 2024-03-31T16:35:41.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7f0a1a59c640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f09fc06cd20 0x7f09fc06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7fabe4ff9640 1 -- 172.21.15.120:0/2096455395 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0017760 con 0x7fabe80b45f0 2024-03-31T16:35:41.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7fabe4ff9640 1 -- 172.21.15.120:0/2096455395 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe0022070 con 0x7fabe80b45f0 2024-03-31T16:35:41.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7fabe4ff9640 1 -- 172.21.15.120:0/2096455395 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0017b00 con 0x7fabe80b45f0 2024-03-31T16:35:41.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.714+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe80cd330 con 0x7fabe80b45f0 2024-03-31T16:35:41.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe80cd8f0 con 0x7fabe80b45f0 2024-03-31T16:35:41.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7fe320ff9640 1 -- 172.21.15.120:0/2954181953 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe318043020 con 0x7fe32406da30 2024-03-31T16:35:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7f2ae3fff640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2ae806c9c0 0x7f2ae806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5304005290 con 0x7f531c04fbe0 2024-03-31T16:35:41.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7f0a1a59c640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f09fc06cd20 0x7f09fc06f1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c006fd0 tx=0x7f0a0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7f2ae3fff640 1 -- 172.21.15.120:0/3412944367 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2aec0af000 con 0x7f2afc1409f0 2024-03-31T16:35:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7f2afb7fe640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2ae806c9c0 0x7f2ae806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7fe320ff9640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe31006c9c0 0x7fe31006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.715+0000 7fe320ff9640 1 -- 172.21.15.120:0/2954181953 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe3180ad6b0 con 0x7fe32406da30 2024-03-31T16:35:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7fe3237fe640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe31006c9c0 0x7fe31006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7f530b7fe640 1 -- 172.21.15.120:0/751204738 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5318018020 con 0x7f531c04fbe0 2024-03-31T16:35:41.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6840057e0 con 0x7fb68403e840 2024-03-31T16:35:41.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe8068cd0 con 0x7fabe80b45f0 2024-03-31T16:35:41.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7f2afb7fe640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2ae806c9c0 0x7f2ae806ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ab90 tx=0x7f2af4009230 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7f530b7fe640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f531006c8f0 0x7f531006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7f53227fc640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f531006c8f0 0x7f531006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7fe3237fe640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe31006c9c0 0x7fe31006ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3240cb4a0 tx=0x7fe314008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7f530b7fe640 1 -- 172.21.15.120:0/751204738 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f531808b920 con 0x7f531c04fbe0 2024-03-31T16:35:41.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.716+0000 7efd6d7fa640 1 -- 172.21.15.120:0/974765951 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68044020 con 0x7efd70162b80 2024-03-31T16:35:41.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.717+0000 7f53227fc640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f531006c8f0 0x7f531006edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f531c008940 tx=0x7f53240ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.717+0000 7efd6d7fa640 1 -- 172.21.15.120:0/974765951 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6803f470 con 0x7efd70162b80 2024-03-31T16:35:41.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.717+0000 7f9e0ffff640 1 -- 172.21.15.120:0/1340423998 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9e100b9ac0 con 0x7f9e1c0ead00 2024-03-31T16:35:41.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.717+0000 7efd7721b640 1 -- 172.21.15.120:0/974765951 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7015d720 con 0x7efd70162b80 2024-03-31T16:35:41.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.717+0000 7efd7721b640 1 -- 172.21.15.120:0/974765951 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd701f80a0 con 0x7efd70162b80 2024-03-31T16:35:41.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.717+0000 7efd6d7fa640 1 -- 172.21.15.120:0/974765951 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68039040 con 0x7efd70162b80 2024-03-31T16:35:41.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.717+0000 7fabe4ff9640 1 -- 172.21.15.120:0/2096455395 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabe0005d10 con 0x7fabe80b45f0 2024-03-31T16:35:41.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.718+0000 7fabe4ff9640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabc806c940 0x7fabc806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.718+0000 7fabe77fe640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabc806c940 0x7fabc806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.718+0000 7efd7721b640 1 -- 172.21.15.120:0/974765951 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd70068cd0 con 0x7efd70162b80 2024-03-31T16:35:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.718+0000 7fabe4ff9640 1 -- 172.21.15.120:0/2096455395 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fabe005f650 con 0x7fabe80b45f0 2024-03-31T16:35:41.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.718+0000 7fabe77fe640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabc806c940 0x7fabc806ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabd8035000 tx=0x7fabd800d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.718+0000 7efd6d7fa640 1 -- 172.21.15.120:0/974765951 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd68047020 con 0x7efd70162b80 2024-03-31T16:35:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.719+0000 7efd6d7fa640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd5406c940 0x7efd5406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.719+0000 7efd6d7fa640 1 -- 172.21.15.120:0/974765951 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd680ae430 con 0x7efd70162b80 2024-03-31T16:35:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.719+0000 7efd74fb7640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd5406c940 0x7efd5406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.720+0000 7efd74fb7640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd5406c940 0x7efd5406ee00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd70166220 tx=0x7efd64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.720+0000 7fb6827fc640 1 -- 172.21.15.120:0/2552613760 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6880052d0 con 0x7fb68403e840 2024-03-31T16:35:41.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.720+0000 7fb6827fc640 1 -- 172.21.15.120:0/2552613760 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688021060 con 0x7fb68403e840 2024-03-31T16:35:41.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.720+0000 7f2ae3fff640 1 -- 172.21.15.120:0/3412944367 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2aec04e020 con 0x7f2afc1409f0 2024-03-31T16:35:41.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.721+0000 7f530b7fe640 1 -- 172.21.15.120:0/751204738 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f531801f020 con 0x7f531c04fbe0 2024-03-31T16:35:41.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.723+0000 7efd6d7fa640 1 -- 172.21.15.120:0/974765951 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efd6804e030 con 0x7efd70162b80 2024-03-31T16:35:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.725+0000 7fabe4ff9640 1 -- 172.21.15.120:0/2096455395 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fabe00636e0 con 0x7fabe80b45f0 2024-03-31T16:35:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.729+0000 7fe320ff9640 1 -- 172.21.15.120:0/2954181953 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe31804a030 con 0x7fe32406da30 2024-03-31T16:35:41.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.737+0000 7f0a0affd640 1 -- 172.21.15.120:0/2707986903 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0a1007a580 con 0x7f0a14054130 2024-03-31T16:35:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.739+0000 7fb6827fc640 1 -- 172.21.15.120:0/2552613760 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb68801a070 con 0x7fb68403e840 2024-03-31T16:35:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.740+0000 7fb6827fc640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb67006c920 0x7fb67006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.740+0000 7fb6913f0640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb67006c920 0x7fb67006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.741+0000 7fb6913f0640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb67006c920 0x7fb67006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb684056930 tx=0x7fb68c0ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.741+0000 7fb6827fc640 1 -- 172.21.15.120:0/2552613760 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb68808b300 con 0x7fb68403e840 2024-03-31T16:35:41.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:41.747+0000 7fb6827fc640 1 -- 172.21.15.120:0/2552613760 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb6880590c0 con 0x7fb68403e840 2024-03-31T16:35:42.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.134+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9e04005850 con 0x7f9e1c0ead00 2024-03-31T16:35:42.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.135+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fabe81551b0 con 0x7fabe80b45f0 2024-03-31T16:35:42.139 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-03-31T16:35:42.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.135+0000 7f9e0ffff640 1 -- 172.21.15.120:0/1340423998 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e10058db0 con 0x7f9e1c0ead00 2024-03-31T16:35:42.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.135+0000 7fabe4ff9640 1 -- 172.21.15.120:0/2096455395 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fabe0062fe0 con 0x7fabe80b45f0 2024-03-31T16:35:42.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.135+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5304005850 con 0x7f531c04fbe0 2024-03-31T16:35:42.141 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2024-03-31T16:35:42.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.136+0000 7f530b7fe640 1 -- 172.21.15.120:0/751204738 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5318059de0 con 0x7f531c04fbe0 2024-03-31T16:35:42.141 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-03-31T16:35:42.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.138+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9e0806c9c0 msgr2=0x7f9e0806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.138+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabc806c940 msgr2=0x7fabc806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.138+0000 7fabee4d3640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabc806c940 0x7fabc806ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabd8035000 tx=0x7fabd800d000 comp rx=0 tx=0).stop 2024-03-31T16:35:42.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9e0806c9c0 0x7f9e0806ee80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e18036000 tx=0x7f9e1803b040 comp rx=0 tx=0).stop 2024-03-31T16:35:42.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe80b45f0 msgr2=0x7fabe815e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe80b45f0 0x7fabe815e7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fabe0007970 tx=0x7fabe0007e30 comp rx=0 tx=0).stop 2024-03-31T16:35:42.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e1c0ead00 msgr2=0x7f9e1c1890d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e1c0ead00 0x7f9e1c1890d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c3f0 tx=0x7f9e1000c8b0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f531006c8f0 msgr2=0x7f531006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f5323fff640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f531006c8f0 0x7f531006edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f531c008940 tx=0x7f53240ab000 comp rx=0 tx=0).stop 2024-03-31T16:35:42.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 shutdown_connections 2024-03-31T16:35:42.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9e0806c9c0 0x7f9e0806ee80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e1c0ead00 0x7f9e1c1890d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e1c04ffd0 0x7f9e1c0366a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 --2- 172.21.15.120:0/1340423998 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e1c038110 0x7f9e1c0e8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 >> 172.21.15.120:0/1340423998 conn(0x7f9e1c009fb0 msgr2=0x7f9e1c03a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 shutdown_connections 2024-03-31T16:35:42.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabc806c940 0x7fabc806ee00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe815b640 0x7fabe814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fabe815b260 0x7fabe8149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 --2- 172.21.15.120:0/2096455395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fabe80b45f0 0x7fabe815e7e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 >> 172.21.15.120:0/2096455395 conn(0x7fabe80b65a0 msgr2=0x7fabe81580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 msgr2=0x7f531c0d8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f5323fff640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0d8570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f531800b410 tx=0x7f531800b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 shutdown_connections 2024-03-31T16:35:42.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7f9e28e43640 1 -- 172.21.15.120:0/1340423998 wait complete. 2024-03-31T16:35:42.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 shutdown_connections 2024-03-31T16:35:42.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.139+0000 7fabee4d3640 1 -- 172.21.15.120:0/2096455395 wait complete. 2024-03-31T16:35:42.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.140+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 shutdown_connections 2024-03-31T16:35:42.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.140+0000 7f5323fff640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f531006c8f0 0x7f531006edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.140+0000 7f5323fff640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f531c0e7640 0x7f531c04dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.140+0000 7f5323fff640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f531c054b30 0x7f531c0e5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.140+0000 7f5323fff640 1 --2- 172.21.15.120:0/751204738 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f531c04fbe0 0x7f531c0d8570 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.140+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 >> 172.21.15.120:0/751204738 conn(0x7f531c00a400 msgr2=0x7f531c04a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.140+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 shutdown_connections 2024-03-31T16:35:42.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.140+0000 7f5323fff640 1 -- 172.21.15.120:0/751204738 wait complete. 2024-03-31T16:35:42.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.145+0000 7efd7721b640 1 -- 172.21.15.120:0/974765951 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efd7015d8f0 con 0x7efd70162b80 2024-03-31T16:35:42.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.146+0000 7efd6d7fa640 1 -- 172.21.15.120:0/974765951 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd6804e030 con 0x7efd70162b80 2024-03-31T16:35:42.150 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2024-03-31T16:35:42.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.149+0000 7efd5affd640 1 -- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd5406c940 msgr2=0x7efd5406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.149+0000 7efd5affd640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd5406c940 0x7efd5406ee00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd70166220 tx=0x7efd64008040 comp rx=0 tx=0).stop 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7efd5affd640 1 -- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd70162b80 msgr2=0x7efd7015abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7efd5affd640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd70162b80 0x7efd7015abc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd68033000 tx=0x7efd68004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7efd5affd640 1 -- 172.21.15.120:0/974765951 shutdown_connections 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7efd5affd640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd5406c940 0x7efd5406ee00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7efd5affd640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd70162b80 0x7efd7015abc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7efd5affd640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd700b6750 0x7efd7015a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7efd5affd640 1 --2- 172.21.15.120:0/974765951 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd7006cc90 0x7efd701f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7efd5affd640 1 -- 172.21.15.120:0/974765951 >> 172.21.15.120:0/974765951 conn(0x7efd70071e20 msgr2=0x7efd700b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.150+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2adc005850 con 0x7f2afc1409f0 2024-03-31T16:35:42.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.151+0000 7efd5affd640 1 -- 172.21.15.120:0/974765951 shutdown_connections 2024-03-31T16:35:42.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.151+0000 7efd5affd640 1 -- 172.21.15.120:0/974765951 wait complete. 2024-03-31T16:35:42.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.151+0000 7f2ae3fff640 1 -- 172.21.15.120:0/3412944367 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2aec07d380 con 0x7f2afc1409f0 2024-03-31T16:35:42.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.154+0000 7fe30a7fc640 1 -- 172.21.15.120:0/2954181953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe3240685c0 con 0x7fe32406da30 2024-03-31T16:35:42.159 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2024-03-31T16:35:42.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.154+0000 7fe320ff9640 1 -- 172.21.15.120:0/2954181953 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3240b9430 con 0x7fe32406da30 2024-03-31T16:35:42.159 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-03-31T16:35:42.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.155+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0a14039900 con 0x7f0a14054130 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2ae806c9c0 msgr2=0x7f2ae806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2ae806c9c0 0x7f2ae806ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2af400ab90 tx=0x7f2af4009230 comp rx=0 tx=0).stop 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 msgr2=0x7f2afc0b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc0b42c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2aec02c870 tx=0x7f2aec0046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 shutdown_connections 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2ae806c9c0 0x7f2ae806ee80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2afc1409f0 0x7f2afc0b42c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2afc06fe30 0x7f2afc0b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 --2- 172.21.15.120:0/3412944367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2afc06c580 0x7f2afc1f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 >> 172.21.15.120:0/3412944367 conn(0x7f2afc071e70 msgr2=0x7f2afc15a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f0a0affd640 1 -- 172.21.15.120:0/2707986903 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a1007a580 con 0x7f0a14054130 2024-03-31T16:35:42.162 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2024-03-31T16:35:42.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 shutdown_connections 2024-03-31T16:35:42.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.156+0000 7f2b01f6d640 1 -- 172.21.15.120:0/3412944367 wait complete. 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 -- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe31006c9c0 msgr2=0x7fe31006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe31006c9c0 0x7fe31006ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3240cb4a0 tx=0x7fe314008040 comp rx=0 tx=0).stop 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 -- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe32406da30 msgr2=0x7fe3240b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe32406da30 0x7fe3240b6190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe31802bd20 tx=0x7fe3180046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 -- 172.21.15.120:0/2954181953 shutdown_connections 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe31006c9c0 0x7fe31006ee80 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe3240cb4a0 tx=0x7fe314008040 comp rx=0 tx=0).stop 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415e860 0x7fe3240cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3240d4910 0x7fe3240b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 --2- 172.21.15.120:0/2954181953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe32406da30 0x7fe3240b6190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.158+0000 7fe30a7fc640 1 -- 172.21.15.120:0/2954181953 >> 172.21.15.120:0/2954181953 conn(0x7fe32409d7d0 msgr2=0x7fe3240b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-03-31T16:35:42.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.159+0000 7fe30a7fc640 1 -- 172.21.15.120:0/2954181953 shutdown_connections 2024-03-31T16:35:42.166 DEBUG:teuthology.parallel:result is None 2024-03-31T16:35:42.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-03-31T16:35:42.167 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7fe30a7fc640 1 -- 172.21.15.120:0/2954181953 wait complete. 2024-03-31T16:35:42.167 DEBUG:teuthology.parallel:result is None 2024-03-31T16:35:42.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-03-31T16:35:42.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f09fc06cd20 msgr2=0x7f09fc06f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f09fc06cd20 0x7f09fc06f1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c006fd0 tx=0x7f0a0c008040 comp rx=0 tx=0).stop 2024-03-31T16:35:42.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a14054130 msgr2=0x7f0a140e1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a14054130 0x7f0a140e1370 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0a14008630 tx=0x7f0a100046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.168 DEBUG:teuthology.parallel:result is None 2024-03-31T16:35:42.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb684053db0 con 0x7fb68403e840 2024-03-31T16:35:42.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 shutdown_connections 2024-03-31T16:35:42.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f09fc06cd20 0x7f09fc06f1e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0a140e30c0 0x7f0a140e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0a14054130 0x7f0a140e1370 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 --2- 172.21.15.120:0/2707986903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0a1403e840 0x7f0a140d9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 >> 172.21.15.120:0/2707986903 conn(0x7f0a140559e0 msgr2=0x7f0a14055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 shutdown_connections 2024-03-31T16:35:42.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.161+0000 7f0a1b59e640 1 -- 172.21.15.120:0/2707986903 wait complete. 2024-03-31T16:35:42.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.162+0000 7fb6827fc640 1 -- 172.21.15.120:0/2552613760 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb68808b0e0 con 0x7fb68403e840 2024-03-31T16:35:42.170 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2024-03-31T16:35:42.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb67006c920 msgr2=0x7fb67006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb67006c920 0x7fb67006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb684056930 tx=0x7fb68c0ab000 comp rx=0 tx=0).stop 2024-03-31T16:35:42.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68403e840 msgr2=0x7fb68404ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68403e840 0x7fb68404ffa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c3c0 tx=0x7fb68800c880 comp rx=0 tx=0).stop 2024-03-31T16:35:42.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 shutdown_connections 2024-03-31T16:35:42.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb67006c920 0x7fb67006ede0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6840e30c0 0x7fb6840529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb684054130 0x7fb684052480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 --2- 172.21.15.120:0/2552613760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb68403e840 0x7fb68404ffa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 >> 172.21.15.120:0/2552613760 conn(0x7fb6840559e0 msgr2=0x7fb6840df510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 shutdown_connections 2024-03-31T16:35:42.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.164+0000 7fb693e55640 1 -- 172.21.15.120:0/2552613760 wait complete. 2024-03-31T16:35:42.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-03-31T16:35:42.175 DEBUG:teuthology.parallel:result is None 2024-03-31T16:35:42.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-03-31T16:35:42.179 DEBUG:teuthology.parallel:result is None 2024-03-31T16:35:42.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-03-31T16:35:42.185 DEBUG:teuthology.parallel:result is None 2024-03-31T16:35:42.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-03-31T16:35:42.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-03-31T16:35:42.186 DEBUG:teuthology.parallel:result is None 2024-03-31T16:35:42.187 DEBUG:teuthology.parallel:result is None 2024-03-31T16:35:42.187 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-31T16:35:42.187 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:35:42.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.320+0000 7f6490a77640 1 Processor -- start 2024-03-31T16:35:42.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.320+0000 7f6490a77640 1 -- start start 2024-03-31T16:35:42.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f6490a77640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f648c15f900 0x7f648c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f6490a77640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 0x7f648c0cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f6490a77640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c15cd90 con 0x7f648c15fe90 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f6490a77640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f648c15d060 con 0x7f648c15f900 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f6490a77640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f648c15d340 con 0x7f648c15da60 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f648a59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f648c15f900 0x7f648c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f648a59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f648c15f900 0x7f648c15c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52484/0 (socket says 172.21.15.120:52484) 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f648a59c640 1 -- 172.21.15.120:0/2678427056 learned_addr learned my addr 172.21.15.120:0/2678427056 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.321+0000 7f6489d9b640 1 --2- 172.21.15.120:0/2678427056 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 0x7f648c0cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648a59c640 1 -- 172.21.15.120:0/2678427056 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 msgr2=0x7f648c0cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648a59c640 1 --2- 172.21.15.120:0/2678427056 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 0x7f648c0cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648a59c640 1 -- 172.21.15.120:0/2678427056 >> v1:172.21.15.203:6789/0 conn(0x7f648c15fe90 legacy=0x7f648c0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648a59c640 1 -- 172.21.15.120:0/2678427056 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c15d620 con 0x7f648c15f900 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648959a640 1 -- 172.21.15.120:0/2678427056 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185028603 0 0) 0x7f648c15cd90 con 0x7f648c15fe90 2024-03-31T16:35:42.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648a59c640 1 --2- 172.21.15.120:0/2678427056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c15c850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f647c009e50 tx=0x7f647c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea887b1a2275a639 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:42.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648959a640 1 -- 172.21.15.120:0/2678427056 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c02cb00 con 0x7f648c15f900 2024-03-31T16:35:42.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648959a640 1 -- 172.21.15.120:0/2678427056 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647c02cca0 con 0x7f648c15f900 2024-03-31T16:35:42.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.322+0000 7f648959a640 1 -- 172.21.15.120:0/2678427056 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c034610 con 0x7f648c15f900 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.323+0000 7f6490a77640 1 -- 172.21.15.120:0/2678427056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 msgr2=0x7f648c15c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.323+0000 7f6490a77640 1 --2- 172.21.15.120:0/2678427056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c15c850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f647c009e50 tx=0x7f647c02bf60 comp rx=0 tx=0).stop 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.323+0000 7f6490a77640 1 -- 172.21.15.120:0/2678427056 shutdown_connections 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.323+0000 7f6490a77640 1 --2- 172.21.15.120:0/2678427056 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 0x7f648c0cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.323+0000 7f6490a77640 1 --2- 172.21.15.120:0/2678427056 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c15c850 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.323+0000 7f6490a77640 1 -- 172.21.15.120:0/2678427056 >> 172.21.15.120:0/2678427056 conn(0x7f648c0b3e90 msgr2=0x7f648c0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.323+0000 7f6490a77640 1 -- 172.21.15.120:0/2678427056 shutdown_connections 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.323+0000 7f6490a77640 1 -- 172.21.15.120:0/2678427056 wait complete. 2024-03-31T16:35:42.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.324+0000 7f6490a77640 1 Processor -- start 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.324+0000 7f6490a77640 1 -- start start 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6490a77640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 0x7f648c14d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6490a77640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6490a77640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f648c15fe90 0x7f648c15e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6490a77640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0d04f0 con 0x7f648c15f900 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6490a77640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0d0370 con 0x7f648c15fe90 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6490a77640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f648c0d0670 con 0x7f648c15da60 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6489d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6489d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c0cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52488/0 (socket says 172.21.15.120:52488) 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6489d9b640 1 -- 172.21.15.120:0/2771745287 learned_addr learned my addr 172.21.15.120:0/2771745287 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f648a59c640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 0x7f648c14d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f648ad9d640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f648c15fe90 0x7f648c15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6489d9b640 1 -- 172.21.15.120:0/2771745287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 msgr2=0x7f648c14d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6489d9b640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 0x7f648c14d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6489d9b640 1 -- 172.21.15.120:0/2771745287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f648c15fe90 msgr2=0x7f648c15e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6489d9b640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f648c15fe90 0x7f648c15e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.325+0000 7f6489d9b640 1 -- 172.21.15.120:0/2771745287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c14d570 con 0x7f648c15f900 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.326+0000 7f6489d9b640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c0cf130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f648000e870 tx=0x7f648000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.326+0000 7f647affd640 1 -- 172.21.15.120:0/2771745287 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480017070 con 0x7f648c15f900 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.326+0000 7f647affd640 1 -- 172.21.15.120:0/2771745287 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648000c940 con 0x7f648c15f900 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.326+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c0cd500 con 0x7f648c15f900 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.326+0000 7f647affd640 1 -- 172.21.15.120:0/2771745287 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648000cd30 con 0x7f648c15f900 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.326+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c0ccf40 con 0x7f648c15f900 2024-03-31T16:35:42.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.327+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c068cd0 con 0x7f648c15f900 2024-03-31T16:35:42.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.327+0000 7f647affd640 1 -- 172.21.15.120:0/2771745287 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f648001a070 con 0x7f648c15f900 2024-03-31T16:35:42.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.328+0000 7f647affd640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f646c06c8f0 0x7f646c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.328+0000 7f647affd640 1 -- 172.21.15.120:0/2771745287 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f648008b970 con 0x7f648c15f900 2024-03-31T16:35:42.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.328+0000 7f648a59c640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f646c06c8f0 0x7f646c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.328+0000 7f648a59c640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f646c06c8f0 0x7f646c06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f647c035000 tx=0x7f647c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:42.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.332+0000 7f647affd640 1 -- 172.21.15.120:0/2771745287 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f648c14d570 con 0x7f648c15f900 2024-03-31T16:35:42.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.502+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f648c071810 con 0x7f646c06c8f0 2024-03-31T16:35:42.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.508+0000 7f647affd640 1 -- 172.21.15.120:0/2771745287 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f648c071810 con 0x7f646c06c8f0 2024-03-31T16:35:42.515 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:42.516 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:35:42.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f646c06c8f0 msgr2=0x7f646c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f646c06c8f0 0x7f646c06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f647c035000 tx=0x7f647c030000 comp rx=0 tx=0).stop 2024-03-31T16:35:42.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 msgr2=0x7f648c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c0cf130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f648000e870 tx=0x7f648000ed30 comp rx=0 tx=0).stop 2024-03-31T16:35:42.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 shutdown_connections 2024-03-31T16:35:42.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f646c06c8f0 0x7f646c06edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f648c15fe90 0x7f648c15e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f648c15f900 0x7f648c0cf130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 --2- 172.21.15.120:0/2771745287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f648c15da60 0x7f648c14d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 >> 172.21.15.120:0/2771745287 conn(0x7f648c0b3e90 msgr2=0x7f648c160370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 shutdown_connections 2024-03-31T16:35:42.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.511+0000 7f6490a77640 1 -- 172.21.15.120:0/2771745287 wait complete. 2024-03-31T16:35:42.526 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-31T16:35:41.859890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.800179"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629943+0000","last_change":"2024-03-31T16:35:32.082188+0000","last_active":"2024-03-31T16:35:33.629943+0000","last_peered":"2024-03-31T16:35:33.629943+0000","last_clean":"2024-03-31T16:35:33.629943+0000","last_became_active":"2024-03-31T16:35:32.081925+0000","last_became_peered":"2024-03-31T16:35:32.081925+0000","last_unstale":"2024-03-31T16:35:33.629943+0000","last_undegraded":"2024-03-31T16:35:33.629943+0000","last_fullsized":"2024-03-31T16:35:33.629943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074810+0000","last_change":"2024-03-31T16:35:32.070694+0000","last_active":"2024-03-31T16:35:33.074810+0000","last_peered":"2024-03-31T16:35:33.074810+0000","last_clean":"2024-03-31T16:35:33.074810+0000","last_became_active":"2024-03-31T16:35:32.070442+0000","last_became_peered":"2024-03-31T16:35:32.070442+0000","last_unstale":"2024-03-31T16:35:33.074810+0000","last_undegraded":"2024-03-31T16:35:33.074810+0000","last_fullsized":"2024-03-31T16:35:33.074810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629856+0000","last_change":"2024-03-31T16:35:32.069876+0000","last_active":"2024-03-31T16:35:33.629856+0000","last_peered":"2024-03-31T16:35:33.629856+0000","last_clean":"2024-03-31T16:35:33.629856+0000","last_became_active":"2024-03-31T16:35:32.069638+0000","last_became_peered":"2024-03-31T16:35:32.069638+0000","last_unstale":"2024-03-31T16:35:33.629856+0000","last_undegraded":"2024-03-31T16:35:33.629856+0000","last_fullsized":"2024-03-31T16:35:33.629856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079518+0000","last_change":"2024-03-31T16:35:32.076897+0000","last_active":"2024-03-31T16:35:33.079518+0000","last_peered":"2024-03-31T16:35:33.079518+0000","last_clean":"2024-03-31T16:35:33.079518+0000","last_became_active":"2024-03-31T16:35:32.076633+0000","last_became_peered":"2024-03-31T16:35:32.076633+0000","last_unstale":"2024-03-31T16:35:33.079518+0000","last_undegraded":"2024-03-31T16:35:33.079518+0000","last_fullsized":"2024-03-31T16:35:33.079518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629757+0000","last_change":"2024-03-31T16:35:32.081370+0000","last_active":"2024-03-31T16:35:33.629757+0000","last_peered":"2024-03-31T16:35:33.629757+0000","last_clean":"2024-03-31T16:35:33.629757+0000","last_became_active":"2024-03-31T16:35:32.080814+0000","last_became_peered":"2024-03-31T16:35:32.080814+0000","last_unstale":"2024-03-31T16:35:33.629757+0000","last_undegraded":"2024-03-31T16:35:33.629757+0000","last_fullsized":"2024-03-31T16:35:33.629757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079237+0000","last_change":"2024-03-31T16:35:32.070742+0000","last_active":"2024-03-31T16:35:33.079237+0000","last_peered":"2024-03-31T16:35:33.079237+0000","last_clean":"2024-03-31T16:35:33.079237+0000","last_became_active":"2024-03-31T16:35:32.070264+0000","last_became_peered":"2024-03-31T16:35:32.070264+0000","last_unstale":"2024-03-31T16:35:33.079237+0000","last_undegraded":"2024-03-31T16:35:33.079237+0000","last_fullsized":"2024-03-31T16:35:33.079237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629493+0000","last_change":"2024-03-31T16:35:32.081753+0000","last_active":"2024-03-31T16:35:33.629493+0000","last_peered":"2024-03-31T16:35:33.629493+0000","last_clean":"2024-03-31T16:35:33.629493+0000","last_became_active":"2024-03-31T16:35:32.081453+0000","last_became_peered":"2024-03-31T16:35:32.081453+0000","last_unstale":"2024-03-31T16:35:33.629493+0000","last_undegraded":"2024-03-31T16:35:33.629493+0000","last_fullsized":"2024-03-31T16:35:33.629493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311273+0000","last_change":"2024-03-31T16:35:32.080813+0000","last_active":"2024-03-31T16:35:33.311273+0000","last_peered":"2024-03-31T16:35:33.311273+0000","last_clean":"2024-03-31T16:35:33.311273+0000","last_became_active":"2024-03-31T16:35:32.080309+0000","last_became_peered":"2024-03-31T16:35:32.080309+0000","last_unstale":"2024-03-31T16:35:33.311273+0000","last_undegraded":"2024-03-31T16:35:33.311273+0000","last_fullsized":"2024-03-31T16:35:33.311273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629958+0000","last_change":"2024-03-31T16:35:32.083450+0000","last_active":"2024-03-31T16:35:33.629958+0000","last_peered":"2024-03-31T16:35:33.629958+0000","last_clean":"2024-03-31T16:35:33.629958+0000","last_became_active":"2024-03-31T16:35:32.083187+0000","last_became_peered":"2024-03-31T16:35:32.083187+0000","last_unstale":"2024-03-31T16:35:33.629958+0000","last_undegraded":"2024-03-31T16:35:33.629958+0000","last_fullsized":"2024-03-31T16:35:33.629958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078571+0000","last_change":"2024-03-31T16:35:32.084349+0000","last_active":"2024-03-31T16:35:33.078571+0000","last_peered":"2024-03-31T16:35:33.078571+0000","last_clean":"2024-03-31T16:35:33.078571+0000","last_became_active":"2024-03-31T16:35:32.084055+0000","last_became_peered":"2024-03-31T16:35:32.084055+0000","last_unstale":"2024-03-31T16:35:33.078571+0000","last_undegraded":"2024-03-31T16:35:33.078571+0000","last_fullsized":"2024-03-31T16:35:33.078571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078081+0000","last_change":"2024-03-31T16:35:32.081612+0000","last_active":"2024-03-31T16:35:33.078081+0000","last_peered":"2024-03-31T16:35:33.078081+0000","last_clean":"2024-03-31T16:35:33.078081+0000","last_became_active":"2024-03-31T16:35:32.081288+0000","last_became_peered":"2024-03-31T16:35:32.081288+0000","last_unstale":"2024-03-31T16:35:33.078081+0000","last_undegraded":"2024-03-31T16:35:33.078081+0000","last_fullsized":"2024-03-31T16:35:33.078081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078261+0000","last_change":"2024-03-31T16:35:32.080466+0000","last_active":"2024-03-31T16:35:33.078261+0000","last_peered":"2024-03-31T16:35:33.078261+0000","last_clean":"2024-03-31T16:35:33.078261+0000","last_became_active":"2024-03-31T16:35:32.080192+0000","last_became_peered":"2024-03-31T16:35:32.080192+0000","last_unstale":"2024-03-31T16:35:33.078261+0000","last_undegraded":"2024-03-31T16:35:33.078261+0000","last_fullsized":"2024-03-31T16:35:33.078261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:56.678344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311515+0000","last_change":"2024-03-31T16:35:32.077617+0000","last_active":"2024-03-31T16:35:33.311515+0000","last_peered":"2024-03-31T16:35:33.311515+0000","last_clean":"2024-03-31T16:35:33.311515+0000","last_became_active":"2024-03-31T16:35:32.077017+0000","last_became_peered":"2024-03-31T16:35:32.077017+0000","last_unstale":"2024-03-31T16:35:33.311515+0000","last_undegraded":"2024-03-31T16:35:33.311515+0000","last_fullsized":"2024-03-31T16:35:33.311515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629702+0000","last_change":"2024-03-31T16:35:32.069024+0000","last_active":"2024-03-31T16:35:33.629702+0000","last_peered":"2024-03-31T16:35:33.629702+0000","last_clean":"2024-03-31T16:35:33.629702+0000","last_became_active":"2024-03-31T16:35:32.068738+0000","last_became_peered":"2024-03-31T16:35:32.068738+0000","last_unstale":"2024-03-31T16:35:33.629702+0000","last_undegraded":"2024-03-31T16:35:33.629702+0000","last_fullsized":"2024-03-31T16:35:33.629702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074478+0000","last_change":"2024-03-31T16:35:32.073796+0000","last_active":"2024-03-31T16:35:33.074478+0000","last_peered":"2024-03-31T16:35:33.074478+0000","last_clean":"2024-03-31T16:35:33.074478+0000","last_became_active":"2024-03-31T16:35:32.073514+0000","last_became_peered":"2024-03-31T16:35:32.073514+0000","last_unstale":"2024-03-31T16:35:33.074478+0000","last_undegraded":"2024-03-31T16:35:33.074478+0000","last_fullsized":"2024-03-31T16:35:33.074478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078993+0000","last_change":"2024-03-31T16:35:32.071718+0000","last_active":"2024-03-31T16:35:33.078993+0000","last_peered":"2024-03-31T16:35:33.078993+0000","last_clean":"2024-03-31T16:35:33.078993+0000","last_became_active":"2024-03-31T16:35:32.071286+0000","last_became_peered":"2024-03-31T16:35:32.071286+0000","last_unstale":"2024-03-31T16:35:33.078993+0000","last_undegraded":"2024-03-31T16:35:33.078993+0000","last_fullsized":"2024-03-31T16:35:33.078993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078539+0000","last_change":"2024-03-31T16:35:32.076047+0000","last_active":"2024-03-31T16:35:33.078539+0000","last_peered":"2024-03-31T16:35:33.078539+0000","last_clean":"2024-03-31T16:35:33.078539+0000","last_became_active":"2024-03-31T16:35:32.075802+0000","last_became_peered":"2024-03-31T16:35:32.075802+0000","last_unstale":"2024-03-31T16:35:33.078539+0000","last_undegraded":"2024-03-31T16:35:33.078539+0000","last_fullsized":"2024-03-31T16:35:33.078539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128917+0000","last_change":"2024-03-31T16:35:32.080444+0000","last_active":"2024-03-31T16:35:33.128917+0000","last_peered":"2024-03-31T16:35:33.128917+0000","last_clean":"2024-03-31T16:35:33.128917+0000","last_became_active":"2024-03-31T16:35:32.080141+0000","last_became_peered":"2024-03-31T16:35:32.080141+0000","last_unstale":"2024-03-31T16:35:33.128917+0000","last_undegraded":"2024-03-31T16:35:33.128917+0000","last_fullsized":"2024-03-31T16:35:33.128917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629965+0000","last_change":"2024-03-31T16:35:32.083381+0000","last_active":"2024-03-31T16:35:33.629965+0000","last_peered":"2024-03-31T16:35:33.629965+0000","last_clean":"2024-03-31T16:35:33.629965+0000","last_became_active":"2024-03-31T16:35:32.083134+0000","last_became_peered":"2024-03-31T16:35:32.083134+0000","last_unstale":"2024-03-31T16:35:33.629965+0000","last_undegraded":"2024-03-31T16:35:33.629965+0000","last_fullsized":"2024-03-31T16:35:33.629965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078368+0000","last_change":"2024-03-31T16:35:32.079624+0000","last_active":"2024-03-31T16:35:33.078368+0000","last_peered":"2024-03-31T16:35:33.078368+0000","last_clean":"2024-03-31T16:35:33.078368+0000","last_became_active":"2024-03-31T16:35:32.079376+0000","last_became_peered":"2024-03-31T16:35:32.079376+0000","last_unstale":"2024-03-31T16:35:33.078368+0000","last_undegraded":"2024-03-31T16:35:33.078368+0000","last_fullsized":"2024-03-31T16:35:33.078368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630066+0000","last_change":"2024-03-31T16:35:32.070619+0000","last_active":"2024-03-31T16:35:33.630066+0000","last_peered":"2024-03-31T16:35:33.630066+0000","last_clean":"2024-03-31T16:35:33.630066+0000","last_became_active":"2024-03-31T16:35:32.070240+0000","last_became_peered":"2024-03-31T16:35:32.070240+0000","last_unstale":"2024-03-31T16:35:33.630066+0000","last_undegraded":"2024-03-31T16:35:33.630066+0000","last_fullsized":"2024-03-31T16:35:33.630066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079368+0000","last_change":"2024-03-31T16:35:32.069561+0000","last_active":"2024-03-31T16:35:33.079368+0000","last_peered":"2024-03-31T16:35:33.079368+0000","last_clean":"2024-03-31T16:35:33.079368+0000","last_became_active":"2024-03-31T16:35:32.069299+0000","last_became_peered":"2024-03-31T16:35:32.069299+0000","last_unstale":"2024-03-31T16:35:33.079368+0000","last_undegraded":"2024-03-31T16:35:33.079368+0000","last_fullsized":"2024-03-31T16:35:33.079368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311327+0000","last_change":"2024-03-31T16:35:32.077589+0000","last_active":"2024-03-31T16:35:33.311327+0000","last_peered":"2024-03-31T16:35:33.311327+0000","last_clean":"2024-03-31T16:35:33.311327+0000","last_became_active":"2024-03-31T16:35:32.077321+0000","last_became_peered":"2024-03-31T16:35:32.077321+0000","last_unstale":"2024-03-31T16:35:33.311327+0000","last_undegraded":"2024-03-31T16:35:33.311327+0000","last_fullsized":"2024-03-31T16:35:33.311327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078983+0000","last_change":"2024-03-31T16:35:32.077562+0000","last_active":"2024-03-31T16:35:33.078983+0000","last_peered":"2024-03-31T16:35:33.078983+0000","last_clean":"2024-03-31T16:35:33.078983+0000","last_became_active":"2024-03-31T16:35:32.077275+0000","last_became_peered":"2024-03-31T16:35:32.077275+0000","last_unstale":"2024-03-31T16:35:33.078983+0000","last_undegraded":"2024-03-31T16:35:33.078983+0000","last_fullsized":"2024-03-31T16:35:33.078983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311700+0000","last_change":"2024-03-31T16:35:32.086200+0000","last_active":"2024-03-31T16:35:33.311700+0000","last_peered":"2024-03-31T16:35:33.311700+0000","last_clean":"2024-03-31T16:35:33.311700+0000","last_became_active":"2024-03-31T16:35:32.085924+0000","last_became_peered":"2024-03-31T16:35:32.085924+0000","last_unstale":"2024-03-31T16:35:33.311700+0000","last_undegraded":"2024-03-31T16:35:33.311700+0000","last_fullsized":"2024-03-31T16:35:33.311700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078702+0000","last_change":"2024-03-31T16:35:32.088160+0000","last_active":"2024-03-31T16:35:33.078702+0000","last_peered":"2024-03-31T16:35:33.078702+0000","last_clean":"2024-03-31T16:35:33.078702+0000","last_became_active":"2024-03-31T16:35:32.087875+0000","last_became_peered":"2024-03-31T16:35:32.087875+0000","last_unstale":"2024-03-31T16:35:33.078702+0000","last_undegraded":"2024-03-31T16:35:33.078702+0000","last_fullsized":"2024-03-31T16:35:33.078702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:32.075010+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:32.074715+0000","last_became_peered":"2024-03-31T16:35:32.074715+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311571+0000","last_change":"2024-03-31T16:35:32.077435+0000","last_active":"2024-03-31T16:35:33.311571+0000","last_peered":"2024-03-31T16:35:33.311571+0000","last_clean":"2024-03-31T16:35:33.311571+0000","last_became_active":"2024-03-31T16:35:32.077163+0000","last_became_peered":"2024-03-31T16:35:32.077163+0000","last_unstale":"2024-03-31T16:35:33.311571+0000","last_undegraded":"2024-03-31T16:35:33.311571+0000","last_fullsized":"2024-03-31T16:35:33.311571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630102+0000","last_change":"2024-03-31T16:35:32.076462+0000","last_active":"2024-03-31T16:35:33.630102+0000","last_peered":"2024-03-31T16:35:33.630102+0000","last_clean":"2024-03-31T16:35:33.630102+0000","last_became_active":"2024-03-31T16:35:32.076201+0000","last_became_peered":"2024-03-31T16:35:32.076201+0000","last_unstale":"2024-03-31T16:35:33.630102+0000","last_undegraded":"2024-03-31T16:35:33.630102+0000","last_fullsized":"2024-03-31T16:35:33.630102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079461+0000","last_change":"2024-03-31T16:35:32.074783+0000","last_active":"2024-03-31T16:35:33.079461+0000","last_peered":"2024-03-31T16:35:33.079461+0000","last_clean":"2024-03-31T16:35:33.079461+0000","last_became_active":"2024-03-31T16:35:32.074536+0000","last_became_peered":"2024-03-31T16:35:32.074536+0000","last_unstale":"2024-03-31T16:35:33.079461+0000","last_undegraded":"2024-03-31T16:35:33.079461+0000","last_fullsized":"2024-03-31T16:35:33.079461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128826+0000","last_change":"2024-03-31T16:35:32.077326+0000","last_active":"2024-03-31T16:35:33.128826+0000","last_peered":"2024-03-31T16:35:33.128826+0000","last_clean":"2024-03-31T16:35:33.128826+0000","last_became_active":"2024-03-31T16:35:32.077039+0000","last_became_peered":"2024-03-31T16:35:32.077039+0000","last_unstale":"2024-03-31T16:35:33.128826+0000","last_undegraded":"2024-03-31T16:35:33.128826+0000","last_fullsized":"2024-03-31T16:35:33.128826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077057+0000","last_change":"2024-03-31T16:35:32.085061+0000","last_active":"2024-03-31T16:35:33.077057+0000","last_peered":"2024-03-31T16:35:33.077057+0000","last_clean":"2024-03-31T16:35:33.077057+0000","last_became_active":"2024-03-31T16:35:32.084792+0000","last_became_peered":"2024-03-31T16:35:32.084792+0000","last_unstale":"2024-03-31T16:35:33.077057+0000","last_undegraded":"2024-03-31T16:35:33.077057+0000","last_fullsized":"2024-03-31T16:35:33.077057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078221+0000","last_change":"2024-03-31T16:35:32.074311+0000","last_active":"2024-03-31T16:35:33.078221+0000","last_peered":"2024-03-31T16:35:33.078221+0000","last_clean":"2024-03-31T16:35:33.078221+0000","last_became_active":"2024-03-31T16:35:32.074039+0000","last_became_peered":"2024-03-31T16:35:32.074039+0000","last_unstale":"2024-03-31T16:35:33.078221+0000","last_undegraded":"2024-03-31T16:35:33.078221+0000","last_fullsized":"2024-03-31T16:35:33.078221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:44.307915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311618+0000","last_change":"2024-03-31T16:35:31.078753+0000","last_active":"2024-03-31T16:35:33.311618+0000","last_peered":"2024-03-31T16:35:33.311618+0000","last_clean":"2024-03-31T16:35:33.311618+0000","last_became_active":"2024-03-31T16:35:31.078408+0000","last_became_peered":"2024-03-31T16:35:31.078408+0000","last_unstale":"2024-03-31T16:35:33.311618+0000","last_undegraded":"2024-03-31T16:35:33.311618+0000","last_fullsized":"2024-03-31T16:35:33.311618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630191+0000","last_change":"2024-03-31T16:35:32.070960+0000","last_active":"2024-03-31T16:35:33.630191+0000","last_peered":"2024-03-31T16:35:33.630191+0000","last_clean":"2024-03-31T16:35:33.630191+0000","last_became_active":"2024-03-31T16:35:32.070713+0000","last_became_peered":"2024-03-31T16:35:32.070713+0000","last_unstale":"2024-03-31T16:35:33.630191+0000","last_undegraded":"2024-03-31T16:35:33.630191+0000","last_fullsized":"2024-03-31T16:35:33.630191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077405+0000","last_change":"2024-03-31T16:35:31.076917+0000","last_active":"2024-03-31T16:35:33.077405+0000","last_peered":"2024-03-31T16:35:33.077405+0000","last_clean":"2024-03-31T16:35:33.077405+0000","last_became_active":"2024-03-31T16:35:31.076373+0000","last_became_peered":"2024-03-31T16:35:31.076373+0000","last_unstale":"2024-03-31T16:35:33.077405+0000","last_undegraded":"2024-03-31T16:35:33.077405+0000","last_fullsized":"2024-03-31T16:35:33.077405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311424+0000","last_change":"2024-03-31T16:35:31.072420+0000","last_active":"2024-03-31T16:35:33.311424+0000","last_peered":"2024-03-31T16:35:33.311424+0000","last_clean":"2024-03-31T16:35:33.311424+0000","last_became_active":"2024-03-31T16:35:31.071802+0000","last_became_peered":"2024-03-31T16:35:31.071802+0000","last_unstale":"2024-03-31T16:35:33.311424+0000","last_undegraded":"2024-03-31T16:35:33.311424+0000","last_fullsized":"2024-03-31T16:35:33.311424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311331+0000","last_change":"2024-03-31T16:35:32.074735+0000","last_active":"2024-03-31T16:35:33.311331+0000","last_peered":"2024-03-31T16:35:33.311331+0000","last_clean":"2024-03-31T16:35:33.311331+0000","last_became_active":"2024-03-31T16:35:32.074093+0000","last_became_peered":"2024-03-31T16:35:32.074093+0000","last_unstale":"2024-03-31T16:35:33.311331+0000","last_undegraded":"2024-03-31T16:35:33.311331+0000","last_fullsized":"2024-03-31T16:35:33.311331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079036+0000","last_change":"2024-03-31T16:35:31.073148+0000","last_active":"2024-03-31T16:35:33.079036+0000","last_peered":"2024-03-31T16:35:33.079036+0000","last_clean":"2024-03-31T16:35:33.079036+0000","last_became_active":"2024-03-31T16:35:31.072813+0000","last_became_peered":"2024-03-31T16:35:31.072813+0000","last_unstale":"2024-03-31T16:35:33.079036+0000","last_undegraded":"2024-03-31T16:35:33.079036+0000","last_fullsized":"2024-03-31T16:35:33.079036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074452+0000","last_change":"2024-03-31T16:35:32.076380+0000","last_active":"2024-03-31T16:35:33.074452+0000","last_peered":"2024-03-31T16:35:33.074452+0000","last_clean":"2024-03-31T16:35:33.074452+0000","last_became_active":"2024-03-31T16:35:32.076113+0000","last_became_peered":"2024-03-31T16:35:32.076113+0000","last_unstale":"2024-03-31T16:35:33.074452+0000","last_undegraded":"2024-03-31T16:35:33.074452+0000","last_fullsized":"2024-03-31T16:35:33.074452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078091+0000","last_change":"2024-03-31T16:35:31.075070+0000","last_active":"2024-03-31T16:35:33.078091+0000","last_peered":"2024-03-31T16:35:33.078091+0000","last_clean":"2024-03-31T16:35:33.078091+0000","last_became_active":"2024-03-31T16:35:31.074753+0000","last_became_peered":"2024-03-31T16:35:31.074753+0000","last_unstale":"2024-03-31T16:35:33.078091+0000","last_undegraded":"2024-03-31T16:35:33.078091+0000","last_fullsized":"2024-03-31T16:35:33.078091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078764+0000","last_change":"2024-03-31T16:35:32.067130+0000","last_active":"2024-03-31T16:35:33.078764+0000","last_peered":"2024-03-31T16:35:33.078764+0000","last_clean":"2024-03-31T16:35:33.078764+0000","last_became_active":"2024-03-31T16:35:32.066719+0000","last_became_peered":"2024-03-31T16:35:32.066719+0000","last_unstale":"2024-03-31T16:35:33.078764+0000","last_undegraded":"2024-03-31T16:35:33.078764+0000","last_fullsized":"2024-03-31T16:35:33.078764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078833+0000","last_change":"2024-03-31T16:35:31.074858+0000","last_active":"2024-03-31T16:35:33.078833+0000","last_peered":"2024-03-31T16:35:33.078833+0000","last_clean":"2024-03-31T16:35:33.078833+0000","last_became_active":"2024-03-31T16:35:31.074274+0000","last_became_peered":"2024-03-31T16:35:31.074274+0000","last_unstale":"2024-03-31T16:35:33.078833+0000","last_undegraded":"2024-03-31T16:35:33.078833+0000","last_fullsized":"2024-03-31T16:35:33.078833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629883+0000","last_change":"2024-03-31T16:35:32.069889+0000","last_active":"2024-03-31T16:35:33.629883+0000","last_peered":"2024-03-31T16:35:33.629883+0000","last_clean":"2024-03-31T16:35:33.629883+0000","last_became_active":"2024-03-31T16:35:32.069595+0000","last_became_peered":"2024-03-31T16:35:32.069595+0000","last_unstale":"2024-03-31T16:35:33.629883+0000","last_undegraded":"2024-03-31T16:35:33.629883+0000","last_fullsized":"2024-03-31T16:35:33.629883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:31.075199+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:31.074912+0000","last_became_peered":"2024-03-31T16:35:31.074912+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078396+0000","last_change":"2024-03-31T16:35:32.075288+0000","last_active":"2024-03-31T16:35:33.078396+0000","last_peered":"2024-03-31T16:35:33.078396+0000","last_clean":"2024-03-31T16:35:33.078396+0000","last_became_active":"2024-03-31T16:35:32.074982+0000","last_became_peered":"2024-03-31T16:35:32.074982+0000","last_unstale":"2024-03-31T16:35:33.078396+0000","last_undegraded":"2024-03-31T16:35:33.078396+0000","last_fullsized":"2024-03-31T16:35:33.078396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078276+0000","last_change":"2024-03-31T16:35:31.071044+0000","last_active":"2024-03-31T16:35:33.078276+0000","last_peered":"2024-03-31T16:35:33.078276+0000","last_clean":"2024-03-31T16:35:33.078276+0000","last_became_active":"2024-03-31T16:35:31.070775+0000","last_became_peered":"2024-03-31T16:35:31.070775+0000","last_unstale":"2024-03-31T16:35:33.078276+0000","last_undegraded":"2024-03-31T16:35:33.078276+0000","last_fullsized":"2024-03-31T16:35:33.078276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629719+0000","last_change":"2024-03-31T16:35:32.082874+0000","last_active":"2024-03-31T16:35:33.629719+0000","last_peered":"2024-03-31T16:35:33.629719+0000","last_clean":"2024-03-31T16:35:33.629719+0000","last_became_active":"2024-03-31T16:35:32.082582+0000","last_became_peered":"2024-03-31T16:35:32.082582+0000","last_unstale":"2024-03-31T16:35:33.629719+0000","last_undegraded":"2024-03-31T16:35:33.629719+0000","last_fullsized":"2024-03-31T16:35:33.629719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630199+0000","last_change":"2024-03-31T16:35:31.072679+0000","last_active":"2024-03-31T16:35:33.630199+0000","last_peered":"2024-03-31T16:35:33.630199+0000","last_clean":"2024-03-31T16:35:33.630199+0000","last_became_active":"2024-03-31T16:35:31.072349+0000","last_became_peered":"2024-03-31T16:35:31.072349+0000","last_unstale":"2024-03-31T16:35:33.630199+0000","last_undegraded":"2024-03-31T16:35:33.630199+0000","last_fullsized":"2024-03-31T16:35:33.630199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629731+0000","last_change":"2024-03-31T16:35:32.072536+0000","last_active":"2024-03-31T16:35:33.629731+0000","last_peered":"2024-03-31T16:35:33.629731+0000","last_clean":"2024-03-31T16:35:33.629731+0000","last_became_active":"2024-03-31T16:35:32.072299+0000","last_became_peered":"2024-03-31T16:35:32.072299+0000","last_unstale":"2024-03-31T16:35:33.629731+0000","last_undegraded":"2024-03-31T16:35:33.629731+0000","last_fullsized":"2024-03-31T16:35:33.629731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079455+0000","last_change":"2024-03-31T16:35:31.071681+0000","last_active":"2024-03-31T16:35:33.079455+0000","last_peered":"2024-03-31T16:35:33.079455+0000","last_clean":"2024-03-31T16:35:33.079455+0000","last_became_active":"2024-03-31T16:35:31.071425+0000","last_became_peered":"2024-03-31T16:35:31.071425+0000","last_unstale":"2024-03-31T16:35:33.079455+0000","last_undegraded":"2024-03-31T16:35:33.079455+0000","last_fullsized":"2024-03-31T16:35:33.079455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629860+0000","last_change":"2024-03-31T16:35:32.081639+0000","last_active":"2024-03-31T16:35:33.629860+0000","last_peered":"2024-03-31T16:35:33.629860+0000","last_clean":"2024-03-31T16:35:33.629860+0000","last_became_active":"2024-03-31T16:35:32.081101+0000","last_became_peered":"2024-03-31T16:35:32.081101+0000","last_unstale":"2024-03-31T16:35:33.629860+0000","last_undegraded":"2024-03-31T16:35:33.629860+0000","last_fullsized":"2024-03-31T16:35:33.629860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077272+0000","last_change":"2024-03-31T16:35:31.076342+0000","last_active":"2024-03-31T16:35:33.077272+0000","last_peered":"2024-03-31T16:35:33.077272+0000","last_clean":"2024-03-31T16:35:33.077272+0000","last_became_active":"2024-03-31T16:35:31.075546+0000","last_became_peered":"2024-03-31T16:35:31.075546+0000","last_unstale":"2024-03-31T16:35:33.077272+0000","last_undegraded":"2024-03-31T16:35:33.077272+0000","last_fullsized":"2024-03-31T16:35:33.077272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077346+0000","last_change":"2024-03-31T16:35:32.077698+0000","last_active":"2024-03-31T16:35:33.077346+0000","last_peered":"2024-03-31T16:35:33.077346+0000","last_clean":"2024-03-31T16:35:33.077346+0000","last_became_active":"2024-03-31T16:35:32.077415+0000","last_became_peered":"2024-03-31T16:35:32.077415+0000","last_unstale":"2024-03-31T16:35:33.077346+0000","last_undegraded":"2024-03-31T16:35:33.077346+0000","last_fullsized":"2024-03-31T16:35:33.077346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128862+0000","last_change":"2024-03-31T16:35:31.066612+0000","last_active":"2024-03-31T16:35:33.128862+0000","last_peered":"2024-03-31T16:35:33.128862+0000","last_clean":"2024-03-31T16:35:33.128862+0000","last_became_active":"2024-03-31T16:35:31.066089+0000","last_became_peered":"2024-03-31T16:35:31.066089+0000","last_unstale":"2024-03-31T16:35:33.128862+0000","last_undegraded":"2024-03-31T16:35:33.128862+0000","last_fullsized":"2024-03-31T16:35:33.128862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629500+0000","last_change":"2024-03-31T16:35:32.078195+0000","last_active":"2024-03-31T16:35:33.629500+0000","last_peered":"2024-03-31T16:35:33.629500+0000","last_clean":"2024-03-31T16:35:33.629500+0000","last_became_active":"2024-03-31T16:35:32.077878+0000","last_became_peered":"2024-03-31T16:35:32.077878+0000","last_unstale":"2024-03-31T16:35:33.629500+0000","last_undegraded":"2024-03-31T16:35:33.629500+0000","last_fullsized":"2024-03-31T16:35:33.629500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078606+0000","last_change":"2024-03-31T16:35:31.073893+0000","last_active":"2024-03-31T16:35:33.078606+0000","last_peered":"2024-03-31T16:35:33.078606+0000","last_clean":"2024-03-31T16:35:33.078606+0000","last_became_active":"2024-03-31T16:35:31.073625+0000","last_became_peered":"2024-03-31T16:35:31.073625+0000","last_unstale":"2024-03-31T16:35:33.078606+0000","last_undegraded":"2024-03-31T16:35:33.078606+0000","last_fullsized":"2024-03-31T16:35:33.078606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:09:31.419651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629895+0000","last_change":"2024-03-31T16:35:32.082027+0000","last_active":"2024-03-31T16:35:33.629895+0000","last_peered":"2024-03-31T16:35:33.629895+0000","last_clean":"2024-03-31T16:35:33.629895+0000","last_became_active":"2024-03-31T16:35:32.080888+0000","last_became_peered":"2024-03-31T16:35:32.080888+0000","last_unstale":"2024-03-31T16:35:33.629895+0000","last_undegraded":"2024-03-31T16:35:33.629895+0000","last_fullsized":"2024-03-31T16:35:33.629895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128888+0000","last_change":"2024-03-31T16:35:31.071984+0000","last_active":"2024-03-31T16:35:33.128888+0000","last_peered":"2024-03-31T16:35:33.128888+0000","last_clean":"2024-03-31T16:35:33.128888+0000","last_became_active":"2024-03-31T16:35:31.071703+0000","last_became_peered":"2024-03-31T16:35:31.071703+0000","last_unstale":"2024-03-31T16:35:33.128888+0000","last_undegraded":"2024-03-31T16:35:33.128888+0000","last_fullsized":"2024-03-31T16:35:33.128888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630062+0000","last_change":"2024-03-31T16:35:32.081372+0000","last_active":"2024-03-31T16:35:33.630062+0000","last_peered":"2024-03-31T16:35:33.630062+0000","last_clean":"2024-03-31T16:35:33.630062+0000","last_became_active":"2024-03-31T16:35:32.081052+0000","last_became_peered":"2024-03-31T16:35:32.081052+0000","last_unstale":"2024-03-31T16:35:33.630062+0000","last_undegraded":"2024-03-31T16:35:33.630062+0000","last_fullsized":"2024-03-31T16:35:33.630062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:11:37.125510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074783+0000","last_change":"2024-03-31T16:35:31.071727+0000","last_active":"2024-03-31T16:35:33.074783+0000","last_peered":"2024-03-31T16:35:33.074783+0000","last_clean":"2024-03-31T16:35:33.074783+0000","last_became_active":"2024-03-31T16:35:31.071417+0000","last_became_peered":"2024-03-31T16:35:31.071417+0000","last_unstale":"2024-03-31T16:35:33.074783+0000","last_undegraded":"2024-03-31T16:35:33.074783+0000","last_fullsized":"2024-03-31T16:35:33.074783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079593+0000","last_change":"2024-03-31T16:35:32.075436+0000","last_active":"2024-03-31T16:35:33.079593+0000","last_peered":"2024-03-31T16:35:33.079593+0000","last_clean":"2024-03-31T16:35:33.079593+0000","last_became_active":"2024-03-31T16:35:32.075165+0000","last_became_peered":"2024-03-31T16:35:32.075165+0000","last_unstale":"2024-03-31T16:35:33.079593+0000","last_undegraded":"2024-03-31T16:35:33.079593+0000","last_fullsized":"2024-03-31T16:35:33.079593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128801+0000","last_change":"2024-03-31T16:35:31.075714+0000","last_active":"2024-03-31T16:35:33.128801+0000","last_peered":"2024-03-31T16:35:33.128801+0000","last_clean":"2024-03-31T16:35:33.128801+0000","last_became_active":"2024-03-31T16:35:31.075208+0000","last_became_peered":"2024-03-31T16:35:31.075208+0000","last_unstale":"2024-03-31T16:35:33.128801+0000","last_undegraded":"2024-03-31T16:35:33.128801+0000","last_fullsized":"2024-03-31T16:35:33.128801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629869+0000","last_change":"2024-03-31T16:35:32.083722+0000","last_active":"2024-03-31T16:35:33.629869+0000","last_peered":"2024-03-31T16:35:33.629869+0000","last_clean":"2024-03-31T16:35:33.629869+0000","last_became_active":"2024-03-31T16:35:32.082940+0000","last_became_peered":"2024-03-31T16:35:32.082940+0000","last_unstale":"2024-03-31T16:35:33.629869+0000","last_undegraded":"2024-03-31T16:35:33.629869+0000","last_fullsized":"2024-03-31T16:35:33.629869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629462+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:35:33.629462+0000","last_peered":"2024-03-31T16:35:33.629462+0000","last_clean":"2024-03-31T16:35:33.629462+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:35:33.629462+0000","last_undegraded":"2024-03-31T16:35:33.629462+0000","last_fullsized":"2024-03-31T16:35:33.629462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077654+0000","last_change":"2024-03-31T16:35:31.067899+0000","last_active":"2024-03-31T16:35:33.077654+0000","last_peered":"2024-03-31T16:35:33.077654+0000","last_clean":"2024-03-31T16:35:33.077654+0000","last_became_active":"2024-03-31T16:35:31.067599+0000","last_became_peered":"2024-03-31T16:35:31.067599+0000","last_unstale":"2024-03-31T16:35:33.077654+0000","last_undegraded":"2024-03-31T16:35:33.077654+0000","last_fullsized":"2024-03-31T16:35:33.077654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311433+0000","last_change":"2024-03-31T16:35:32.075582+0000","last_active":"2024-03-31T16:35:33.311433+0000","last_peered":"2024-03-31T16:35:33.311433+0000","last_clean":"2024-03-31T16:35:33.311433+0000","last_became_active":"2024-03-31T16:35:32.075305+0000","last_became_peered":"2024-03-31T16:35:32.075305+0000","last_unstale":"2024-03-31T16:35:33.311433+0000","last_undegraded":"2024-03-31T16:35:33.311433+0000","last_fullsized":"2024-03-31T16:35:33.311433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629405+0000","last_change":"2024-03-31T16:35:31.077578+0000","last_active":"2024-03-31T16:35:33.629405+0000","last_peered":"2024-03-31T16:35:33.629405+0000","last_clean":"2024-03-31T16:35:33.629405+0000","last_became_active":"2024-03-31T16:35:31.076918+0000","last_became_peered":"2024-03-31T16:35:31.076918+0000","last_unstale":"2024-03-31T16:35:33.629405+0000","last_undegraded":"2024-03-31T16:35:33.629405+0000","last_fullsized":"2024-03-31T16:35:33.629405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629665+0000","last_change":"2024-03-31T16:35:32.071942+0000","last_active":"2024-03-31T16:35:33.629665+0000","last_peered":"2024-03-31T16:35:33.629665+0000","last_clean":"2024-03-31T16:35:33.629665+0000","last_became_active":"2024-03-31T16:35:32.071670+0000","last_became_peered":"2024-03-31T16:35:32.071670+0000","last_unstale":"2024-03-31T16:35:33.629665+0000","last_undegraded":"2024-03-31T16:35:33.629665+0000","last_fullsized":"2024-03-31T16:35:33.629665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:25:21.037477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128907+0000","last_change":"2024-03-31T16:35:31.070684+0000","last_active":"2024-03-31T16:35:33.128907+0000","last_peered":"2024-03-31T16:35:33.128907+0000","last_clean":"2024-03-31T16:35:33.128907+0000","last_became_active":"2024-03-31T16:35:31.070356+0000","last_became_peered":"2024-03-31T16:35:31.070356+0000","last_unstale":"2024-03-31T16:35:33.128907+0000","last_undegraded":"2024-03-31T16:35:33.128907+0000","last_fullsized":"2024-03-31T16:35:33.128907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074515+0000","last_change":"2024-03-31T16:35:32.069540+0000","last_active":"2024-03-31T16:35:33.074515+0000","last_peered":"2024-03-31T16:35:33.074515+0000","last_clean":"2024-03-31T16:35:33.074515+0000","last_became_active":"2024-03-31T16:35:32.069256+0000","last_became_peered":"2024-03-31T16:35:32.069256+0000","last_unstale":"2024-03-31T16:35:33.074515+0000","last_undegraded":"2024-03-31T16:35:33.074515+0000","last_fullsized":"2024-03-31T16:35:33.074515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079522+0000","last_change":"2024-03-31T16:35:31.069729+0000","last_active":"2024-03-31T16:35:33.079522+0000","last_peered":"2024-03-31T16:35:33.079522+0000","last_clean":"2024-03-31T16:35:33.079522+0000","last_became_active":"2024-03-31T16:35:31.069435+0000","last_became_peered":"2024-03-31T16:35:31.069435+0000","last_unstale":"2024-03-31T16:35:33.079522+0000","last_undegraded":"2024-03-31T16:35:33.079522+0000","last_fullsized":"2024-03-31T16:35:33.079522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078662+0000","last_change":"2024-03-31T16:35:32.072296+0000","last_active":"2024-03-31T16:35:33.078662+0000","last_peered":"2024-03-31T16:35:33.078662+0000","last_clean":"2024-03-31T16:35:33.078662+0000","last_became_active":"2024-03-31T16:35:32.071947+0000","last_became_peered":"2024-03-31T16:35:32.071947+0000","last_unstale":"2024-03-31T16:35:33.078662+0000","last_undegraded":"2024-03-31T16:35:33.078662+0000","last_fullsized":"2024-03-31T16:35:33.078662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074675+0000","last_change":"2024-03-31T16:35:31.070142+0000","last_active":"2024-03-31T16:35:33.074675+0000","last_peered":"2024-03-31T16:35:33.074675+0000","last_clean":"2024-03-31T16:35:33.074675+0000","last_became_active":"2024-03-31T16:35:31.069855+0000","last_became_peered":"2024-03-31T16:35:31.069855+0000","last_unstale":"2024-03-31T16:35:33.074675+0000","last_undegraded":"2024-03-31T16:35:33.074675+0000","last_fullsized":"2024-03-31T16:35:33.074675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079469+0000","last_change":"2024-03-31T16:35:32.076452+0000","last_active":"2024-03-31T16:35:33.079469+0000","last_peered":"2024-03-31T16:35:33.079469+0000","last_clean":"2024-03-31T16:35:33.079469+0000","last_became_active":"2024-03-31T16:35:32.076176+0000","last_became_peered":"2024-03-31T16:35:32.076176+0000","last_unstale":"2024-03-31T16:35:33.079469+0000","last_undegraded":"2024-03-31T16:35:33.079469+0000","last_fullsized":"2024-03-31T16:35:33.079469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629942+0000","last_change":"2024-03-31T16:35:31.077517+0000","last_active":"2024-03-31T16:35:33.629942+0000","last_peered":"2024-03-31T16:35:33.629942+0000","last_clean":"2024-03-31T16:35:33.629942+0000","last_became_active":"2024-03-31T16:35:31.077239+0000","last_became_peered":"2024-03-31T16:35:31.077239+0000","last_unstale":"2024-03-31T16:35:33.629942+0000","last_undegraded":"2024-03-31T16:35:33.629942+0000","last_fullsized":"2024-03-31T16:35:33.629942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074667+0000","last_change":"2024-03-31T16:35:32.070836+0000","last_active":"2024-03-31T16:35:33.074667+0000","last_peered":"2024-03-31T16:35:33.074667+0000","last_clean":"2024-03-31T16:35:33.074667+0000","last_became_active":"2024-03-31T16:35:32.070521+0000","last_became_peered":"2024-03-31T16:35:32.070521+0000","last_unstale":"2024-03-31T16:35:33.074667+0000","last_undegraded":"2024-03-31T16:35:33.074667+0000","last_fullsized":"2024-03-31T16:35:33.074667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077062+0000","last_change":"2024-03-31T16:35:31.074489+0000","last_active":"2024-03-31T16:35:33.077062+0000","last_peered":"2024-03-31T16:35:33.077062+0000","last_clean":"2024-03-31T16:35:33.077062+0000","last_became_active":"2024-03-31T16:35:31.074195+0000","last_became_peered":"2024-03-31T16:35:31.074195+0000","last_unstale":"2024-03-31T16:35:33.077062+0000","last_undegraded":"2024-03-31T16:35:33.077062+0000","last_fullsized":"2024-03-31T16:35:33.077062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311754+0000","last_change":"2024-03-31T16:35:32.083120+0000","last_active":"2024-03-31T16:35:33.311754+0000","last_peered":"2024-03-31T16:35:33.311754+0000","last_clean":"2024-03-31T16:35:33.311754+0000","last_became_active":"2024-03-31T16:35:32.082841+0000","last_became_peered":"2024-03-31T16:35:32.082841+0000","last_unstale":"2024-03-31T16:35:33.311754+0000","last_undegraded":"2024-03-31T16:35:33.311754+0000","last_fullsized":"2024-03-31T16:35:33.311754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078173+0000","last_change":"2024-03-31T16:35:31.076558+0000","last_active":"2024-03-31T16:35:33.078173+0000","last_peered":"2024-03-31T16:35:33.078173+0000","last_clean":"2024-03-31T16:35:33.078173+0000","last_became_active":"2024-03-31T16:35:31.075298+0000","last_became_peered":"2024-03-31T16:35:31.075298+0000","last_unstale":"2024-03-31T16:35:33.078173+0000","last_undegraded":"2024-03-31T16:35:33.078173+0000","last_fullsized":"2024-03-31T16:35:33.078173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629833+0000","last_change":"2024-03-31T16:35:32.069455+0000","last_active":"2024-03-31T16:35:33.629833+0000","last_peered":"2024-03-31T16:35:33.629833+0000","last_clean":"2024-03-31T16:35:33.629833+0000","last_became_active":"2024-03-31T16:35:32.069153+0000","last_became_peered":"2024-03-31T16:35:32.069153+0000","last_unstale":"2024-03-31T16:35:33.629833+0000","last_undegraded":"2024-03-31T16:35:33.629833+0000","last_fullsized":"2024-03-31T16:35:33.629833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629400+0000","last_change":"2024-03-31T16:35:31.078800+0000","last_active":"2024-03-31T16:35:33.629400+0000","last_peered":"2024-03-31T16:35:33.629400+0000","last_clean":"2024-03-31T16:35:33.629400+0000","last_became_active":"2024-03-31T16:35:31.078459+0000","last_became_peered":"2024-03-31T16:35:31.078459+0000","last_unstale":"2024-03-31T16:35:33.629400+0000","last_undegraded":"2024-03-31T16:35:33.629400+0000","last_fullsized":"2024-03-31T16:35:33.629400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078033+0000","last_change":"2024-03-31T16:35:32.069622+0000","last_active":"2024-03-31T16:35:33.078033+0000","last_peered":"2024-03-31T16:35:33.078033+0000","last_clean":"2024-03-31T16:35:33.078033+0000","last_became_active":"2024-03-31T16:35:32.069306+0000","last_became_peered":"2024-03-31T16:35:32.069306+0000","last_unstale":"2024-03-31T16:35:33.078033+0000","last_undegraded":"2024-03-31T16:35:33.078033+0000","last_fullsized":"2024-03-31T16:35:33.078033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:09.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074545+0000","last_change":"2024-03-31T16:35:31.075114+0000","last_active":"2024-03-31T16:35:33.074545+0000","last_peered":"2024-03-31T16:35:33.074545+0000","last_clean":"2024-03-31T16:35:33.074545+0000","last_became_active":"2024-03-31T16:35:31.074806+0000","last_became_peered":"2024-03-31T16:35:31.074806+0000","last_unstale":"2024-03-31T16:35:33.074545+0000","last_undegraded":"2024-03-31T16:35:33.074545+0000","last_fullsized":"2024-03-31T16:35:33.074545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311430+0000","last_change":"2024-03-31T16:35:32.074953+0000","last_active":"2024-03-31T16:35:33.311430+0000","last_peered":"2024-03-31T16:35:33.311430+0000","last_clean":"2024-03-31T16:35:33.311430+0000","last_became_active":"2024-03-31T16:35:32.074427+0000","last_became_peered":"2024-03-31T16:35:32.074427+0000","last_unstale":"2024-03-31T16:35:33.311430+0000","last_undegraded":"2024-03-31T16:35:33.311430+0000","last_fullsized":"2024-03-31T16:35:33.311430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074527+0000","last_change":"2024-03-31T16:35:31.075011+0000","last_active":"2024-03-31T16:35:33.074527+0000","last_peered":"2024-03-31T16:35:33.074527+0000","last_clean":"2024-03-31T16:35:33.074527+0000","last_became_active":"2024-03-31T16:35:31.074731+0000","last_became_peered":"2024-03-31T16:35:31.074731+0000","last_unstale":"2024-03-31T16:35:33.074527+0000","last_undegraded":"2024-03-31T16:35:33.074527+0000","last_fullsized":"2024-03-31T16:35:33.074527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311546+0000","last_change":"2024-03-31T16:35:32.075723+0000","last_active":"2024-03-31T16:35:33.311546+0000","last_peered":"2024-03-31T16:35:33.311546+0000","last_clean":"2024-03-31T16:35:33.311546+0000","last_became_active":"2024-03-31T16:35:32.075324+0000","last_became_peered":"2024-03-31T16:35:32.075324+0000","last_unstale":"2024-03-31T16:35:33.311546+0000","last_undegraded":"2024-03-31T16:35:33.311546+0000","last_fullsized":"2024-03-31T16:35:33.311546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629868+0000","last_change":"2024-03-31T16:35:31.077732+0000","last_active":"2024-03-31T16:35:33.629868+0000","last_peered":"2024-03-31T16:35:33.629868+0000","last_clean":"2024-03-31T16:35:33.629868+0000","last_became_active":"2024-03-31T16:35:31.076950+0000","last_became_peered":"2024-03-31T16:35:31.076950+0000","last_unstale":"2024-03-31T16:35:33.629868+0000","last_undegraded":"2024-03-31T16:35:33.629868+0000","last_fullsized":"2024-03-31T16:35:33.629868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077294+0000","last_change":"2024-03-31T16:35:32.078813+0000","last_active":"2024-03-31T16:35:33.077294+0000","last_peered":"2024-03-31T16:35:33.077294+0000","last_clean":"2024-03-31T16:35:33.077294+0000","last_became_active":"2024-03-31T16:35:32.078564+0000","last_became_peered":"2024-03-31T16:35:32.078564+0000","last_unstale":"2024-03-31T16:35:33.077294+0000","last_undegraded":"2024-03-31T16:35:33.077294+0000","last_fullsized":"2024-03-31T16:35:33.077294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079367+0000","last_change":"2024-03-31T16:35:32.070433+0000","last_active":"2024-03-31T16:35:33.079367+0000","last_peered":"2024-03-31T16:35:33.079367+0000","last_clean":"2024-03-31T16:35:33.079367+0000","last_became_active":"2024-03-31T16:35:32.070040+0000","last_became_peered":"2024-03-31T16:35:32.070040+0000","last_unstale":"2024-03-31T16:35:33.079367+0000","last_undegraded":"2024-03-31T16:35:33.079367+0000","last_fullsized":"2024-03-31T16:35:33.079367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629671+0000","last_change":"2024-03-31T16:35:31.077383+0000","last_active":"2024-03-31T16:35:33.629671+0000","last_peered":"2024-03-31T16:35:33.629671+0000","last_clean":"2024-03-31T16:35:33.629671+0000","last_became_active":"2024-03-31T16:35:31.076971+0000","last_became_peered":"2024-03-31T16:35:31.076971+0000","last_unstale":"2024-03-31T16:35:33.629671+0000","last_undegraded":"2024-03-31T16:35:33.629671+0000","last_fullsized":"2024-03-31T16:35:33.629671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079595+0000","last_change":"2024-03-31T16:35:32.070447+0000","last_active":"2024-03-31T16:35:33.079595+0000","last_peered":"2024-03-31T16:35:33.079595+0000","last_clean":"2024-03-31T16:35:33.079595+0000","last_became_active":"2024-03-31T16:35:32.070062+0000","last_became_peered":"2024-03-31T16:35:32.070062+0000","last_unstale":"2024-03-31T16:35:33.079595+0000","last_undegraded":"2024-03-31T16:35:33.079595+0000","last_fullsized":"2024-03-31T16:35:33.079595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629811+0000","last_change":"2024-03-31T16:35:31.078244+0000","last_active":"2024-03-31T16:35:33.629811+0000","last_peered":"2024-03-31T16:35:33.629811+0000","last_clean":"2024-03-31T16:35:33.629811+0000","last_became_active":"2024-03-31T16:35:31.077952+0000","last_became_peered":"2024-03-31T16:35:31.077952+0000","last_unstale":"2024-03-31T16:35:33.629811+0000","last_undegraded":"2024-03-31T16:35:33.629811+0000","last_fullsized":"2024-03-31T16:35:33.629811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629875+0000","last_change":"2024-03-31T16:35:32.072440+0000","last_active":"2024-03-31T16:35:33.629875+0000","last_peered":"2024-03-31T16:35:33.629875+0000","last_clean":"2024-03-31T16:35:33.629875+0000","last_became_active":"2024-03-31T16:35:32.072156+0000","last_became_peered":"2024-03-31T16:35:32.072156+0000","last_unstale":"2024-03-31T16:35:33.629875+0000","last_undegraded":"2024-03-31T16:35:33.629875+0000","last_fullsized":"2024-03-31T16:35:33.629875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311695+0000","last_change":"2024-03-31T16:35:31.073210+0000","last_active":"2024-03-31T16:35:33.311695+0000","last_peered":"2024-03-31T16:35:33.311695+0000","last_clean":"2024-03-31T16:35:33.311695+0000","last_became_active":"2024-03-31T16:35:31.072922+0000","last_became_peered":"2024-03-31T16:35:31.072922+0000","last_unstale":"2024-03-31T16:35:33.311695+0000","last_undegraded":"2024-03-31T16:35:33.311695+0000","last_fullsized":"2024-03-31T16:35:33.311695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311639+0000","last_change":"2024-03-31T16:35:32.080402+0000","last_active":"2024-03-31T16:35:33.311639+0000","last_peered":"2024-03-31T16:35:33.311639+0000","last_clean":"2024-03-31T16:35:33.311639+0000","last_became_active":"2024-03-31T16:35:32.080137+0000","last_became_peered":"2024-03-31T16:35:32.080137+0000","last_unstale":"2024-03-31T16:35:33.311639+0000","last_undegraded":"2024-03-31T16:35:33.311639+0000","last_fullsized":"2024-03-31T16:35:33.311639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630039+0000","last_change":"2024-03-31T16:35:31.076017+0000","last_active":"2024-03-31T16:35:33.630039+0000","last_peered":"2024-03-31T16:35:33.630039+0000","last_clean":"2024-03-31T16:35:33.630039+0000","last_became_active":"2024-03-31T16:35:31.075647+0000","last_became_peered":"2024-03-31T16:35:31.075647+0000","last_unstale":"2024-03-31T16:35:33.630039+0000","last_undegraded":"2024-03-31T16:35:33.630039+0000","last_fullsized":"2024-03-31T16:35:33.630039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:35:42.530 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:35:42.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.662+0000 7f759ce55640 1 Processor -- start 2024-03-31T16:35:42.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.662+0000 7f759ce55640 1 -- start start 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f759ce55640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75980d0e70 0x7f75980cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f759ce55640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f759815f6e0 0x7f75980d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f759ce55640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75980d1790 con 0x7f75981621d0 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f759ce55640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f75980cf6c0 con 0x7f75980d0e70 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f759ce55640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75980cf9a0 con 0x7f759815f6e0 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f7595d9b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f759815f6e0 0x7f75980d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f759659c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75980d0e70 0x7f75980cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f759659c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75980d0e70 0x7f75980cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:44106/0 (socket says 172.21.15.120:44106) 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f759659c640 1 -- 172.21.15.120:0/761012487 learned_addr learned my addr 172.21.15.120:0/761012487 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f7595d9b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f759815f6e0 0x7f75980d1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:60784/0 (socket says 172.21.15.120:60784) 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.663+0000 7f7596d9d640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f75981621d0 0x7f7598162660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:49870/0 (socket says 172.21.15.120:49870) 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.664+0000 7f759659c640 1 -- 172.21.15.120:0/761012487 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f759815f6e0 msgr2=0x7f75980d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:42.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.664+0000 7f759659c640 1 --2- 172.21.15.120:0/761012487 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f759815f6e0 0x7f75980d1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.664+0000 7f759659c640 1 -- 172.21.15.120:0/761012487 >> v1:172.21.15.203:6789/0 conn(0x7f75981621d0 legacy=0x7f7598162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.664+0000 7f759659c640 1 -- 172.21.15.120:0/761012487 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75980cfc80 con 0x7f75980d0e70 2024-03-31T16:35:42.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.664+0000 7f759559a640 1 -- 172.21.15.120:0/761012487 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60978856 0 0) 0x7f75980d1790 con 0x7f75981621d0 2024-03-31T16:35:42.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.664+0000 7f7595d9b640 1 --2- 172.21.15.120:0/761012487 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f759815f6e0 0x7f75980d1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:42.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.664+0000 7f759659c640 1 --2- 172.21.15.120:0/761012487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75980d0e70 0x7f75980cf050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7588009e50 tx=0x7f758802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da0eb08c8c9a5e46 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:42.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759559a640 1 -- 172.21.15.120:0/761012487 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758802ca70 con 0x7f75980d0e70 2024-03-31T16:35:42.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759559a640 1 -- 172.21.15.120:0/761012487 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758802cc10 con 0x7f75980d0e70 2024-03-31T16:35:42.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759559a640 1 -- 172.21.15.120:0/761012487 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75880343f0 con 0x7f75980d0e70 2024-03-31T16:35:42.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759ce55640 1 -- 172.21.15.120:0/761012487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75980d0e70 msgr2=0x7f75980cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759ce55640 1 --2- 172.21.15.120:0/761012487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75980d0e70 0x7f75980cf050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7588009e50 tx=0x7f758802bed0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759ce55640 1 -- 172.21.15.120:0/761012487 shutdown_connections 2024-03-31T16:35:42.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759ce55640 1 --2- 172.21.15.120:0/761012487 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f759815f6e0 0x7f75980d1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759ce55640 1 --2- 172.21.15.120:0/761012487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75980d0e70 0x7f75980cf050 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759ce55640 1 -- 172.21.15.120:0/761012487 >> 172.21.15.120:0/761012487 conn(0x7f759808bfb0 msgr2=0x7f75980d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759ce55640 1 -- 172.21.15.120:0/761012487 shutdown_connections 2024-03-31T16:35:42.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.665+0000 7f759ce55640 1 -- 172.21.15.120:0/761012487 wait complete. 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.666+0000 7f759ce55640 1 Processor -- start 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f759ce55640 1 -- start start 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f759ce55640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75980d0e70 0x7f7598157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f759ce55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f759815f6e0 0x7f759806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f759ce55640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75981621d0 0x7f759806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f759ce55640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f759815fb40 con 0x7f759815f6e0 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f759ce55640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75980d0240 con 0x7f75981621d0 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f759ce55640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f759815e910 con 0x7f75980d0e70 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f7595d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f759815f6e0 0x7f759806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f7595d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f759815f6e0 0x7f759806cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52504/0 (socket says 172.21.15.120:52504) 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f7595d9b640 1 -- 172.21.15.120:0/4081178016 learned_addr learned my addr 172.21.15.120:0/4081178016 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:42.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f759659c640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75980d0e70 0x7f7598157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.667+0000 7f7596d9d640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75981621d0 0x7f759806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7595d9b640 1 -- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75980d0e70 msgr2=0x7f7598157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7595d9b640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75980d0e70 0x7f7598157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7595d9b640 1 -- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75981621d0 msgr2=0x7f759806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7595d9b640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75981621d0 0x7f759806d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7595d9b640 1 -- 172.21.15.120:0/4081178016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75980b9db0 con 0x7f759815f6e0 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f759659c640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75980d0e70 0x7f7598157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7596d9d640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75981621d0 0x7f759806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7595d9b640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f759815f6e0 0x7f759806cea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f758c00e960 tx=0x7f758c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7586ffd640 1 -- 172.21.15.120:0/4081178016 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c017070 con 0x7f759815f6e0 2024-03-31T16:35:42.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7598157f50 con 0x7f759815f6e0 2024-03-31T16:35:42.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7586ffd640 1 -- 172.21.15.120:0/4081178016 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c00ca00 con 0x7f759815f6e0 2024-03-31T16:35:42.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f7586ffd640 1 -- 172.21.15.120:0/4081178016 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c00cdd0 con 0x7f759815f6e0 2024-03-31T16:35:42.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.668+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75980cc3f0 con 0x7f759815f6e0 2024-03-31T16:35:42.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.669+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7598068cd0 con 0x7f759815f6e0 2024-03-31T16:35:42.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.669+0000 7f7586ffd640 1 -- 172.21.15.120:0/4081178016 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f758c01a070 con 0x7f759815f6e0 2024-03-31T16:35:42.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.670+0000 7f7586ffd640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f757806c8f0 0x7f757806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:42.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.670+0000 7f7586ffd640 1 -- 172.21.15.120:0/4081178016 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f758c08b9d0 con 0x7f759815f6e0 2024-03-31T16:35:42.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.670+0000 7f759659c640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f757806c8f0 0x7f757806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:42.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.670+0000 7f759659c640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f757806c8f0 0x7f757806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7588035000 tx=0x7f7588030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:42.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.674+0000 7f7586ffd640 1 -- 172.21.15.120:0/4081178016 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7598157f50 con 0x7f759815f6e0 2024-03-31T16:35:42.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.847+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f759808e580 con 0x7f757806c8f0 2024-03-31T16:35:42.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.853+0000 7f7586ffd640 1 -- 172.21.15.120:0/4081178016 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f759808e580 con 0x7f757806c8f0 2024-03-31T16:35:42.860 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:42.861 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f757806c8f0 msgr2=0x7f757806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f757806c8f0 0x7f757806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7588035000 tx=0x7f7588030000 comp rx=0 tx=0).stop 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f759815f6e0 msgr2=0x7f759806cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f759815f6e0 0x7f759806cea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f758c00e960 tx=0x7f758c00ee20 comp rx=0 tx=0).stop 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 shutdown_connections 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f757806c8f0 0x7f757806edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75981621d0 0x7f759806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f759815f6e0 0x7f759806cea0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 --2- 172.21.15.120:0/4081178016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75980d0e70 0x7f7598157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 >> 172.21.15.120:0/4081178016 conn(0x7f759808bfb0 msgr2=0x7f75980d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 shutdown_connections 2024-03-31T16:35:42.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:42.856+0000 7f759ce55640 1 -- 172.21.15.120:0/4081178016 wait complete. 2024-03-31T16:35:42.871 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-31T16:35:41.859890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.800179"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629943+0000","last_change":"2024-03-31T16:35:32.082188+0000","last_active":"2024-03-31T16:35:33.629943+0000","last_peered":"2024-03-31T16:35:33.629943+0000","last_clean":"2024-03-31T16:35:33.629943+0000","last_became_active":"2024-03-31T16:35:32.081925+0000","last_became_peered":"2024-03-31T16:35:32.081925+0000","last_unstale":"2024-03-31T16:35:33.629943+0000","last_undegraded":"2024-03-31T16:35:33.629943+0000","last_fullsized":"2024-03-31T16:35:33.629943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074810+0000","last_change":"2024-03-31T16:35:32.070694+0000","last_active":"2024-03-31T16:35:33.074810+0000","last_peered":"2024-03-31T16:35:33.074810+0000","last_clean":"2024-03-31T16:35:33.074810+0000","last_became_active":"2024-03-31T16:35:32.070442+0000","last_became_peered":"2024-03-31T16:35:32.070442+0000","last_unstale":"2024-03-31T16:35:33.074810+0000","last_undegraded":"2024-03-31T16:35:33.074810+0000","last_fullsized":"2024-03-31T16:35:33.074810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629856+0000","last_change":"2024-03-31T16:35:32.069876+0000","last_active":"2024-03-31T16:35:33.629856+0000","last_peered":"2024-03-31T16:35:33.629856+0000","last_clean":"2024-03-31T16:35:33.629856+0000","last_became_active":"2024-03-31T16:35:32.069638+0000","last_became_peered":"2024-03-31T16:35:32.069638+0000","last_unstale":"2024-03-31T16:35:33.629856+0000","last_undegraded":"2024-03-31T16:35:33.629856+0000","last_fullsized":"2024-03-31T16:35:33.629856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079518+0000","last_change":"2024-03-31T16:35:32.076897+0000","last_active":"2024-03-31T16:35:33.079518+0000","last_peered":"2024-03-31T16:35:33.079518+0000","last_clean":"2024-03-31T16:35:33.079518+0000","last_became_active":"2024-03-31T16:35:32.076633+0000","last_became_peered":"2024-03-31T16:35:32.076633+0000","last_unstale":"2024-03-31T16:35:33.079518+0000","last_undegraded":"2024-03-31T16:35:33.079518+0000","last_fullsized":"2024-03-31T16:35:33.079518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:35:15.584026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629757+0000","last_change":"2024-03-31T16:35:32.081370+0000","last_active":"2024-03-31T16:35:33.629757+0000","last_peered":"2024-03-31T16:35:33.629757+0000","last_clean":"2024-03-31T16:35:33.629757+0000","last_became_active":"2024-03-31T16:35:32.080814+0000","last_became_peered":"2024-03-31T16:35:32.080814+0000","last_unstale":"2024-03-31T16:35:33.629757+0000","last_undegraded":"2024-03-31T16:35:33.629757+0000","last_fullsized":"2024-03-31T16:35:33.629757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079237+0000","last_change":"2024-03-31T16:35:32.070742+0000","last_active":"2024-03-31T16:35:33.079237+0000","last_peered":"2024-03-31T16:35:33.079237+0000","last_clean":"2024-03-31T16:35:33.079237+0000","last_became_active":"2024-03-31T16:35:32.070264+0000","last_became_peered":"2024-03-31T16:35:32.070264+0000","last_unstale":"2024-03-31T16:35:33.079237+0000","last_undegraded":"2024-03-31T16:35:33.079237+0000","last_fullsized":"2024-03-31T16:35:33.079237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629493+0000","last_change":"2024-03-31T16:35:32.081753+0000","last_active":"2024-03-31T16:35:33.629493+0000","last_peered":"2024-03-31T16:35:33.629493+0000","last_clean":"2024-03-31T16:35:33.629493+0000","last_became_active":"2024-03-31T16:35:32.081453+0000","last_became_peered":"2024-03-31T16:35:32.081453+0000","last_unstale":"2024-03-31T16:35:33.629493+0000","last_undegraded":"2024-03-31T16:35:33.629493+0000","last_fullsized":"2024-03-31T16:35:33.629493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311273+0000","last_change":"2024-03-31T16:35:32.080813+0000","last_active":"2024-03-31T16:35:33.311273+0000","last_peered":"2024-03-31T16:35:33.311273+0000","last_clean":"2024-03-31T16:35:33.311273+0000","last_became_active":"2024-03-31T16:35:32.080309+0000","last_became_peered":"2024-03-31T16:35:32.080309+0000","last_unstale":"2024-03-31T16:35:33.311273+0000","last_undegraded":"2024-03-31T16:35:33.311273+0000","last_fullsized":"2024-03-31T16:35:33.311273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629958+0000","last_change":"2024-03-31T16:35:32.083450+0000","last_active":"2024-03-31T16:35:33.629958+0000","last_peered":"2024-03-31T16:35:33.629958+0000","last_clean":"2024-03-31T16:35:33.629958+0000","last_became_active":"2024-03-31T16:35:32.083187+0000","last_became_peered":"2024-03-31T16:35:32.083187+0000","last_unstale":"2024-03-31T16:35:33.629958+0000","last_undegraded":"2024-03-31T16:35:33.629958+0000","last_fullsized":"2024-03-31T16:35:33.629958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078571+0000","last_change":"2024-03-31T16:35:32.084349+0000","last_active":"2024-03-31T16:35:33.078571+0000","last_peered":"2024-03-31T16:35:33.078571+0000","last_clean":"2024-03-31T16:35:33.078571+0000","last_became_active":"2024-03-31T16:35:32.084055+0000","last_became_peered":"2024-03-31T16:35:32.084055+0000","last_unstale":"2024-03-31T16:35:33.078571+0000","last_undegraded":"2024-03-31T16:35:33.078571+0000","last_fullsized":"2024-03-31T16:35:33.078571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078081+0000","last_change":"2024-03-31T16:35:32.081612+0000","last_active":"2024-03-31T16:35:33.078081+0000","last_peered":"2024-03-31T16:35:33.078081+0000","last_clean":"2024-03-31T16:35:33.078081+0000","last_became_active":"2024-03-31T16:35:32.081288+0000","last_became_peered":"2024-03-31T16:35:32.081288+0000","last_unstale":"2024-03-31T16:35:33.078081+0000","last_undegraded":"2024-03-31T16:35:33.078081+0000","last_fullsized":"2024-03-31T16:35:33.078081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078261+0000","last_change":"2024-03-31T16:35:32.080466+0000","last_active":"2024-03-31T16:35:33.078261+0000","last_peered":"2024-03-31T16:35:33.078261+0000","last_clean":"2024-03-31T16:35:33.078261+0000","last_became_active":"2024-03-31T16:35:32.080192+0000","last_became_peered":"2024-03-31T16:35:32.080192+0000","last_unstale":"2024-03-31T16:35:33.078261+0000","last_undegraded":"2024-03-31T16:35:33.078261+0000","last_fullsized":"2024-03-31T16:35:33.078261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:56.678344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311515+0000","last_change":"2024-03-31T16:35:32.077617+0000","last_active":"2024-03-31T16:35:33.311515+0000","last_peered":"2024-03-31T16:35:33.311515+0000","last_clean":"2024-03-31T16:35:33.311515+0000","last_became_active":"2024-03-31T16:35:32.077017+0000","last_became_peered":"2024-03-31T16:35:32.077017+0000","last_unstale":"2024-03-31T16:35:33.311515+0000","last_undegraded":"2024-03-31T16:35:33.311515+0000","last_fullsized":"2024-03-31T16:35:33.311515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629702+0000","last_change":"2024-03-31T16:35:32.069024+0000","last_active":"2024-03-31T16:35:33.629702+0000","last_peered":"2024-03-31T16:35:33.629702+0000","last_clean":"2024-03-31T16:35:33.629702+0000","last_became_active":"2024-03-31T16:35:32.068738+0000","last_became_peered":"2024-03-31T16:35:32.068738+0000","last_unstale":"2024-03-31T16:35:33.629702+0000","last_undegraded":"2024-03-31T16:35:33.629702+0000","last_fullsized":"2024-03-31T16:35:33.629702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074478+0000","last_change":"2024-03-31T16:35:32.073796+0000","last_active":"2024-03-31T16:35:33.074478+0000","last_peered":"2024-03-31T16:35:33.074478+0000","last_clean":"2024-03-31T16:35:33.074478+0000","last_became_active":"2024-03-31T16:35:32.073514+0000","last_became_peered":"2024-03-31T16:35:32.073514+0000","last_unstale":"2024-03-31T16:35:33.074478+0000","last_undegraded":"2024-03-31T16:35:33.074478+0000","last_fullsized":"2024-03-31T16:35:33.074478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078993+0000","last_change":"2024-03-31T16:35:32.071718+0000","last_active":"2024-03-31T16:35:33.078993+0000","last_peered":"2024-03-31T16:35:33.078993+0000","last_clean":"2024-03-31T16:35:33.078993+0000","last_became_active":"2024-03-31T16:35:32.071286+0000","last_became_peered":"2024-03-31T16:35:32.071286+0000","last_unstale":"2024-03-31T16:35:33.078993+0000","last_undegraded":"2024-03-31T16:35:33.078993+0000","last_fullsized":"2024-03-31T16:35:33.078993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078539+0000","last_change":"2024-03-31T16:35:32.076047+0000","last_active":"2024-03-31T16:35:33.078539+0000","last_peered":"2024-03-31T16:35:33.078539+0000","last_clean":"2024-03-31T16:35:33.078539+0000","last_became_active":"2024-03-31T16:35:32.075802+0000","last_became_peered":"2024-03-31T16:35:32.075802+0000","last_unstale":"2024-03-31T16:35:33.078539+0000","last_undegraded":"2024-03-31T16:35:33.078539+0000","last_fullsized":"2024-03-31T16:35:33.078539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128917+0000","last_change":"2024-03-31T16:35:32.080444+0000","last_active":"2024-03-31T16:35:33.128917+0000","last_peered":"2024-03-31T16:35:33.128917+0000","last_clean":"2024-03-31T16:35:33.128917+0000","last_became_active":"2024-03-31T16:35:32.080141+0000","last_became_peered":"2024-03-31T16:35:32.080141+0000","last_unstale":"2024-03-31T16:35:33.128917+0000","last_undegraded":"2024-03-31T16:35:33.128917+0000","last_fullsized":"2024-03-31T16:35:33.128917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629965+0000","last_change":"2024-03-31T16:35:32.083381+0000","last_active":"2024-03-31T16:35:33.629965+0000","last_peered":"2024-03-31T16:35:33.629965+0000","last_clean":"2024-03-31T16:35:33.629965+0000","last_became_active":"2024-03-31T16:35:32.083134+0000","last_became_peered":"2024-03-31T16:35:32.083134+0000","last_unstale":"2024-03-31T16:35:33.629965+0000","last_undegraded":"2024-03-31T16:35:33.629965+0000","last_fullsized":"2024-03-31T16:35:33.629965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078368+0000","last_change":"2024-03-31T16:35:32.079624+0000","last_active":"2024-03-31T16:35:33.078368+0000","last_peered":"2024-03-31T16:35:33.078368+0000","last_clean":"2024-03-31T16:35:33.078368+0000","last_became_active":"2024-03-31T16:35:32.079376+0000","last_became_peered":"2024-03-31T16:35:32.079376+0000","last_unstale":"2024-03-31T16:35:33.078368+0000","last_undegraded":"2024-03-31T16:35:33.078368+0000","last_fullsized":"2024-03-31T16:35:33.078368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630066+0000","last_change":"2024-03-31T16:35:32.070619+0000","last_active":"2024-03-31T16:35:33.630066+0000","last_peered":"2024-03-31T16:35:33.630066+0000","last_clean":"2024-03-31T16:35:33.630066+0000","last_became_active":"2024-03-31T16:35:32.070240+0000","last_became_peered":"2024-03-31T16:35:32.070240+0000","last_unstale":"2024-03-31T16:35:33.630066+0000","last_undegraded":"2024-03-31T16:35:33.630066+0000","last_fullsized":"2024-03-31T16:35:33.630066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079368+0000","last_change":"2024-03-31T16:35:32.069561+0000","last_active":"2024-03-31T16:35:33.079368+0000","last_peered":"2024-03-31T16:35:33.079368+0000","last_clean":"2024-03-31T16:35:33.079368+0000","last_became_active":"2024-03-31T16:35:32.069299+0000","last_became_peered":"2024-03-31T16:35:32.069299+0000","last_unstale":"2024-03-31T16:35:33.079368+0000","last_undegraded":"2024-03-31T16:35:33.079368+0000","last_fullsized":"2024-03-31T16:35:33.079368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311327+0000","last_change":"2024-03-31T16:35:32.077589+0000","last_active":"2024-03-31T16:35:33.311327+0000","last_peered":"2024-03-31T16:35:33.311327+0000","last_clean":"2024-03-31T16:35:33.311327+0000","last_became_active":"2024-03-31T16:35:32.077321+0000","last_became_peered":"2024-03-31T16:35:32.077321+0000","last_unstale":"2024-03-31T16:35:33.311327+0000","last_undegraded":"2024-03-31T16:35:33.311327+0000","last_fullsized":"2024-03-31T16:35:33.311327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078983+0000","last_change":"2024-03-31T16:35:32.077562+0000","last_active":"2024-03-31T16:35:33.078983+0000","last_peered":"2024-03-31T16:35:33.078983+0000","last_clean":"2024-03-31T16:35:33.078983+0000","last_became_active":"2024-03-31T16:35:32.077275+0000","last_became_peered":"2024-03-31T16:35:32.077275+0000","last_unstale":"2024-03-31T16:35:33.078983+0000","last_undegraded":"2024-03-31T16:35:33.078983+0000","last_fullsized":"2024-03-31T16:35:33.078983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311700+0000","last_change":"2024-03-31T16:35:32.086200+0000","last_active":"2024-03-31T16:35:33.311700+0000","last_peered":"2024-03-31T16:35:33.311700+0000","last_clean":"2024-03-31T16:35:33.311700+0000","last_became_active":"2024-03-31T16:35:32.085924+0000","last_became_peered":"2024-03-31T16:35:32.085924+0000","last_unstale":"2024-03-31T16:35:33.311700+0000","last_undegraded":"2024-03-31T16:35:33.311700+0000","last_fullsized":"2024-03-31T16:35:33.311700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078702+0000","last_change":"2024-03-31T16:35:32.088160+0000","last_active":"2024-03-31T16:35:33.078702+0000","last_peered":"2024-03-31T16:35:33.078702+0000","last_clean":"2024-03-31T16:35:33.078702+0000","last_became_active":"2024-03-31T16:35:32.087875+0000","last_became_peered":"2024-03-31T16:35:32.087875+0000","last_unstale":"2024-03-31T16:35:33.078702+0000","last_undegraded":"2024-03-31T16:35:33.078702+0000","last_fullsized":"2024-03-31T16:35:33.078702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:32.075010+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:32.074715+0000","last_became_peered":"2024-03-31T16:35:32.074715+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311571+0000","last_change":"2024-03-31T16:35:32.077435+0000","last_active":"2024-03-31T16:35:33.311571+0000","last_peered":"2024-03-31T16:35:33.311571+0000","last_clean":"2024-03-31T16:35:33.311571+0000","last_became_active":"2024-03-31T16:35:32.077163+0000","last_became_peered":"2024-03-31T16:35:32.077163+0000","last_unstale":"2024-03-31T16:35:33.311571+0000","last_undegraded":"2024-03-31T16:35:33.311571+0000","last_fullsized":"2024-03-31T16:35:33.311571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:21:08.386993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630102+0000","last_change":"2024-03-31T16:35:32.076462+0000","last_active":"2024-03-31T16:35:33.630102+0000","last_peered":"2024-03-31T16:35:33.630102+0000","last_clean":"2024-03-31T16:35:33.630102+0000","last_became_active":"2024-03-31T16:35:32.076201+0000","last_became_peered":"2024-03-31T16:35:32.076201+0000","last_unstale":"2024-03-31T16:35:33.630102+0000","last_undegraded":"2024-03-31T16:35:33.630102+0000","last_fullsized":"2024-03-31T16:35:33.630102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079461+0000","last_change":"2024-03-31T16:35:32.074783+0000","last_active":"2024-03-31T16:35:33.079461+0000","last_peered":"2024-03-31T16:35:33.079461+0000","last_clean":"2024-03-31T16:35:33.079461+0000","last_became_active":"2024-03-31T16:35:32.074536+0000","last_became_peered":"2024-03-31T16:35:32.074536+0000","last_unstale":"2024-03-31T16:35:33.079461+0000","last_undegraded":"2024-03-31T16:35:33.079461+0000","last_fullsized":"2024-03-31T16:35:33.079461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128826+0000","last_change":"2024-03-31T16:35:32.077326+0000","last_active":"2024-03-31T16:35:33.128826+0000","last_peered":"2024-03-31T16:35:33.128826+0000","last_clean":"2024-03-31T16:35:33.128826+0000","last_became_active":"2024-03-31T16:35:32.077039+0000","last_became_peered":"2024-03-31T16:35:32.077039+0000","last_unstale":"2024-03-31T16:35:33.128826+0000","last_undegraded":"2024-03-31T16:35:33.128826+0000","last_fullsized":"2024-03-31T16:35:33.128826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077057+0000","last_change":"2024-03-31T16:35:32.085061+0000","last_active":"2024-03-31T16:35:33.077057+0000","last_peered":"2024-03-31T16:35:33.077057+0000","last_clean":"2024-03-31T16:35:33.077057+0000","last_became_active":"2024-03-31T16:35:32.084792+0000","last_became_peered":"2024-03-31T16:35:32.084792+0000","last_unstale":"2024-03-31T16:35:33.077057+0000","last_undegraded":"2024-03-31T16:35:33.077057+0000","last_fullsized":"2024-03-31T16:35:33.077057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:42:26.519798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078221+0000","last_change":"2024-03-31T16:35:32.074311+0000","last_active":"2024-03-31T16:35:33.078221+0000","last_peered":"2024-03-31T16:35:33.078221+0000","last_clean":"2024-03-31T16:35:33.078221+0000","last_became_active":"2024-03-31T16:35:32.074039+0000","last_became_peered":"2024-03-31T16:35:32.074039+0000","last_unstale":"2024-03-31T16:35:33.078221+0000","last_undegraded":"2024-03-31T16:35:33.078221+0000","last_fullsized":"2024-03-31T16:35:33.078221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:44.307915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311618+0000","last_change":"2024-03-31T16:35:31.078753+0000","last_active":"2024-03-31T16:35:33.311618+0000","last_peered":"2024-03-31T16:35:33.311618+0000","last_clean":"2024-03-31T16:35:33.311618+0000","last_became_active":"2024-03-31T16:35:31.078408+0000","last_became_peered":"2024-03-31T16:35:31.078408+0000","last_unstale":"2024-03-31T16:35:33.311618+0000","last_undegraded":"2024-03-31T16:35:33.311618+0000","last_fullsized":"2024-03-31T16:35:33.311618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630191+0000","last_change":"2024-03-31T16:35:32.070960+0000","last_active":"2024-03-31T16:35:33.630191+0000","last_peered":"2024-03-31T16:35:33.630191+0000","last_clean":"2024-03-31T16:35:33.630191+0000","last_became_active":"2024-03-31T16:35:32.070713+0000","last_became_peered":"2024-03-31T16:35:32.070713+0000","last_unstale":"2024-03-31T16:35:33.630191+0000","last_undegraded":"2024-03-31T16:35:33.630191+0000","last_fullsized":"2024-03-31T16:35:33.630191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077405+0000","last_change":"2024-03-31T16:35:31.076917+0000","last_active":"2024-03-31T16:35:33.077405+0000","last_peered":"2024-03-31T16:35:33.077405+0000","last_clean":"2024-03-31T16:35:33.077405+0000","last_became_active":"2024-03-31T16:35:31.076373+0000","last_became_peered":"2024-03-31T16:35:31.076373+0000","last_unstale":"2024-03-31T16:35:33.077405+0000","last_undegraded":"2024-03-31T16:35:33.077405+0000","last_fullsized":"2024-03-31T16:35:33.077405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311424+0000","last_change":"2024-03-31T16:35:31.072420+0000","last_active":"2024-03-31T16:35:33.311424+0000","last_peered":"2024-03-31T16:35:33.311424+0000","last_clean":"2024-03-31T16:35:33.311424+0000","last_became_active":"2024-03-31T16:35:31.071802+0000","last_became_peered":"2024-03-31T16:35:31.071802+0000","last_unstale":"2024-03-31T16:35:33.311424+0000","last_undegraded":"2024-03-31T16:35:33.311424+0000","last_fullsized":"2024-03-31T16:35:33.311424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311331+0000","last_change":"2024-03-31T16:35:32.074735+0000","last_active":"2024-03-31T16:35:33.311331+0000","last_peered":"2024-03-31T16:35:33.311331+0000","last_clean":"2024-03-31T16:35:33.311331+0000","last_became_active":"2024-03-31T16:35:32.074093+0000","last_became_peered":"2024-03-31T16:35:32.074093+0000","last_unstale":"2024-03-31T16:35:33.311331+0000","last_undegraded":"2024-03-31T16:35:33.311331+0000","last_fullsized":"2024-03-31T16:35:33.311331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079036+0000","last_change":"2024-03-31T16:35:31.073148+0000","last_active":"2024-03-31T16:35:33.079036+0000","last_peered":"2024-03-31T16:35:33.079036+0000","last_clean":"2024-03-31T16:35:33.079036+0000","last_became_active":"2024-03-31T16:35:31.072813+0000","last_became_peered":"2024-03-31T16:35:31.072813+0000","last_unstale":"2024-03-31T16:35:33.079036+0000","last_undegraded":"2024-03-31T16:35:33.079036+0000","last_fullsized":"2024-03-31T16:35:33.079036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074452+0000","last_change":"2024-03-31T16:35:32.076380+0000","last_active":"2024-03-31T16:35:33.074452+0000","last_peered":"2024-03-31T16:35:33.074452+0000","last_clean":"2024-03-31T16:35:33.074452+0000","last_became_active":"2024-03-31T16:35:32.076113+0000","last_became_peered":"2024-03-31T16:35:32.076113+0000","last_unstale":"2024-03-31T16:35:33.074452+0000","last_undegraded":"2024-03-31T16:35:33.074452+0000","last_fullsized":"2024-03-31T16:35:33.074452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078091+0000","last_change":"2024-03-31T16:35:31.075070+0000","last_active":"2024-03-31T16:35:33.078091+0000","last_peered":"2024-03-31T16:35:33.078091+0000","last_clean":"2024-03-31T16:35:33.078091+0000","last_became_active":"2024-03-31T16:35:31.074753+0000","last_became_peered":"2024-03-31T16:35:31.074753+0000","last_unstale":"2024-03-31T16:35:33.078091+0000","last_undegraded":"2024-03-31T16:35:33.078091+0000","last_fullsized":"2024-03-31T16:35:33.078091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078764+0000","last_change":"2024-03-31T16:35:32.067130+0000","last_active":"2024-03-31T16:35:33.078764+0000","last_peered":"2024-03-31T16:35:33.078764+0000","last_clean":"2024-03-31T16:35:33.078764+0000","last_became_active":"2024-03-31T16:35:32.066719+0000","last_became_peered":"2024-03-31T16:35:32.066719+0000","last_unstale":"2024-03-31T16:35:33.078764+0000","last_undegraded":"2024-03-31T16:35:33.078764+0000","last_fullsized":"2024-03-31T16:35:33.078764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078833+0000","last_change":"2024-03-31T16:35:31.074858+0000","last_active":"2024-03-31T16:35:33.078833+0000","last_peered":"2024-03-31T16:35:33.078833+0000","last_clean":"2024-03-31T16:35:33.078833+0000","last_became_active":"2024-03-31T16:35:31.074274+0000","last_became_peered":"2024-03-31T16:35:31.074274+0000","last_unstale":"2024-03-31T16:35:33.078833+0000","last_undegraded":"2024-03-31T16:35:33.078833+0000","last_fullsized":"2024-03-31T16:35:33.078833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629883+0000","last_change":"2024-03-31T16:35:32.069889+0000","last_active":"2024-03-31T16:35:33.629883+0000","last_peered":"2024-03-31T16:35:33.629883+0000","last_clean":"2024-03-31T16:35:33.629883+0000","last_became_active":"2024-03-31T16:35:32.069595+0000","last_became_peered":"2024-03-31T16:35:32.069595+0000","last_unstale":"2024-03-31T16:35:33.629883+0000","last_undegraded":"2024-03-31T16:35:33.629883+0000","last_fullsized":"2024-03-31T16:35:33.629883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074677+0000","last_change":"2024-03-31T16:35:31.075199+0000","last_active":"2024-03-31T16:35:33.074677+0000","last_peered":"2024-03-31T16:35:33.074677+0000","last_clean":"2024-03-31T16:35:33.074677+0000","last_became_active":"2024-03-31T16:35:31.074912+0000","last_became_peered":"2024-03-31T16:35:31.074912+0000","last_unstale":"2024-03-31T16:35:33.074677+0000","last_undegraded":"2024-03-31T16:35:33.074677+0000","last_fullsized":"2024-03-31T16:35:33.074677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078396+0000","last_change":"2024-03-31T16:35:32.075288+0000","last_active":"2024-03-31T16:35:33.078396+0000","last_peered":"2024-03-31T16:35:33.078396+0000","last_clean":"2024-03-31T16:35:33.078396+0000","last_became_active":"2024-03-31T16:35:32.074982+0000","last_became_peered":"2024-03-31T16:35:32.074982+0000","last_unstale":"2024-03-31T16:35:33.078396+0000","last_undegraded":"2024-03-31T16:35:33.078396+0000","last_fullsized":"2024-03-31T16:35:33.078396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:14.190646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078276+0000","last_change":"2024-03-31T16:35:31.071044+0000","last_active":"2024-03-31T16:35:33.078276+0000","last_peered":"2024-03-31T16:35:33.078276+0000","last_clean":"2024-03-31T16:35:33.078276+0000","last_became_active":"2024-03-31T16:35:31.070775+0000","last_became_peered":"2024-03-31T16:35:31.070775+0000","last_unstale":"2024-03-31T16:35:33.078276+0000","last_undegraded":"2024-03-31T16:35:33.078276+0000","last_fullsized":"2024-03-31T16:35:33.078276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629719+0000","last_change":"2024-03-31T16:35:32.082874+0000","last_active":"2024-03-31T16:35:33.629719+0000","last_peered":"2024-03-31T16:35:33.629719+0000","last_clean":"2024-03-31T16:35:33.629719+0000","last_became_active":"2024-03-31T16:35:32.082582+0000","last_became_peered":"2024-03-31T16:35:32.082582+0000","last_unstale":"2024-03-31T16:35:33.629719+0000","last_undegraded":"2024-03-31T16:35:33.629719+0000","last_fullsized":"2024-03-31T16:35:33.629719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630199+0000","last_change":"2024-03-31T16:35:31.072679+0000","last_active":"2024-03-31T16:35:33.630199+0000","last_peered":"2024-03-31T16:35:33.630199+0000","last_clean":"2024-03-31T16:35:33.630199+0000","last_became_active":"2024-03-31T16:35:31.072349+0000","last_became_peered":"2024-03-31T16:35:31.072349+0000","last_unstale":"2024-03-31T16:35:33.630199+0000","last_undegraded":"2024-03-31T16:35:33.630199+0000","last_fullsized":"2024-03-31T16:35:33.630199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629731+0000","last_change":"2024-03-31T16:35:32.072536+0000","last_active":"2024-03-31T16:35:33.629731+0000","last_peered":"2024-03-31T16:35:33.629731+0000","last_clean":"2024-03-31T16:35:33.629731+0000","last_became_active":"2024-03-31T16:35:32.072299+0000","last_became_peered":"2024-03-31T16:35:32.072299+0000","last_unstale":"2024-03-31T16:35:33.629731+0000","last_undegraded":"2024-03-31T16:35:33.629731+0000","last_fullsized":"2024-03-31T16:35:33.629731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079455+0000","last_change":"2024-03-31T16:35:31.071681+0000","last_active":"2024-03-31T16:35:33.079455+0000","last_peered":"2024-03-31T16:35:33.079455+0000","last_clean":"2024-03-31T16:35:33.079455+0000","last_became_active":"2024-03-31T16:35:31.071425+0000","last_became_peered":"2024-03-31T16:35:31.071425+0000","last_unstale":"2024-03-31T16:35:33.079455+0000","last_undegraded":"2024-03-31T16:35:33.079455+0000","last_fullsized":"2024-03-31T16:35:33.079455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629860+0000","last_change":"2024-03-31T16:35:32.081639+0000","last_active":"2024-03-31T16:35:33.629860+0000","last_peered":"2024-03-31T16:35:33.629860+0000","last_clean":"2024-03-31T16:35:33.629860+0000","last_became_active":"2024-03-31T16:35:32.081101+0000","last_became_peered":"2024-03-31T16:35:32.081101+0000","last_unstale":"2024-03-31T16:35:33.629860+0000","last_undegraded":"2024-03-31T16:35:33.629860+0000","last_fullsized":"2024-03-31T16:35:33.629860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077272+0000","last_change":"2024-03-31T16:35:31.076342+0000","last_active":"2024-03-31T16:35:33.077272+0000","last_peered":"2024-03-31T16:35:33.077272+0000","last_clean":"2024-03-31T16:35:33.077272+0000","last_became_active":"2024-03-31T16:35:31.075546+0000","last_became_peered":"2024-03-31T16:35:31.075546+0000","last_unstale":"2024-03-31T16:35:33.077272+0000","last_undegraded":"2024-03-31T16:35:33.077272+0000","last_fullsized":"2024-03-31T16:35:33.077272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077346+0000","last_change":"2024-03-31T16:35:32.077698+0000","last_active":"2024-03-31T16:35:33.077346+0000","last_peered":"2024-03-31T16:35:33.077346+0000","last_clean":"2024-03-31T16:35:33.077346+0000","last_became_active":"2024-03-31T16:35:32.077415+0000","last_became_peered":"2024-03-31T16:35:32.077415+0000","last_unstale":"2024-03-31T16:35:33.077346+0000","last_undegraded":"2024-03-31T16:35:33.077346+0000","last_fullsized":"2024-03-31T16:35:33.077346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128862+0000","last_change":"2024-03-31T16:35:31.066612+0000","last_active":"2024-03-31T16:35:33.128862+0000","last_peered":"2024-03-31T16:35:33.128862+0000","last_clean":"2024-03-31T16:35:33.128862+0000","last_became_active":"2024-03-31T16:35:31.066089+0000","last_became_peered":"2024-03-31T16:35:31.066089+0000","last_unstale":"2024-03-31T16:35:33.128862+0000","last_undegraded":"2024-03-31T16:35:33.128862+0000","last_fullsized":"2024-03-31T16:35:33.128862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629500+0000","last_change":"2024-03-31T16:35:32.078195+0000","last_active":"2024-03-31T16:35:33.629500+0000","last_peered":"2024-03-31T16:35:33.629500+0000","last_clean":"2024-03-31T16:35:33.629500+0000","last_became_active":"2024-03-31T16:35:32.077878+0000","last_became_peered":"2024-03-31T16:35:32.077878+0000","last_unstale":"2024-03-31T16:35:33.629500+0000","last_undegraded":"2024-03-31T16:35:33.629500+0000","last_fullsized":"2024-03-31T16:35:33.629500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:19:36.978208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078606+0000","last_change":"2024-03-31T16:35:31.073893+0000","last_active":"2024-03-31T16:35:33.078606+0000","last_peered":"2024-03-31T16:35:33.078606+0000","last_clean":"2024-03-31T16:35:33.078606+0000","last_became_active":"2024-03-31T16:35:31.073625+0000","last_became_peered":"2024-03-31T16:35:31.073625+0000","last_unstale":"2024-03-31T16:35:33.078606+0000","last_undegraded":"2024-03-31T16:35:33.078606+0000","last_fullsized":"2024-03-31T16:35:33.078606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:09:31.419651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629895+0000","last_change":"2024-03-31T16:35:32.082027+0000","last_active":"2024-03-31T16:35:33.629895+0000","last_peered":"2024-03-31T16:35:33.629895+0000","last_clean":"2024-03-31T16:35:33.629895+0000","last_became_active":"2024-03-31T16:35:32.080888+0000","last_became_peered":"2024-03-31T16:35:32.080888+0000","last_unstale":"2024-03-31T16:35:33.629895+0000","last_undegraded":"2024-03-31T16:35:33.629895+0000","last_fullsized":"2024-03-31T16:35:33.629895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128888+0000","last_change":"2024-03-31T16:35:31.071984+0000","last_active":"2024-03-31T16:35:33.128888+0000","last_peered":"2024-03-31T16:35:33.128888+0000","last_clean":"2024-03-31T16:35:33.128888+0000","last_became_active":"2024-03-31T16:35:31.071703+0000","last_became_peered":"2024-03-31T16:35:31.071703+0000","last_unstale":"2024-03-31T16:35:33.128888+0000","last_undegraded":"2024-03-31T16:35:33.128888+0000","last_fullsized":"2024-03-31T16:35:33.128888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630062+0000","last_change":"2024-03-31T16:35:32.081372+0000","last_active":"2024-03-31T16:35:33.630062+0000","last_peered":"2024-03-31T16:35:33.630062+0000","last_clean":"2024-03-31T16:35:33.630062+0000","last_became_active":"2024-03-31T16:35:32.081052+0000","last_became_peered":"2024-03-31T16:35:32.081052+0000","last_unstale":"2024-03-31T16:35:33.630062+0000","last_undegraded":"2024-03-31T16:35:33.630062+0000","last_fullsized":"2024-03-31T16:35:33.630062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:11:37.125510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074783+0000","last_change":"2024-03-31T16:35:31.071727+0000","last_active":"2024-03-31T16:35:33.074783+0000","last_peered":"2024-03-31T16:35:33.074783+0000","last_clean":"2024-03-31T16:35:33.074783+0000","last_became_active":"2024-03-31T16:35:31.071417+0000","last_became_peered":"2024-03-31T16:35:31.071417+0000","last_unstale":"2024-03-31T16:35:33.074783+0000","last_undegraded":"2024-03-31T16:35:33.074783+0000","last_fullsized":"2024-03-31T16:35:33.074783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079593+0000","last_change":"2024-03-31T16:35:32.075436+0000","last_active":"2024-03-31T16:35:33.079593+0000","last_peered":"2024-03-31T16:35:33.079593+0000","last_clean":"2024-03-31T16:35:33.079593+0000","last_became_active":"2024-03-31T16:35:32.075165+0000","last_became_peered":"2024-03-31T16:35:32.075165+0000","last_unstale":"2024-03-31T16:35:33.079593+0000","last_undegraded":"2024-03-31T16:35:33.079593+0000","last_fullsized":"2024-03-31T16:35:33.079593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:05.578952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128801+0000","last_change":"2024-03-31T16:35:31.075714+0000","last_active":"2024-03-31T16:35:33.128801+0000","last_peered":"2024-03-31T16:35:33.128801+0000","last_clean":"2024-03-31T16:35:33.128801+0000","last_became_active":"2024-03-31T16:35:31.075208+0000","last_became_peered":"2024-03-31T16:35:31.075208+0000","last_unstale":"2024-03-31T16:35:33.128801+0000","last_undegraded":"2024-03-31T16:35:33.128801+0000","last_fullsized":"2024-03-31T16:35:33.128801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:23:25.249173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629869+0000","last_change":"2024-03-31T16:35:32.083722+0000","last_active":"2024-03-31T16:35:33.629869+0000","last_peered":"2024-03-31T16:35:33.629869+0000","last_clean":"2024-03-31T16:35:33.629869+0000","last_became_active":"2024-03-31T16:35:32.082940+0000","last_became_peered":"2024-03-31T16:35:32.082940+0000","last_unstale":"2024-03-31T16:35:33.629869+0000","last_undegraded":"2024-03-31T16:35:33.629869+0000","last_fullsized":"2024-03-31T16:35:33.629869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:54:59.414997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629462+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:35:33.629462+0000","last_peered":"2024-03-31T16:35:33.629462+0000","last_clean":"2024-03-31T16:35:33.629462+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:35:33.629462+0000","last_undegraded":"2024-03-31T16:35:33.629462+0000","last_fullsized":"2024-03-31T16:35:33.629462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077654+0000","last_change":"2024-03-31T16:35:31.067899+0000","last_active":"2024-03-31T16:35:33.077654+0000","last_peered":"2024-03-31T16:35:33.077654+0000","last_clean":"2024-03-31T16:35:33.077654+0000","last_became_active":"2024-03-31T16:35:31.067599+0000","last_became_peered":"2024-03-31T16:35:31.067599+0000","last_unstale":"2024-03-31T16:35:33.077654+0000","last_undegraded":"2024-03-31T16:35:33.077654+0000","last_fullsized":"2024-03-31T16:35:33.077654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311433+0000","last_change":"2024-03-31T16:35:32.075582+0000","last_active":"2024-03-31T16:35:33.311433+0000","last_peered":"2024-03-31T16:35:33.311433+0000","last_clean":"2024-03-31T16:35:33.311433+0000","last_became_active":"2024-03-31T16:35:32.075305+0000","last_became_peered":"2024-03-31T16:35:32.075305+0000","last_unstale":"2024-03-31T16:35:33.311433+0000","last_undegraded":"2024-03-31T16:35:33.311433+0000","last_fullsized":"2024-03-31T16:35:33.311433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:00:34.281720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629405+0000","last_change":"2024-03-31T16:35:31.077578+0000","last_active":"2024-03-31T16:35:33.629405+0000","last_peered":"2024-03-31T16:35:33.629405+0000","last_clean":"2024-03-31T16:35:33.629405+0000","last_became_active":"2024-03-31T16:35:31.076918+0000","last_became_peered":"2024-03-31T16:35:31.076918+0000","last_unstale":"2024-03-31T16:35:33.629405+0000","last_undegraded":"2024-03-31T16:35:33.629405+0000","last_fullsized":"2024-03-31T16:35:33.629405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629665+0000","last_change":"2024-03-31T16:35:32.071942+0000","last_active":"2024-03-31T16:35:33.629665+0000","last_peered":"2024-03-31T16:35:33.629665+0000","last_clean":"2024-03-31T16:35:33.629665+0000","last_became_active":"2024-03-31T16:35:32.071670+0000","last_became_peered":"2024-03-31T16:35:32.071670+0000","last_unstale":"2024-03-31T16:35:33.629665+0000","last_undegraded":"2024-03-31T16:35:33.629665+0000","last_fullsized":"2024-03-31T16:35:33.629665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:25:21.037477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.128907+0000","last_change":"2024-03-31T16:35:31.070684+0000","last_active":"2024-03-31T16:35:33.128907+0000","last_peered":"2024-03-31T16:35:33.128907+0000","last_clean":"2024-03-31T16:35:33.128907+0000","last_became_active":"2024-03-31T16:35:31.070356+0000","last_became_peered":"2024-03-31T16:35:31.070356+0000","last_unstale":"2024-03-31T16:35:33.128907+0000","last_undegraded":"2024-03-31T16:35:33.128907+0000","last_fullsized":"2024-03-31T16:35:33.128907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074515+0000","last_change":"2024-03-31T16:35:32.069540+0000","last_active":"2024-03-31T16:35:33.074515+0000","last_peered":"2024-03-31T16:35:33.074515+0000","last_clean":"2024-03-31T16:35:33.074515+0000","last_became_active":"2024-03-31T16:35:32.069256+0000","last_became_peered":"2024-03-31T16:35:32.069256+0000","last_unstale":"2024-03-31T16:35:33.074515+0000","last_undegraded":"2024-03-31T16:35:33.074515+0000","last_fullsized":"2024-03-31T16:35:33.074515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:31:48.547740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079522+0000","last_change":"2024-03-31T16:35:31.069729+0000","last_active":"2024-03-31T16:35:33.079522+0000","last_peered":"2024-03-31T16:35:33.079522+0000","last_clean":"2024-03-31T16:35:33.079522+0000","last_became_active":"2024-03-31T16:35:31.069435+0000","last_became_peered":"2024-03-31T16:35:31.069435+0000","last_unstale":"2024-03-31T16:35:33.079522+0000","last_undegraded":"2024-03-31T16:35:33.079522+0000","last_fullsized":"2024-03-31T16:35:33.079522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:42:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078662+0000","last_change":"2024-03-31T16:35:32.072296+0000","last_active":"2024-03-31T16:35:33.078662+0000","last_peered":"2024-03-31T16:35:33.078662+0000","last_clean":"2024-03-31T16:35:33.078662+0000","last_became_active":"2024-03-31T16:35:32.071947+0000","last_became_peered":"2024-03-31T16:35:32.071947+0000","last_unstale":"2024-03-31T16:35:33.078662+0000","last_undegraded":"2024-03-31T16:35:33.078662+0000","last_fullsized":"2024-03-31T16:35:33.078662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:11.972134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074675+0000","last_change":"2024-03-31T16:35:31.070142+0000","last_active":"2024-03-31T16:35:33.074675+0000","last_peered":"2024-03-31T16:35:33.074675+0000","last_clean":"2024-03-31T16:35:33.074675+0000","last_became_active":"2024-03-31T16:35:31.069855+0000","last_became_peered":"2024-03-31T16:35:31.069855+0000","last_unstale":"2024-03-31T16:35:33.074675+0000","last_undegraded":"2024-03-31T16:35:33.074675+0000","last_fullsized":"2024-03-31T16:35:33.074675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:08.331303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079469+0000","last_change":"2024-03-31T16:35:32.076452+0000","last_active":"2024-03-31T16:35:33.079469+0000","last_peered":"2024-03-31T16:35:33.079469+0000","last_clean":"2024-03-31T16:35:33.079469+0000","last_became_active":"2024-03-31T16:35:32.076176+0000","last_became_peered":"2024-03-31T16:35:32.076176+0000","last_unstale":"2024-03-31T16:35:33.079469+0000","last_undegraded":"2024-03-31T16:35:33.079469+0000","last_fullsized":"2024-03-31T16:35:33.079469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629942+0000","last_change":"2024-03-31T16:35:31.077517+0000","last_active":"2024-03-31T16:35:33.629942+0000","last_peered":"2024-03-31T16:35:33.629942+0000","last_clean":"2024-03-31T16:35:33.629942+0000","last_became_active":"2024-03-31T16:35:31.077239+0000","last_became_peered":"2024-03-31T16:35:31.077239+0000","last_unstale":"2024-03-31T16:35:33.629942+0000","last_undegraded":"2024-03-31T16:35:33.629942+0000","last_fullsized":"2024-03-31T16:35:33.629942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074667+0000","last_change":"2024-03-31T16:35:32.070836+0000","last_active":"2024-03-31T16:35:33.074667+0000","last_peered":"2024-03-31T16:35:33.074667+0000","last_clean":"2024-03-31T16:35:33.074667+0000","last_became_active":"2024-03-31T16:35:32.070521+0000","last_became_peered":"2024-03-31T16:35:32.070521+0000","last_unstale":"2024-03-31T16:35:33.074667+0000","last_undegraded":"2024-03-31T16:35:33.074667+0000","last_fullsized":"2024-03-31T16:35:33.074667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077062+0000","last_change":"2024-03-31T16:35:31.074489+0000","last_active":"2024-03-31T16:35:33.077062+0000","last_peered":"2024-03-31T16:35:33.077062+0000","last_clean":"2024-03-31T16:35:33.077062+0000","last_became_active":"2024-03-31T16:35:31.074195+0000","last_became_peered":"2024-03-31T16:35:31.074195+0000","last_unstale":"2024-03-31T16:35:33.077062+0000","last_undegraded":"2024-03-31T16:35:33.077062+0000","last_fullsized":"2024-03-31T16:35:33.077062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311754+0000","last_change":"2024-03-31T16:35:32.083120+0000","last_active":"2024-03-31T16:35:33.311754+0000","last_peered":"2024-03-31T16:35:33.311754+0000","last_clean":"2024-03-31T16:35:33.311754+0000","last_became_active":"2024-03-31T16:35:32.082841+0000","last_became_peered":"2024-03-31T16:35:32.082841+0000","last_unstale":"2024-03-31T16:35:33.311754+0000","last_undegraded":"2024-03-31T16:35:33.311754+0000","last_fullsized":"2024-03-31T16:35:33.311754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:53:04.203897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078173+0000","last_change":"2024-03-31T16:35:31.076558+0000","last_active":"2024-03-31T16:35:33.078173+0000","last_peered":"2024-03-31T16:35:33.078173+0000","last_clean":"2024-03-31T16:35:33.078173+0000","last_became_active":"2024-03-31T16:35:31.075298+0000","last_became_peered":"2024-03-31T16:35:31.075298+0000","last_unstale":"2024-03-31T16:35:33.078173+0000","last_undegraded":"2024-03-31T16:35:33.078173+0000","last_fullsized":"2024-03-31T16:35:33.078173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629833+0000","last_change":"2024-03-31T16:35:32.069455+0000","last_active":"2024-03-31T16:35:33.629833+0000","last_peered":"2024-03-31T16:35:33.629833+0000","last_clean":"2024-03-31T16:35:33.629833+0000","last_became_active":"2024-03-31T16:35:32.069153+0000","last_became_peered":"2024-03-31T16:35:32.069153+0000","last_unstale":"2024-03-31T16:35:33.629833+0000","last_undegraded":"2024-03-31T16:35:33.629833+0000","last_fullsized":"2024-03-31T16:35:33.629833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:27:30.420735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629400+0000","last_change":"2024-03-31T16:35:31.078800+0000","last_active":"2024-03-31T16:35:33.629400+0000","last_peered":"2024-03-31T16:35:33.629400+0000","last_clean":"2024-03-31T16:35:33.629400+0000","last_became_active":"2024-03-31T16:35:31.078459+0000","last_became_peered":"2024-03-31T16:35:31.078459+0000","last_unstale":"2024-03-31T16:35:33.629400+0000","last_undegraded":"2024-03-31T16:35:33.629400+0000","last_fullsized":"2024-03-31T16:35:33.629400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.078033+0000","last_change":"2024-03-31T16:35:32.069622+0000","last_active":"2024-03-31T16:35:33.078033+0000","last_peered":"2024-03-31T16:35:33.078033+0000","last_clean":"2024-03-31T16:35:33.078033+0000","last_became_active":"2024-03-31T16:35:32.069306+0000","last_became_peered":"2024-03-31T16:35:32.069306+0000","last_unstale":"2024-03-31T16:35:33.078033+0000","last_undegraded":"2024-03-31T16:35:33.078033+0000","last_fullsized":"2024-03-31T16:35:33.078033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:09.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074545+0000","last_change":"2024-03-31T16:35:31.075114+0000","last_active":"2024-03-31T16:35:33.074545+0000","last_peered":"2024-03-31T16:35:33.074545+0000","last_clean":"2024-03-31T16:35:33.074545+0000","last_became_active":"2024-03-31T16:35:31.074806+0000","last_became_peered":"2024-03-31T16:35:31.074806+0000","last_unstale":"2024-03-31T16:35:33.074545+0000","last_undegraded":"2024-03-31T16:35:33.074545+0000","last_fullsized":"2024-03-31T16:35:33.074545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:11:05.447888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311430+0000","last_change":"2024-03-31T16:35:32.074953+0000","last_active":"2024-03-31T16:35:33.311430+0000","last_peered":"2024-03-31T16:35:33.311430+0000","last_clean":"2024-03-31T16:35:33.311430+0000","last_became_active":"2024-03-31T16:35:32.074427+0000","last_became_peered":"2024-03-31T16:35:32.074427+0000","last_unstale":"2024-03-31T16:35:33.311430+0000","last_undegraded":"2024-03-31T16:35:33.311430+0000","last_fullsized":"2024-03-31T16:35:33.311430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:35:18.586561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.074527+0000","last_change":"2024-03-31T16:35:31.075011+0000","last_active":"2024-03-31T16:35:33.074527+0000","last_peered":"2024-03-31T16:35:33.074527+0000","last_clean":"2024-03-31T16:35:33.074527+0000","last_became_active":"2024-03-31T16:35:31.074731+0000","last_became_peered":"2024-03-31T16:35:31.074731+0000","last_unstale":"2024-03-31T16:35:33.074527+0000","last_undegraded":"2024-03-31T16:35:33.074527+0000","last_fullsized":"2024-03-31T16:35:33.074527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:46:10.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311546+0000","last_change":"2024-03-31T16:35:32.075723+0000","last_active":"2024-03-31T16:35:33.311546+0000","last_peered":"2024-03-31T16:35:33.311546+0000","last_clean":"2024-03-31T16:35:33.311546+0000","last_became_active":"2024-03-31T16:35:32.075324+0000","last_became_peered":"2024-03-31T16:35:32.075324+0000","last_unstale":"2024-03-31T16:35:33.311546+0000","last_undegraded":"2024-03-31T16:35:33.311546+0000","last_fullsized":"2024-03-31T16:35:33.311546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:00:43.834936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629868+0000","last_change":"2024-03-31T16:35:31.077732+0000","last_active":"2024-03-31T16:35:33.629868+0000","last_peered":"2024-03-31T16:35:33.629868+0000","last_clean":"2024-03-31T16:35:33.629868+0000","last_became_active":"2024-03-31T16:35:31.076950+0000","last_became_peered":"2024-03-31T16:35:31.076950+0000","last_unstale":"2024-03-31T16:35:33.629868+0000","last_undegraded":"2024-03-31T16:35:33.629868+0000","last_fullsized":"2024-03-31T16:35:33.629868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:12:55.673812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.077294+0000","last_change":"2024-03-31T16:35:32.078813+0000","last_active":"2024-03-31T16:35:33.077294+0000","last_peered":"2024-03-31T16:35:33.077294+0000","last_clean":"2024-03-31T16:35:33.077294+0000","last_became_active":"2024-03-31T16:35:32.078564+0000","last_became_peered":"2024-03-31T16:35:32.078564+0000","last_unstale":"2024-03-31T16:35:33.077294+0000","last_undegraded":"2024-03-31T16:35:33.077294+0000","last_fullsized":"2024-03-31T16:35:33.077294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:45.842987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079367+0000","last_change":"2024-03-31T16:35:32.070433+0000","last_active":"2024-03-31T16:35:33.079367+0000","last_peered":"2024-03-31T16:35:33.079367+0000","last_clean":"2024-03-31T16:35:33.079367+0000","last_became_active":"2024-03-31T16:35:32.070040+0000","last_became_peered":"2024-03-31T16:35:32.070040+0000","last_unstale":"2024-03-31T16:35:33.079367+0000","last_undegraded":"2024-03-31T16:35:33.079367+0000","last_fullsized":"2024-03-31T16:35:33.079367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629671+0000","last_change":"2024-03-31T16:35:31.077383+0000","last_active":"2024-03-31T16:35:33.629671+0000","last_peered":"2024-03-31T16:35:33.629671+0000","last_clean":"2024-03-31T16:35:33.629671+0000","last_became_active":"2024-03-31T16:35:31.076971+0000","last_became_peered":"2024-03-31T16:35:31.076971+0000","last_unstale":"2024-03-31T16:35:33.629671+0000","last_undegraded":"2024-03-31T16:35:33.629671+0000","last_fullsized":"2024-03-31T16:35:33.629671+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:09:43.303383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.079595+0000","last_change":"2024-03-31T16:35:32.070447+0000","last_active":"2024-03-31T16:35:33.079595+0000","last_peered":"2024-03-31T16:35:33.079595+0000","last_clean":"2024-03-31T16:35:33.079595+0000","last_became_active":"2024-03-31T16:35:32.070062+0000","last_became_peered":"2024-03-31T16:35:32.070062+0000","last_unstale":"2024-03-31T16:35:33.079595+0000","last_undegraded":"2024-03-31T16:35:33.079595+0000","last_fullsized":"2024-03-31T16:35:33.079595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:07:41.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629811+0000","last_change":"2024-03-31T16:35:31.078244+0000","last_active":"2024-03-31T16:35:33.629811+0000","last_peered":"2024-03-31T16:35:33.629811+0000","last_clean":"2024-03-31T16:35:33.629811+0000","last_became_active":"2024-03-31T16:35:31.077952+0000","last_became_peered":"2024-03-31T16:35:31.077952+0000","last_unstale":"2024-03-31T16:35:33.629811+0000","last_undegraded":"2024-03-31T16:35:33.629811+0000","last_fullsized":"2024-03-31T16:35:33.629811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:30:13.186114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.629875+0000","last_change":"2024-03-31T16:35:32.072440+0000","last_active":"2024-03-31T16:35:33.629875+0000","last_peered":"2024-03-31T16:35:33.629875+0000","last_clean":"2024-03-31T16:35:33.629875+0000","last_became_active":"2024-03-31T16:35:32.072156+0000","last_became_peered":"2024-03-31T16:35:32.072156+0000","last_unstale":"2024-03-31T16:35:33.629875+0000","last_undegraded":"2024-03-31T16:35:33.629875+0000","last_fullsized":"2024-03-31T16:35:33.629875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T23:31:21.028897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311695+0000","last_change":"2024-03-31T16:35:31.073210+0000","last_active":"2024-03-31T16:35:33.311695+0000","last_peered":"2024-03-31T16:35:33.311695+0000","last_clean":"2024-03-31T16:35:33.311695+0000","last_became_active":"2024-03-31T16:35:31.072922+0000","last_became_peered":"2024-03-31T16:35:31.072922+0000","last_unstale":"2024-03-31T16:35:33.311695+0000","last_undegraded":"2024-03-31T16:35:33.311695+0000","last_fullsized":"2024-03-31T16:35:33.311695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.311639+0000","last_change":"2024-03-31T16:35:32.080402+0000","last_active":"2024-03-31T16:35:33.311639+0000","last_peered":"2024-03-31T16:35:33.311639+0000","last_clean":"2024-03-31T16:35:33.311639+0000","last_became_active":"2024-03-31T16:35:32.080137+0000","last_became_peered":"2024-03-31T16:35:32.080137+0000","last_unstale":"2024-03-31T16:35:33.311639+0000","last_undegraded":"2024-03-31T16:35:33.311639+0000","last_fullsized":"2024-03-31T16:35:33.311639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:31.049108+0000","last_clean_scrub_stamp":"2024-03-31T16:35:31.049108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:54:13.395318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-31T16:35:33.630039+0000","last_change":"2024-03-31T16:35:31.076017+0000","last_active":"2024-03-31T16:35:33.630039+0000","last_peered":"2024-03-31T16:35:33.630039+0000","last_clean":"2024-03-31T16:35:33.630039+0000","last_became_active":"2024-03-31T16:35:31.075647+0000","last_became_peered":"2024-03-31T16:35:31.075647+0000","last_unstale":"2024-03-31T16:35:33.630039+0000","last_undegraded":"2024-03-31T16:35:33.630039+0000","last_fullsized":"2024-03-31T16:35:33.630039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:30.044577+0000","last_clean_scrub_stamp":"2024-03-31T16:35:30.044577+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:28:26.280937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:35:42.874 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-31T16:35:42.874 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-31T16:35:42.874 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-31T16:35:42.875 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-31T16:35:43.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.006+0000 7f52bf7af640 1 Processor -- start 2024-03-31T16:35:43.011 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.006+0000 7f52bf7af640 1 -- start start 2024-03-31T16:35:43.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bf7af640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52b815f900 0x7f52b815c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bf7af640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815da60 0x7f52b80cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bf7af640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f52b815fe90 0x7f52b80d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bf7af640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f52b815cd90 con 0x7f52b815f900 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bf7af640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f52b815d060 con 0x7f52b815fe90 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bf7af640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f52b815d340 con 0x7f52b815da60 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bd54b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52b815f900 0x7f52b815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bd54b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52b815f900 0x7f52b815c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52518/0 (socket says 172.21.15.120:52518) 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bd54b640 1 -- 172.21.15.120:0/1255354018 learned_addr learned my addr 172.21.15.120:0/1255354018 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bdd4c640 1 --2- 172.21.15.120:0/1255354018 >> v2:172.21.15.203:3300/0 conn(0x7f52b815fe90 0x7f52b80d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.007+0000 7f52bcd4a640 1 --2- 172.21.15.120:0/1255354018 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815da60 0x7f52b80cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.008+0000 7f52bd54b640 1 -- 172.21.15.120:0/1255354018 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815da60 msgr2=0x7f52b80cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:43.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.008+0000 7f52bd54b640 1 --2- 172.21.15.120:0/1255354018 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815da60 0x7f52b80cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.008+0000 7f52bd54b640 1 -- 172.21.15.120:0/1255354018 >> v2:172.21.15.203:3300/0 conn(0x7f52b815fe90 msgr2=0x7f52b80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:43.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.008+0000 7f52bd54b640 1 --2- 172.21.15.120:0/1255354018 >> v2:172.21.15.203:3300/0 conn(0x7f52b815fe90 0x7f52b80d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.008+0000 7f52bd54b640 1 -- 172.21.15.120:0/1255354018 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b815d620 con 0x7f52b815f900 2024-03-31T16:35:43.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.008+0000 7f52bdd4c640 1 --2- 172.21.15.120:0/1255354018 >> v2:172.21.15.203:3300/0 conn(0x7f52b815fe90 0x7f52b80d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:43.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.008+0000 7f52bd54b640 1 --2- 172.21.15.120:0/1255354018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b815c850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52b80d0a60 tx=0x7f52b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb93283126243a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52affff640 1 -- 172.21.15.120:0/1255354018 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b402ca70 con 0x7f52b815f900 2024-03-31T16:35:43.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52affff640 1 -- 172.21.15.120:0/1255354018 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b402cc10 con 0x7f52b815f900 2024-03-31T16:35:43.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52affff640 1 -- 172.21.15.120:0/1255354018 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b40343f0 con 0x7f52b815f900 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 -- 172.21.15.120:0/1255354018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 msgr2=0x7f52b815c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 --2- 172.21.15.120:0/1255354018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b815c850 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52b80d0a60 tx=0x7f52b402bed0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 -- 172.21.15.120:0/1255354018 shutdown_connections 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 --2- 172.21.15.120:0/1255354018 >> v2:172.21.15.203:3300/0 conn(0x7f52b815fe90 0x7f52b80d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 --2- 172.21.15.120:0/1255354018 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815da60 0x7f52b80cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 --2- 172.21.15.120:0/1255354018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b815c850 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 -- 172.21.15.120:0/1255354018 >> 172.21.15.120:0/1255354018 conn(0x7f52b80b3e90 msgr2=0x7f52b80b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 -- 172.21.15.120:0/1255354018 shutdown_connections 2024-03-31T16:35:43.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.009+0000 7f52bf7af640 1 -- 172.21.15.120:0/1255354018 wait complete. 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.010+0000 7f52bf7af640 1 Processor -- start 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.010+0000 7f52bf7af640 1 -- start start 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bf7af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52b815da60 0x7f52b81535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bf7af640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b80cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bf7af640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815fe90 0x7f52b80c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bf7af640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f52b80cea50 con 0x7f52b815f900 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bf7af640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52b80ce8d0 con 0x7f52b815da60 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bf7af640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f52b80cebd0 con 0x7f52b815fe90 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bcd4a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b80cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bcd4a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b80cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52534/0 (socket says 172.21.15.120:52534) 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bcd4a640 1 -- 172.21.15.120:0/3138961672 learned_addr learned my addr 172.21.15.120:0/3138961672 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bd54b640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52b815da60 0x7f52b81535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bdd4c640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815fe90 0x7f52b80c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bcd4a640 1 -- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815fe90 msgr2=0x7f52b80c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bcd4a640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815fe90 0x7f52b80c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bcd4a640 1 -- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52b815da60 msgr2=0x7f52b81535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bcd4a640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52b815da60 0x7f52b81535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bcd4a640 1 -- 172.21.15.120:0/3138961672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b815a8a0 con 0x7f52b815f900 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.011+0000 7f52bdd4c640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815fe90 0x7f52b80c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.012+0000 7f52bcd4a640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b80cb3b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52a800e9b0 tx=0x7f52a800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.012+0000 7f52adffb640 1 -- 172.21.15.120:0/3138961672 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8017070 con 0x7f52b815f900 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.012+0000 7f52adffb640 1 -- 172.21.15.120:0/3138961672 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a800c9a0 con 0x7f52b815f900 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.012+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b815ab80 con 0x7f52b815f900 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.012+0000 7f52adffb640 1 -- 172.21.15.120:0/3138961672 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a800cd90 con 0x7f52b815f900 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.012+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b815b140 con 0x7f52b815f900 2024-03-31T16:35:43.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.013+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b8068cd0 con 0x7f52b815f900 2024-03-31T16:35:43.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.013+0000 7f52adffb640 1 -- 172.21.15.120:0/3138961672 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52a801a070 con 0x7f52b815f900 2024-03-31T16:35:43.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.014+0000 7f52adffb640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f529c06c8f0 0x7f529c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.014+0000 7f52bd54b640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f529c06c8f0 0x7f529c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.014+0000 7f52adffb640 1 -- 172.21.15.120:0/3138961672 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f52a808baa0 con 0x7f52b815f900 2024-03-31T16:35:43.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.014+0000 7f52bd54b640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f529c06c8f0 0x7f529c06edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52b4035000 tx=0x7f52b4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.018+0000 7f52adffb640 1 -- 172.21.15.120:0/3138961672 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f52a8059880 con 0x7f52b815f900 2024-03-31T16:35:43.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.230+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f52b8159260 con 0x7f52b815f900 2024-03-31T16:35:43.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.231+0000 7f52adffb640 1 -- 172.21.15.120:0/3138961672 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f52a805db80 con 0x7f52b815f900 2024-03-31T16:35:43.235 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:43.235 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-31T16:35:43.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f529c06c8f0 msgr2=0x7f529c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f529c06c8f0 0x7f529c06edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52b4035000 tx=0x7f52b4030000 comp rx=0 tx=0).stop 2024-03-31T16:35:43.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 msgr2=0x7f52b80cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b80cb3b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52a800e9b0 tx=0x7f52a800ee70 comp rx=0 tx=0).stop 2024-03-31T16:35:43.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 shutdown_connections 2024-03-31T16:35:43.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f529c06c8f0 0x7f529c06edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f52b815fe90 0x7f52b80c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52b815f900 0x7f52b80cb3b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 --2- 172.21.15.120:0/3138961672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52b815da60 0x7f52b81535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 >> 172.21.15.120:0/3138961672 conn(0x7f52b80b3e90 msgr2=0x7f52b8160370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:43.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 shutdown_connections 2024-03-31T16:35:43.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.233+0000 7f52bf7af640 1 -- 172.21.15.120:0/3138961672 wait complete. 2024-03-31T16:35:43.248 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-31T16:35:43.248 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:43.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.344+0000 7fbbee2d3640 1 Processor -- start 2024-03-31T16:35:43.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.344+0000 7fbbee2d3640 1 -- start start 2024-03-31T16:35:43.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbee2d3640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbbe80d0990 0x7fbbe80aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbee2d3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe80b40b0 con 0x7fbbe8155930 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbee2d3640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe80b4390 con 0x7fbbe8155550 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbee2d3640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe80b4670 con 0x7fbbe80d0990 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbe77fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbbe8155930 0x7fbbe80d0280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53290/0 (socket says 172.21.15.120:53290) 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbe77fe640 1 -- 172.21.15.120:0/908302313 learned_addr learned my addr 172.21.15.120:0/908302313 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbec870640 1 --2- 172.21.15.120:0/908302313 >> v2:172.21.15.203:3300/0 conn(0x7fbbe80d0990 0x7fbbe80aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbe6ffd640 1 -- 172.21.15.120:0/908302313 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414036021 0 0) 0x7fbbe80b40b0 con 0x7fbbe8155930 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbe6ffd640 1 -- 172.21.15.120:0/908302313 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbd4003520 con 0x7fbbe8155930 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbec870640 1 -- 172.21.15.120:0/908302313 >> v1:172.21.15.203:6789/0 conn(0x7fbbe8155550 legacy=0x7fbbe815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbe6ffd640 1 -- 172.21.15.120:0/908302313 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131085120 0 0) 0x7fbbe80b4390 con 0x7fbbe8155550 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbec870640 1 -- 172.21.15.120:0/908302313 >> v1:172.21.15.120:6789/0 conn(0x7fbbe8155930 legacy=0x7fbbe80d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.345+0000 7fbbec870640 1 -- 172.21.15.120:0/908302313 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe80b4950 con 0x7fbbe80d0990 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.346+0000 7fbbec870640 1 --2- 172.21.15.120:0/908302313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 0x7fbbe80aede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009d90 tx=0x7fbbe002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0b81750a928a769 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.346+0000 7fbbe6ffd640 1 -- 172.21.15.120:0/908302313 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0039070 con 0x7fbbe80d0990 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.346+0000 7fbbe6ffd640 1 -- 172.21.15.120:0/908302313 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe002cc60 con 0x7fbbe80d0990 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.346+0000 7fbbe6ffd640 1 -- 172.21.15.120:0/908302313 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0034660 con 0x7fbbe80d0990 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.347+0000 7fbbee2d3640 1 -- 172.21.15.120:0/908302313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 msgr2=0x7fbbe80aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.347+0000 7fbbee2d3640 1 --2- 172.21.15.120:0/908302313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 0x7fbbe80aede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009d90 tx=0x7fbbe002beb0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.347+0000 7fbbee2d3640 1 -- 172.21.15.120:0/908302313 shutdown_connections 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.347+0000 7fbbee2d3640 1 --2- 172.21.15.120:0/908302313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 0x7fbbe80aede0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.347+0000 7fbbee2d3640 1 -- 172.21.15.120:0/908302313 >> 172.21.15.120:0/908302313 conn(0x7fbbe806b750 msgr2=0x7fbbe806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.347+0000 7fbbee2d3640 1 -- 172.21.15.120:0/908302313 shutdown_connections 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.347+0000 7fbbee2d3640 1 -- 172.21.15.120:0/908302313 wait complete. 2024-03-31T16:35:43.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.348+0000 7fbbee2d3640 1 Processor -- start 2024-03-31T16:35:43.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.348+0000 7fbbee2d3640 1 -- start start 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbee2d3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 0x7fbbe8098d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbee2d3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe8155550 0x7fbbe809daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbee2d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe8155930 0x7fbbe81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbee2d3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe815bba0 con 0x7fbbe8155930 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbee2d3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe815ba20 con 0x7fbbe80d0990 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbee2d3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe80b3cf0 con 0x7fbbe8155550 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe8155930 0x7fbbe81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe8155930 0x7fbbe81540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52540/0 (socket says 172.21.15.120:52540) 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 -- 172.21.15.120:0/759453892 learned_addr learned my addr 172.21.15.120:0/759453892 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbe7fff640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 0x7fbbe8098d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbe77fe640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe8155550 0x7fbbe809daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 -- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe8155550 msgr2=0x7fbbe809daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe8155550 0x7fbbe809daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 -- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 msgr2=0x7fbbe8098d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 0x7fbbe8098d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 -- 172.21.15.120:0/759453892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe8099630 con 0x7fbbe8155930 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbe7fff640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 0x7fbbe8098d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbec870640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe8155930 0x7fbbe81540c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0037040 tx=0x7fbbe0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbe4ff9640 1 -- 172.21.15.120:0/759453892 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0039050 con 0x7fbbe8155930 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.349+0000 7fbbe4ff9640 1 -- 172.21.15.120:0/759453892 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe003a040 con 0x7fbbe8155930 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.350+0000 7fbbe4ff9640 1 -- 172.21.15.120:0/759453892 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0009450 con 0x7fbbe8155930 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.350+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe8099910 con 0x7fbbe8155930 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.350+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe809a2c0 con 0x7fbbe8155930 2024-03-31T16:35:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.351+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe806bd60 con 0x7fbbe8155930 2024-03-31T16:35:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.351+0000 7fbbe4ff9640 1 -- 172.21.15.120:0/759453892 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbbe0047020 con 0x7fbbe8155930 2024-03-31T16:35:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.351+0000 7fbbe4ff9640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbbc806c8f0 0x7fbbc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.352+0000 7fbbe7fff640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbbc806c8f0 0x7fbbc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.352+0000 7fbbe4ff9640 1 -- 172.21.15.120:0/759453892 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbbe00adbd0 con 0x7fbbe8155930 2024-03-31T16:35:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.352+0000 7fbbe7fff640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbbc806c8f0 0x7fbbc806edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8000f60 tx=0x7fbbd8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.356+0000 7fbbe4ff9640 1 -- 172.21.15.120:0/759453892 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbbe806bd60 con 0x7fbbe8155930 2024-03-31T16:35:43.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.532+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbe80685c0 con 0x7fbbe8155930 2024-03-31T16:35:43.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.533+0000 7fbbe4ff9640 1 -- 172.21.15.120:0/759453892 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7fbbe004e020 con 0x7fbbe8155930 2024-03-31T16:35:43.538 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:43.538 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbbc806c8f0 msgr2=0x7fbbc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbbc806c8f0 0x7fbbc806edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8000f60 tx=0x7fbbd8009040 comp rx=0 tx=0).stop 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe8155930 msgr2=0x7fbbe81540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe8155930 0x7fbbe81540c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0037040 tx=0x7fbbe0004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 shutdown_connections 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbbc806c8f0 0x7fbbc806edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbe8155930 0x7fbbe81540c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbbe8155550 0x7fbbe809daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 --2- 172.21.15.120:0/759453892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbe80d0990 0x7fbbe8098d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 >> 172.21.15.120:0/759453892 conn(0x7fbbe806b750 msgr2=0x7fbbe80ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:43.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.535+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 shutdown_connections 2024-03-31T16:35:43.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.536+0000 7fbbee2d3640 1 -- 172.21.15.120:0/759453892 wait complete. 2024-03-31T16:35:43.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:35:43.551 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:35:43.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.650+0000 7f1b38982640 1 Processor -- start 2024-03-31T16:35:43.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.650+0000 7f1b38982640 1 -- start start 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b38982640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 0x7f1b3406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b38982640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b340b4a30 0x7f1b340b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b38982640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3415ede0 con 0x7f1b34158580 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b38982640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f1b34141b30 con 0x7f1b340b4a30 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b38982640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b34141d80 con 0x7f1b340b4650 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b31d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b340b4a30 0x7f1b340b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b32d9d640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f1b34158580 0x7f1b341589d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:49888/0 (socket says 172.21.15.120:49888) 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b3259c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 0x7f1b3406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b32d9d640 1 -- 172.21.15.120:0/763850367 learned_addr learned my addr 172.21.15.120:0/763850367 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b31d9b640 1 -- 172.21.15.120:0/763850367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 msgr2=0x7f1b3406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b31d9b640 1 --2- 172.21.15.120:0/763850367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 0x7f1b3406c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b31d9b640 1 -- 172.21.15.120:0/763850367 >> v1:172.21.15.203:6789/0 conn(0x7f1b34158580 legacy=0x7f1b341589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b3159a640 1 -- 172.21.15.120:0/763850367 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585450534 0 0) 0x7f1b3415ede0 con 0x7f1b34158580 2024-03-31T16:35:43.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.651+0000 7f1b31d9b640 1 -- 172.21.15.120:0/763850367 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b34142060 con 0x7f1b340b4a30 2024-03-31T16:35:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.652+0000 7f1b31d9b640 1 --2- 172.21.15.120:0/763850367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b340b4a30 0x7f1b340b5c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1b280097a0 tx=0x7f1b2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09d491709e0a800 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.652+0000 7f1b3159a640 1 -- 172.21.15.120:0/763850367 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28035020 con 0x7f1b340b4a30 2024-03-31T16:35:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.652+0000 7f1b3159a640 1 -- 172.21.15.120:0/763850367 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b28031830 con 0x7f1b340b4a30 2024-03-31T16:35:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.652+0000 7f1b3159a640 1 -- 172.21.15.120:0/763850367 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28031c00 con 0x7f1b340b4a30 2024-03-31T16:35:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.653+0000 7f1b38982640 1 -- 172.21.15.120:0/763850367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b340b4a30 msgr2=0x7f1b340b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.653+0000 7f1b38982640 1 --2- 172.21.15.120:0/763850367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b340b4a30 0x7f1b340b5c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1b280097a0 tx=0x7f1b2802b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.653+0000 7f1b38982640 1 -- 172.21.15.120:0/763850367 shutdown_connections 2024-03-31T16:35:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.653+0000 7f1b38982640 1 --2- 172.21.15.120:0/763850367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b340b4a30 0x7f1b340b5c10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.653+0000 7f1b38982640 1 --2- 172.21.15.120:0/763850367 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 0x7f1b3406c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.653+0000 7f1b38982640 1 -- 172.21.15.120:0/763850367 >> 172.21.15.120:0/763850367 conn(0x7f1b34067670 msgr2=0x7f1b34067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.653+0000 7f1b38982640 1 -- 172.21.15.120:0/763850367 shutdown_connections 2024-03-31T16:35:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.653+0000 7f1b38982640 1 -- 172.21.15.120:0/763850367 wait complete. 2024-03-31T16:35:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.654+0000 7f1b38982640 1 Processor -- start 2024-03-31T16:35:43.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.654+0000 7f1b38982640 1 -- start start 2024-03-31T16:35:43.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b38982640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 0x7f1b3415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b38982640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b340b4a30 0x7f1b3415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b38982640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b34158580 0x7f1b3415e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b38982640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1b34142900 con 0x7f1b34158580 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b38982640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b34142620 con 0x7f1b340b4a30 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b38982640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3406cbc0 con 0x7f1b340b4650 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b34158580 0x7f1b3415e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b31d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b340b4a30 0x7f1b3415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b34158580 0x7f1b3415e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52564/0 (socket says 172.21.15.120:52564) 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b31d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b340b4a30 0x7f1b3415dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:44150/0 (socket says 172.21.15.120:44150) 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 -- 172.21.15.120:0/712426732 learned_addr learned my addr 172.21.15.120:0/712426732 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b3259c640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 0x7f1b3415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 -- 172.21.15.120:0/712426732 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 msgr2=0x7f1b3415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 0x7f1b3415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 -- 172.21.15.120:0/712426732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b340b4a30 msgr2=0x7f1b3415dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b340b4a30 0x7f1b3415dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 -- 172.21.15.120:0/712426732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b340cd420 con 0x7f1b34158580 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b31d9b640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b340b4a30 0x7f1b3415dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b32d9d640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b34158580 0x7f1b3415e150 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00c480 tx=0x7f1b2c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.655+0000 7f1b22ffd640 1 -- 172.21.15.120:0/712426732 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c005ce0 con 0x7f1b34158580 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.656+0000 7f1b22ffd640 1 -- 172.21.15.120:0/712426732 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c007070 con 0x7f1b34158580 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.656+0000 7f1b22ffd640 1 -- 172.21.15.120:0/712426732 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0074a0 con 0x7f1b34158580 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.656+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b340cd700 con 0x7f1b34158580 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.656+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b340cdcc0 con 0x7f1b34158580 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.657+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b340685c0 con 0x7f1b34158580 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.657+0000 7f1b22ffd640 1 -- 172.21.15.120:0/712426732 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b2c01b400 con 0x7f1b34158580 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.657+0000 7f1b22ffd640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b1406c8f0 0x7f1b1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.658+0000 7f1b3259c640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b1406c8f0 0x7f1b1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.658+0000 7f1b22ffd640 1 -- 172.21.15.120:0/712426732 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1b2c08b5d0 con 0x7f1b34158580 2024-03-31T16:35:43.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.658+0000 7f1b3259c640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b1406c8f0 0x7f1b1406edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b24011340 tx=0x7f1b2400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.662+0000 7f1b22ffd640 1 -- 172.21.15.120:0/712426732 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1b2c059440 con 0x7f1b34158580 2024-03-31T16:35:43.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.838+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b34071ab0 con 0x7f1b34158580 2024-03-31T16:35:43.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.839+0000 7f1b22ffd640 1 -- 172.21.15.120:0/712426732 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f1b2c05d740 con 0x7f1b34158580 2024-03-31T16:35:43.843 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:35:43.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b1406c8f0 msgr2=0x7f1b1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b1406c8f0 0x7f1b1406edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b24011340 tx=0x7f1b2400b040 comp rx=0 tx=0).stop 2024-03-31T16:35:43.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b34158580 msgr2=0x7f1b3415e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b34158580 0x7f1b3415e150 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00c480 tx=0x7f1b2c00c940 comp rx=0 tx=0).stop 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 shutdown_connections 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b1406c8f0 0x7f1b1406edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b34158580 0x7f1b3415e150 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b340b4a30 0x7f1b3415dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 --2- 172.21.15.120:0/712426732 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b340b4650 0x7f1b3415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 >> 172.21.15.120:0/712426732 conn(0x7f1b34067670 msgr2=0x7f1b340b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 shutdown_connections 2024-03-31T16:35:43.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.841+0000 7f1b38982640 1 -- 172.21.15.120:0/712426732 wait complete. 2024-03-31T16:35:43.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:35:43.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.955+0000 7f1a6b7fa640 1 Processor -- start 2024-03-31T16:35:43.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.955+0000 7f1a6b7fa640 1 -- start start 2024-03-31T16:35:43.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a6b7fa640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a64070170 0x7f1a6406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a6b7fa640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1a640705f0 0x7f1a6406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a6b7fa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6415edc0 con 0x7f1a640d1bf0 2024-03-31T16:35:43.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a6b7fa640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1a640d1fd0 con 0x7f1a640705f0 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a6b7fa640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6415eb80 con 0x7f1a64070170 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a69596640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1a640d1bf0 0x7f1a6415f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53304/0 (socket says 172.21.15.120:53304) 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a69596640 1 -- 172.21.15.120:0/1918946293 learned_addr learned my addr 172.21.15.120:0/1918946293 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a69d97640 1 --2- 172.21.15.120:0/1918946293 >> v2:172.21.15.203:3300/0 conn(0x7f1a640705f0 0x7f1a6406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a68d95640 1 --2- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a64070170 0x7f1a6406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a5bfff640 1 -- 172.21.15.120:0/1918946293 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98501876 0 0) 0x7f1a6415edc0 con 0x7f1a640d1bf0 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a5bfff640 1 -- 172.21.15.120:0/1918946293 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a50003520 con 0x7f1a640d1bf0 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a69d97640 1 -- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a64070170 msgr2=0x7f1a6406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a69d97640 1 --2- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a64070170 0x7f1a6406b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a69d97640 1 -- 172.21.15.120:0/1918946293 >> v1:172.21.15.120:6789/0 conn(0x7f1a640d1bf0 legacy=0x7f1a6415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a69d97640 1 -- 172.21.15.120:0/1918946293 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640b5e60 con 0x7f1a640705f0 2024-03-31T16:35:43.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.956+0000 7f1a68d95640 1 --2- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a64070170 0x7f1a6406b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.957+0000 7f1a69d97640 1 --2- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a640705f0 0x7f1a6406bab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009d90 tx=0x7f1a5c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4185cce268b972e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.957+0000 7f1a5bfff640 1 -- 172.21.15.120:0/1918946293 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c039070 con 0x7f1a640705f0 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.957+0000 7f1a5bfff640 1 -- 172.21.15.120:0/1918946293 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c02cbc0 con 0x7f1a640705f0 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.957+0000 7f1a5bfff640 1 -- 172.21.15.120:0/1918946293 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c034440 con 0x7f1a640705f0 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.958+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a640705f0 msgr2=0x7f1a6406bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.958+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a640705f0 0x7f1a6406bab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009d90 tx=0x7f1a5c02be10 comp rx=0 tx=0).stop 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.958+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/1918946293 shutdown_connections 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.958+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a640705f0 0x7f1a6406bab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.958+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/1918946293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a64070170 0x7f1a6406b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.958+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/1918946293 >> 172.21.15.120:0/1918946293 conn(0x7f1a640b6560 msgr2=0x7f1a640b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.958+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/1918946293 shutdown_connections 2024-03-31T16:35:43.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.958+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/1918946293 wait complete. 2024-03-31T16:35:43.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.959+0000 7f1a6b7fa640 1 Processor -- start 2024-03-31T16:35:43.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.959+0000 7f1a6b7fa640 1 -- start start 2024-03-31T16:35:43.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a6b7fa640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a64070170 0x7f1a6409dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a6b7fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a640705f0 0x7f1a6409c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a6b7fa640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a640d1bf0 0x7f1a6409b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a6b7fa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640b5b10 con 0x7f1a640705f0 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a6b7fa640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6415f080 con 0x7f1a64070170 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a6b7fa640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1a640b4220 con 0x7f1a640d1bf0 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a640705f0 0x7f1a6409c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a640705f0 0x7f1a6409c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52566/0 (socket says 172.21.15.120:52566) 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 -- 172.21.15.120:0/901835090 learned_addr learned my addr 172.21.15.120:0/901835090 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a69596640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a64070170 0x7f1a6409dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a69d97640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a640d1bf0 0x7f1a6409b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 -- 172.21.15.120:0/901835090 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a640d1bf0 msgr2=0x7f1a6409b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a640d1bf0 0x7f1a6409b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 -- 172.21.15.120:0/901835090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a64070170 msgr2=0x7f1a6409dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a64070170 0x7f1a6409dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:43.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 -- 172.21.15.120:0/901835090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640cb260 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a68d95640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a640705f0 0x7f1a6409c400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400ebe0 tx=0x7f1a5400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a59ffb640 1 -- 172.21.15.120:0/901835090 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54017070 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a59ffb640 1 -- 172.21.15.120:0/901835090 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5400cc30 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a59ffb640 1 -- 172.21.15.120:0/901835090 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54013470 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.960+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a640cb820 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.961+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a640cbde0 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.961+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a640685c0 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.962+0000 7f1a59ffb640 1 -- 172.21.15.120:0/901835090 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a5401a070 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.962+0000 7f1a59ffb640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a4806c8f0 0x7f1a4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.962+0000 7f1a59ffb640 1 -- 172.21.15.120:0/901835090 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1a5408bd90 con 0x7f1a640705f0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.962+0000 7f1a69596640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a4806c8f0 0x7f1a4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:43.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.963+0000 7f1a69596640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a4806c8f0 0x7f1a4806edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1a60005880 tx=0x7f1a60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:43.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:43.966+0000 7f1a59ffb640 1 -- 172.21.15.120:0/901835090 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1a54059b70 con 0x7f1a640705f0 2024-03-31T16:35:44.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.142+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1a640b3fe0 con 0x7f1a640705f0 2024-03-31T16:35:44.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.142+0000 7f1a59ffb640 1 -- 172.21.15.120:0/901835090 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1a5405de70 con 0x7f1a640705f0 2024-03-31T16:35:44.147 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a4806c8f0 msgr2=0x7f1a4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a4806c8f0 0x7f1a4806edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1a60005880 tx=0x7f1a60009040 comp rx=0 tx=0).stop 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a640705f0 msgr2=0x7f1a6409c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a640705f0 0x7f1a6409c400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400ebe0 tx=0x7f1a5400c520 comp rx=0 tx=0).stop 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 shutdown_connections 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a4806c8f0 0x7f1a4806edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a640d1bf0 0x7f1a6409b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a640705f0 0x7f1a6409c400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 --2- 172.21.15.120:0/901835090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a64070170 0x7f1a6409dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 >> 172.21.15.120:0/901835090 conn(0x7f1a640b6560 msgr2=0x7f1a6415f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:44.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 shutdown_connections 2024-03-31T16:35:44.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.144+0000 7f1a6b7fa640 1 -- 172.21.15.120:0/901835090 wait complete. 2024-03-31T16:35:44.159 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:35:44.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.258+0000 7fcdfe360640 1 Processor -- start 2024-03-31T16:35:44.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.258+0000 7fcdfe360640 1 -- start start 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfe360640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcdf80cd130 0x7fcdf80719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfe360640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcdf8071f30 0x7fcdf806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfe360640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf81463e0 con 0x7fcdf8146000 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfe360640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf806dd80 con 0x7fcdf8071f30 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfe360640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf80cd6b0 con 0x7fcdf80cd130 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfc8fd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcdf8071f30 0x7fcdf806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdf7fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcdf8146000 0x7fcdf8160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53314/0 (socket says 172.21.15.120:53314) 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdf7fff640 1 -- 172.21.15.120:0/148030534 learned_addr learned my addr 172.21.15.120:0/148030534 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdf77fe640 1 --2- 172.21.15.120:0/148030534 >> v2:172.21.15.203:3300/0 conn(0x7fcdf80cd130 0x7fcdf80719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfc8fd640 1 -- 172.21.15.120:0/148030534 >> v2:172.21.15.203:3300/0 conn(0x7fcdf80cd130 msgr2=0x7fcdf80719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:44.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfc8fd640 1 --2- 172.21.15.120:0/148030534 >> v2:172.21.15.203:3300/0 conn(0x7fcdf80cd130 0x7fcdf80719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfc8fd640 1 -- 172.21.15.120:0/148030534 >> v1:172.21.15.120:6789/0 conn(0x7fcdf8146000 legacy=0x7fcdf8160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.259+0000 7fcdfc8fd640 1 -- 172.21.15.120:0/148030534 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf80cd990 con 0x7fcdf8071f30 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.260+0000 7fcdfc8fd640 1 --2- 172.21.15.120:0/148030534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8071f30 0x7fcdf806e210 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009d90 tx=0x7fcdf002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22667a7062475af5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.260+0000 7fcdf6ffd640 1 -- 172.21.15.120:0/148030534 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0039070 con 0x7fcdf8071f30 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.260+0000 7fcdf6ffd640 1 -- 172.21.15.120:0/148030534 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf002cbd0 con 0x7fcdf8071f30 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.260+0000 7fcdf6ffd640 1 -- 172.21.15.120:0/148030534 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0034440 con 0x7fcdf8071f30 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.260+0000 7fcdfe360640 1 -- 172.21.15.120:0/148030534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8071f30 msgr2=0x7fcdf806e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.260+0000 7fcdfe360640 1 --2- 172.21.15.120:0/148030534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8071f30 0x7fcdf806e210 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009d90 tx=0x7fcdf002be20 comp rx=0 tx=0).stop 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.261+0000 7fcdfe360640 1 -- 172.21.15.120:0/148030534 shutdown_connections 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.261+0000 7fcdfe360640 1 --2- 172.21.15.120:0/148030534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8071f30 0x7fcdf806e210 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.261+0000 7fcdfe360640 1 --2- 172.21.15.120:0/148030534 >> v2:172.21.15.203:3300/0 conn(0x7fcdf80cd130 0x7fcdf80719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.261+0000 7fcdfe360640 1 -- 172.21.15.120:0/148030534 >> 172.21.15.120:0/148030534 conn(0x7fcdf806bba0 msgr2=0x7fcdf80b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.261+0000 7fcdfe360640 1 -- 172.21.15.120:0/148030534 shutdown_connections 2024-03-31T16:35:44.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.261+0000 7fcdfe360640 1 -- 172.21.15.120:0/148030534 wait complete. 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.262+0000 7fcdfe360640 1 Processor -- start 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.262+0000 7fcdfe360640 1 -- start start 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfe360640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdf8071f30 0x7fcdf81f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfe360640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdf80cd130 0x7fcdf80ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfe360640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8146000 0x7fcdf80c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfe360640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf806e750 con 0x7fcdf8146000 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfe360640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf806da10 con 0x7fcdf8071f30 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfe360640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf806e8d0 con 0x7fcdf80cd130 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8146000 0x7fcdf80c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8146000 0x7fcdf80c65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52584/0 (socket says 172.21.15.120:52584) 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 -- 172.21.15.120:0/3253230792 learned_addr learned my addr 172.21.15.120:0/3253230792 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:44.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdf7fff640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdf8071f30 0x7fcdf81f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdf77fe640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdf80cd130 0x7fcdf80ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 -- 172.21.15.120:0/3253230792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdf80cd130 msgr2=0x7fcdf80ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdf80cd130 0x7fcdf80ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 -- 172.21.15.120:0/3253230792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdf8071f30 msgr2=0x7fcdf81f14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdf8071f30 0x7fcdf81f14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 -- 172.21.15.120:0/3253230792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf80c54d0 con 0x7fcdf8146000 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfc8fd640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8146000 0x7fcdf80c65c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009d90 tx=0x7fcdf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdf4ff9640 1 -- 172.21.15.120:0/3253230792 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0039050 con 0x7fcdf8146000 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdf4ff9640 1 -- 172.21.15.120:0/3253230792 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf0045070 con 0x7fcdf8146000 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf80c57b0 con 0x7fcdf8146000 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdf4ff9640 1 -- 172.21.15.120:0/3253230792 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0009450 con 0x7fcdf8146000 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.263+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf80c5d70 con 0x7fcdf8146000 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.264+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf80685c0 con 0x7fcdf8146000 2024-03-31T16:35:44.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.265+0000 7fcdf4ff9640 1 -- 172.21.15.120:0/3253230792 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcdf003e850 con 0x7fcdf8146000 2024-03-31T16:35:44.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.265+0000 7fcdf4ff9640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcde406c8f0 0x7fcde406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.265+0000 7fcdf4ff9640 1 -- 172.21.15.120:0/3253230792 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcdf00ae7a0 con 0x7fcdf8146000 2024-03-31T16:35:44.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.265+0000 7fcdf7fff640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcde406c8f0 0x7fcde406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.266+0000 7fcdf7fff640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcde406c8f0 0x7fcde406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80cfdc0 tx=0x7fcde8007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.270+0000 7fcdf4ff9640 1 -- 172.21.15.120:0/3253230792 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcdf007c6a0 con 0x7fcdf8146000 2024-03-31T16:35:44.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.443+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcdf80730d0 con 0x7fcdf8146000 2024-03-31T16:35:44.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.443+0000 7fcdf4ff9640 1 -- 172.21.15.120:0/3253230792 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fcdf00809a0 con 0x7fcdf8146000 2024-03-31T16:35:44.447 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:35:44.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcde406c8f0 msgr2=0x7fcde406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcde406c8f0 0x7fcde406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdf80cfdc0 tx=0x7fcde8007e80 comp rx=0 tx=0).stop 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8146000 msgr2=0x7fcdf80c65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8146000 0x7fcdf80c65c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009d90 tx=0x7fcdf0004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 shutdown_connections 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcde406c8f0 0x7fcde406edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcdf8146000 0x7fcdf80c65c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdf80cd130 0x7fcdf80ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 --2- 172.21.15.120:0/3253230792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdf8071f30 0x7fcdf81f14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 >> 172.21.15.120:0/3253230792 conn(0x7fcdf806bba0 msgr2=0x7fcdf80b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 shutdown_connections 2024-03-31T16:35:44.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.445+0000 7fcdfe360640 1 -- 172.21.15.120:0/3253230792 wait complete. 2024-03-31T16:35:44.460 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:35:44.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.556+0000 7f3678a55640 1 Processor -- start 2024-03-31T16:35:44.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.556+0000 7f3678a55640 1 -- start start 2024-03-31T16:35:44.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3678a55640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f36741452f0 0x7f36741456d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3678a55640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f367406bc80 0x7f36740b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3678a55640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36740ae4a0 con 0x7f36740ae020 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3678a55640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f367415c990 con 0x7f36741452f0 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3678a55640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36740afcf0 con 0x7f367406bc80 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3672d9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f367406bc80 0x7f36740b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f367259c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f36741452f0 0x7f36741456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3672d9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f367406bc80 0x7f36740b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:49090/0 (socket says 172.21.15.120:49090) 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3672d9d640 1 -- 172.21.15.120:0/980026403 learned_addr learned my addr 172.21.15.120:0/980026403 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f367259c640 1 -- 172.21.15.120:0/980026403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f367406bc80 msgr2=0x7f36740b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f367259c640 1 --2- 172.21.15.120:0/980026403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f367406bc80 0x7f36740b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f367259c640 1 -- 172.21.15.120:0/980026403 >> v1:172.21.15.203:6789/0 conn(0x7f36740ae020 legacy=0x7f367406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f367259c640 1 -- 172.21.15.120:0/980026403 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36740affd0 con 0x7f36741452f0 2024-03-31T16:35:44.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.557+0000 7f3672d9d640 1 --2- 172.21.15.120:0/980026403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f367406bc80 0x7f36740b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.558+0000 7f367259c640 1 --2- 172.21.15.120:0/980026403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36741452f0 0x7f36741456d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3664009d90 tx=0x7f366402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1716e9ab666c18b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.558+0000 7f367159a640 1 -- 172.21.15.120:0/980026403 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664039070 con 0x7f36741452f0 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.558+0000 7f367159a640 1 -- 172.21.15.120:0/980026403 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366402cbc0 con 0x7f36741452f0 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.558+0000 7f367159a640 1 -- 172.21.15.120:0/980026403 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664034440 con 0x7f36741452f0 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.558+0000 7f3678a55640 1 -- 172.21.15.120:0/980026403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36741452f0 msgr2=0x7f36741456d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.558+0000 7f3678a55640 1 --2- 172.21.15.120:0/980026403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36741452f0 0x7f36741456d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3664009d90 tx=0x7f366402be10 comp rx=0 tx=0).stop 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.559+0000 7f3678a55640 1 -- 172.21.15.120:0/980026403 shutdown_connections 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.559+0000 7f3678a55640 1 --2- 172.21.15.120:0/980026403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f367406bc80 0x7f36740b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.564 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.559+0000 7f3678a55640 1 --2- 172.21.15.120:0/980026403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36741452f0 0x7f36741456d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.559+0000 7f3678a55640 1 -- 172.21.15.120:0/980026403 >> 172.21.15.120:0/980026403 conn(0x7f36740b6560 msgr2=0x7f36740b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:44.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.559+0000 7f3678a55640 1 -- 172.21.15.120:0/980026403 shutdown_connections 2024-03-31T16:35:44.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.559+0000 7f3678a55640 1 -- 172.21.15.120:0/980026403 wait complete. 2024-03-31T16:35:44.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.560+0000 7f3678a55640 1 Processor -- start 2024-03-31T16:35:44.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.560+0000 7f3678a55640 1 -- start start 2024-03-31T16:35:44.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3678a55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f367406bc80 0x7f367409c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3678a55640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36740ae020 0x7f3674159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3678a55640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36741452f0 0x7f36741431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3678a55640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f36740b0870 con 0x7f367406bc80 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3678a55640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36740b0590 con 0x7f36740ae020 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3678a55640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36740af910 con 0x7f36741452f0 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f367406bc80 0x7f367409c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f367406bc80 0x7f367409c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55830/0 (socket says 172.21.15.120:55830) 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 -- 172.21.15.120:0/950049470 learned_addr learned my addr 172.21.15.120:0/950049470 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3672d9d640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36741452f0 0x7f36741431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3671d9b640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36740ae020 0x7f3674159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 -- 172.21.15.120:0/950049470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36741452f0 msgr2=0x7f36741431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36741452f0 0x7f36741431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 -- 172.21.15.120:0/950049470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36740ae020 msgr2=0x7f3674159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36740ae020 0x7f3674159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 -- 172.21.15.120:0/950049470 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36741436e0 con 0x7f367406bc80 2024-03-31T16:35:44.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f367259c640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f367406bc80 0x7f367409c9d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3664037040 tx=0x7f3664004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3662ffd640 1 -- 172.21.15.120:0/950049470 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664039050 con 0x7f367406bc80 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3662ffd640 1 -- 172.21.15.120:0/950049470 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3664045070 con 0x7f367406bc80 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36741439b0 con 0x7f367406bc80 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3662ffd640 1 -- 172.21.15.120:0/950049470 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366403e850 con 0x7f367406bc80 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.561+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3674143f70 con 0x7f367406bc80 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.563+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367406ba40 con 0x7f367406bc80 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.563+0000 7f3662ffd640 1 -- 172.21.15.120:0/950049470 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f366403e9f0 con 0x7f367406bc80 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.563+0000 7f3662ffd640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f365406c920 0x7f365406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.563+0000 7f3662ffd640 1 -- 172.21.15.120:0/950049470 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f36640ae860 con 0x7f367406bc80 2024-03-31T16:35:44.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.563+0000 7f3671d9b640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f365406c920 0x7f365406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.564+0000 7f3671d9b640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f365406c920 0x7f365406ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f36680016e0 tx=0x7f3668009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.572 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.568+0000 7f3662ffd640 1 -- 172.21.15.120:0/950049470 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f367406ba40 con 0x7f367406bc80 2024-03-31T16:35:44.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.781+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36740685c0 con 0x7f367406bc80 2024-03-31T16:35:44.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.782+0000 7f3662ffd640 1 -- 172.21.15.120:0/950049470 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f36640ae020 con 0x7f367406bc80 2024-03-31T16:35:44.786 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:44.786 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:35:31.420280+0000","modified":"2024-03-31T16:35:33.846906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-03-31T16:35:44.787 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f365406c920 msgr2=0x7f365406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f365406c920 0x7f365406ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f36680016e0 tx=0x7f3668009040 comp rx=0 tx=0).stop 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f367406bc80 msgr2=0x7f367409c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f367406bc80 0x7f367409c9d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3664037040 tx=0x7f3664004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 shutdown_connections 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f365406c920 0x7f365406ede0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36741452f0 0x7f36741431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36740ae020 0x7f3674159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 --2- 172.21.15.120:0/950049470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f367406bc80 0x7f367409c9d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 >> 172.21.15.120:0/950049470 conn(0x7f36740b6560 msgr2=0x7f36740b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:44.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 shutdown_connections 2024-03-31T16:35:44.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.784+0000 7f3678a55640 1 -- 172.21.15.120:0/950049470 wait complete. 2024-03-31T16:35:44.800 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:44.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.895+0000 7f1246b74640 1 Processor -- start 2024-03-31T16:35:44.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.895+0000 7f1246b74640 1 -- start start 2024-03-31T16:35:44.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1246b74640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f12400cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1246b74640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f12400716d0 0x7f12400d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1246b74640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1240071c80 con 0x7f12400b4a30 2024-03-31T16:35:44.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1246b74640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1240071f60 con 0x7f12400716d0 2024-03-31T16:35:44.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1246b74640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f12400b3f50 con 0x7f124015d490 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1244910640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f12400cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1245111640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f12400716d0 0x7f12400d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1244910640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f12400cfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:49112/0 (socket says 172.21.15.120:49112) 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1244910640 1 -- 172.21.15.120:0/3062624469 learned_addr learned my addr 172.21.15.120:0/3062624469 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f123ffff640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f12400b4a30 0x7f1240070fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:33418/0 (socket says 172.21.15.120:33418) 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1244910640 1 -- 172.21.15.120:0/3062624469 >> v2:172.21.15.203:3300/0 conn(0x7f12400716d0 msgr2=0x7f12400d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1244910640 1 --2- 172.21.15.120:0/3062624469 >> v2:172.21.15.203:3300/0 conn(0x7f12400716d0 0x7f12400d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1244910640 1 -- 172.21.15.120:0/3062624469 >> v1:172.21.15.203:6789/0 conn(0x7f12400b4a30 legacy=0x7f1240070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.896+0000 7f1244910640 1 -- 172.21.15.120:0/3062624469 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12400b4230 con 0x7f124015d490 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.897+0000 7f1244910640 1 --2- 172.21.15.120:0/3062624469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f12400cfd80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12400720e0 tx=0x7f123402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e241f0d92563927 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.897+0000 7f123f7fe640 1 -- 172.21.15.120:0/3062624469 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234035020 con 0x7f124015d490 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.897+0000 7f123f7fe640 1 -- 172.21.15.120:0/3062624469 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1234031640 con 0x7f124015d490 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.897+0000 7f123f7fe640 1 -- 172.21.15.120:0/3062624469 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123402d040 con 0x7f124015d490 2024-03-31T16:35:44.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.898+0000 7f1246b74640 1 -- 172.21.15.120:0/3062624469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 msgr2=0x7f12400cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.898+0000 7f1246b74640 1 --2- 172.21.15.120:0/3062624469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f12400cfd80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12400720e0 tx=0x7f123402b8f0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.898+0000 7f1246b74640 1 -- 172.21.15.120:0/3062624469 shutdown_connections 2024-03-31T16:35:44.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.898+0000 7f1246b74640 1 --2- 172.21.15.120:0/3062624469 >> v2:172.21.15.203:3300/0 conn(0x7f12400716d0 0x7f12400d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.898+0000 7f1246b74640 1 --2- 172.21.15.120:0/3062624469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f12400cfd80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.898+0000 7f1246b74640 1 -- 172.21.15.120:0/3062624469 >> 172.21.15.120:0/3062624469 conn(0x7f12400d2240 msgr2=0x7f12400d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:44.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.898+0000 7f1246b74640 1 -- 172.21.15.120:0/3062624469 shutdown_connections 2024-03-31T16:35:44.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.898+0000 7f1246b74640 1 -- 172.21.15.120:0/3062624469 wait complete. 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.899+0000 7f1246b74640 1 Processor -- start 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.899+0000 7f1246b74640 1 -- start start 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1246b74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12400716d0 0x7f124015e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1246b74640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12400b4a30 0x7f124013e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1246b74640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f1240157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1246b74640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f124015d9f0 con 0x7f12400716d0 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1246b74640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f124015d870 con 0x7f12400b4a30 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1246b74640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f12400c74a0 con 0x7f124015d490 2024-03-31T16:35:44.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1244910640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12400716d0 0x7f124015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f123ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12400b4a30 0x7f124013e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1244910640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12400716d0 0x7f124015e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55836/0 (socket says 172.21.15.120:55836) 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1244910640 1 -- 172.21.15.120:0/846799162 learned_addr learned my addr 172.21.15.120:0/846799162 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1245111640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f1240157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1244910640 1 -- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 msgr2=0x7f1240157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1244910640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f1240157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1244910640 1 -- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12400b4a30 msgr2=0x7f124013e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1244910640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12400b4a30 0x7f124013e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1244910640 1 -- 172.21.15.120:0/846799162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124013ee60 con 0x7f12400716d0 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f123ffff640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12400b4a30 0x7f124013e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.900+0000 7f1245111640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f1240157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.901+0000 7f1244910640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12400716d0 0x7f124015e340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f123402b930 tx=0x7f12340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.901+0000 7f123d7fa640 1 -- 172.21.15.120:0/846799162 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234040070 con 0x7f12400716d0 2024-03-31T16:35:44.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.901+0000 7f123d7fa640 1 -- 172.21.15.120:0/846799162 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1234039970 con 0x7f12400716d0 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.901+0000 7f123d7fa640 1 -- 172.21.15.120:0/846799162 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234035040 con 0x7f12400716d0 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.901+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124013f140 con 0x7f12400716d0 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.901+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f124013f700 con 0x7f12400716d0 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.902+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12400685c0 con 0x7f12400716d0 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.902+0000 7f123d7fa640 1 -- 172.21.15.120:0/846799162 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1234038020 con 0x7f12400716d0 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.903+0000 7f123d7fa640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f122406c8f0 0x7f122406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.903+0000 7f123d7fa640 1 -- 172.21.15.120:0/846799162 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f12340ad3d0 con 0x7f12400716d0 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.903+0000 7f123ffff640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f122406c8f0 0x7f122406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:44.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.903+0000 7f123ffff640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f122406c8f0 0x7f122406edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1240160ea0 tx=0x7f122c007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:44.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:44.907+0000 7f123d7fa640 1 -- 172.21.15.120:0/846799162 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f123407b120 con 0x7f12400716d0 2024-03-31T16:35:45.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.084+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12400b5bb0 con 0x7f12400716d0 2024-03-31T16:35:45.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.085+0000 7f123d7fa640 1 -- 172.21.15.120:0/846799162 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f123407f420 con 0x7f12400716d0 2024-03-31T16:35:45.089 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:45.089 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:45.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f122406c8f0 msgr2=0x7f122406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f122406c8f0 0x7f122406edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1240160ea0 tx=0x7f122c007e80 comp rx=0 tx=0).stop 2024-03-31T16:35:45.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12400716d0 msgr2=0x7f124015e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12400716d0 0x7f124015e340 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f123402b930 tx=0x7f12340046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 shutdown_connections 2024-03-31T16:35:45.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f122406c8f0 0x7f122406edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f124015d490 0x7f1240157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12400b4a30 0x7f124013e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 --2- 172.21.15.120:0/846799162 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f12400716d0 0x7f124015e340 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 >> 172.21.15.120:0/846799162 conn(0x7f12400d2240 msgr2=0x7f12400b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:45.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 shutdown_connections 2024-03-31T16:35:45.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.087+0000 7f1246b74640 1 -- 172.21.15.120:0/846799162 wait complete. 2024-03-31T16:35:45.102 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:35:45.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:35:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.201+0000 7f92d670e640 1 Processor -- start 2024-03-31T16:35:45.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.201+0000 7f92d670e640 1 -- start start 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.201+0000 7f92d670e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f92d015e590 0x7f92d00d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.201+0000 7f92d670e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d006cd90 0x7f92d00cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.201+0000 7f92d670e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d0071060 con 0x7f92d00b47d0 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.201+0000 7f92d670e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f92d0071340 con 0x7f92d015e590 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.201+0000 7f92d670e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f92d0071620 con 0x7f92d006cd90 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.202+0000 7f92cffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f92d015e590 0x7f92d00d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.202+0000 7f92cf7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f92d00b47d0 0x7f92d006c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36264/0 (socket says 172.21.15.120:36264) 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.202+0000 7f92cf7fe640 1 -- 172.21.15.120:0/1527820815 learned_addr learned my addr 172.21.15.120:0/1527820815 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.202+0000 7f92d4cab640 1 --2- 172.21.15.120:0/1527820815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d006cd90 0x7f92d00cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.202+0000 7f92cffff640 1 -- 172.21.15.120:0/1527820815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d006cd90 msgr2=0x7f92d00cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:45.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.202+0000 7f92cffff640 1 --2- 172.21.15.120:0/1527820815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d006cd90 0x7f92d00cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.202+0000 7f92cffff640 1 -- 172.21.15.120:0/1527820815 >> v1:172.21.15.120:6789/0 conn(0x7f92d00b47d0 legacy=0x7f92d006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.202+0000 7f92cffff640 1 -- 172.21.15.120:0/1527820815 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d0071900 con 0x7f92d015e590 2024-03-31T16:35:45.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92cffff640 1 --2- 172.21.15.120:0/1527820815 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d015e590 0x7f92d00d1560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f92c00097a0 tx=0x7f92c002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ce4f44e2354904 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92ceffd640 1 -- 172.21.15.120:0/1527820815 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0037070 con 0x7f92d015e590 2024-03-31T16:35:45.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92ceffd640 1 -- 172.21.15.120:0/1527820815 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c0030710 con 0x7f92d015e590 2024-03-31T16:35:45.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92ceffd640 1 -- 172.21.15.120:0/1527820815 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0030ae0 con 0x7f92d015e590 2024-03-31T16:35:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92d670e640 1 -- 172.21.15.120:0/1527820815 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d015e590 msgr2=0x7f92d00d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92d670e640 1 --2- 172.21.15.120:0/1527820815 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d015e590 0x7f92d00d1560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f92c00097a0 tx=0x7f92c002b710 comp rx=0 tx=0).stop 2024-03-31T16:35:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92d670e640 1 -- 172.21.15.120:0/1527820815 shutdown_connections 2024-03-31T16:35:45.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92d670e640 1 --2- 172.21.15.120:0/1527820815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d006cd90 0x7f92d00cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92d670e640 1 --2- 172.21.15.120:0/1527820815 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d015e590 0x7f92d00d1560 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92d670e640 1 -- 172.21.15.120:0/1527820815 >> 172.21.15.120:0/1527820815 conn(0x7f92d00d2240 msgr2=0x7f92d00d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92d670e640 1 -- 172.21.15.120:0/1527820815 shutdown_connections 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.203+0000 7f92d670e640 1 -- 172.21.15.120:0/1527820815 wait complete. 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.204+0000 7f92d670e640 1 Processor -- start 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92d670e640 1 -- start start 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92d670e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d006cd90 0x7f92d0149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92d670e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92d00b47d0 0x7f92d0147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92d670e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d015e590 0x7f92d01484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92d670e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f92d015e970 con 0x7f92d006cd90 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92d670e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92d00b4c60 con 0x7f92d00b47d0 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92d670e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f92d015eaf0 con 0x7f92d015e590 2024-03-31T16:35:45.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92cffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d006cd90 0x7f92d0149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92cffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d006cd90 0x7f92d0149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55858/0 (socket says 172.21.15.120:55858) 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92cffff640 1 -- 172.21.15.120:0/1397915926 learned_addr learned my addr 172.21.15.120:0/1397915926 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92d4cab640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d015e590 0x7f92d01484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.205+0000 7f92cf7fe640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92d00b47d0 0x7f92d0147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92cffff640 1 -- 172.21.15.120:0/1397915926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d015e590 msgr2=0x7f92d01484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92cffff640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d015e590 0x7f92d01484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92cffff640 1 -- 172.21.15.120:0/1397915926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92d00b47d0 msgr2=0x7f92d0147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92cffff640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92d00b47d0 0x7f92d0147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92cffff640 1 -- 172.21.15.120:0/1397915926 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d014a310 con 0x7f92d006cd90 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92cffff640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d006cd90 0x7f92d0149dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f92c00098c0 tx=0x7f92c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92ccff9640 1 -- 172.21.15.120:0/1397915926 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0041030 con 0x7f92d006cd90 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92ccff9640 1 -- 172.21.15.120:0/1397915926 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c003c670 con 0x7f92d006cd90 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92ccff9640 1 -- 172.21.15.120:0/1397915926 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0037040 con 0x7f92d006cd90 2024-03-31T16:35:45.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d01481e0 con 0x7f92d006cd90 2024-03-31T16:35:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.206+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d0149010 con 0x7f92d006cd90 2024-03-31T16:35:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.207+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d00685c0 con 0x7f92d006cd90 2024-03-31T16:35:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.207+0000 7f92ccff9640 1 -- 172.21.15.120:0/1397915926 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92c0044070 con 0x7f92d006cd90 2024-03-31T16:35:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.208+0000 7f92ccff9640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f92bc06c8f0 0x7f92bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.208+0000 7f92ccff9640 1 -- 172.21.15.120:0/1397915926 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f92c00ad330 con 0x7f92d006cd90 2024-03-31T16:35:45.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.208+0000 7f92cf7fe640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f92bc06c8f0 0x7f92bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.208+0000 7f92cf7fe640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f92bc06c8f0 0x7f92bc06edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f92d0158c00 tx=0x7f92c4007e20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.212+0000 7f92ccff9640 1 -- 172.21.15.120:0/1397915926 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f92c007b1a0 con 0x7f92d006cd90 2024-03-31T16:35:45.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.388+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f92d00b3fa0 con 0x7f92d006cd90 2024-03-31T16:35:45.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.389+0000 7f92ccff9640 1 -- 172.21.15.120:0/1397915926 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f92c007f4a0 con 0x7f92d006cd90 2024-03-31T16:35:45.393 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:35:45.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f92bc06c8f0 msgr2=0x7f92bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f92bc06c8f0 0x7f92bc06edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f92d0158c00 tx=0x7f92c4007e20 comp rx=0 tx=0).stop 2024-03-31T16:35:45.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d006cd90 msgr2=0x7f92d0149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d006cd90 0x7f92d0149dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f92c00098c0 tx=0x7f92c00046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 shutdown_connections 2024-03-31T16:35:45.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f92bc06c8f0 0x7f92bc06edb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92d015e590 0x7f92d01484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92d00b47d0 0x7f92d0147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 --2- 172.21.15.120:0/1397915926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f92d006cd90 0x7f92d0149dd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 >> 172.21.15.120:0/1397915926 conn(0x7f92d00d2240 msgr2=0x7f92d01621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:45.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 shutdown_connections 2024-03-31T16:35:45.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.391+0000 7f92d670e640 1 -- 172.21.15.120:0/1397915926 wait complete. 2024-03-31T16:35:45.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:35:45.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.505+0000 7f05ee82b640 1 Processor -- start 2024-03-31T16:35:45.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.505+0000 7f05ee82b640 1 -- start start 2024-03-31T16:35:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05ee82b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155930 0x7f05e80d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05ee82b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f05e80d07c0 0x7f05e80aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05ee82b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e80b40b0 con 0x7f05e8155550 2024-03-31T16:35:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05ee82b640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f05e80b4390 con 0x7f05e80d07c0 2024-03-31T16:35:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05ee82b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f05e80b4670 con 0x7f05e8155930 2024-03-31T16:35:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e7fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f05e8155550 0x7f05e815f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36278/0 (socket says 172.21.15.120:36278) 2024-03-31T16:35:45.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e7fff640 1 -- 172.21.15.120:0/3416038890 learned_addr learned my addr 172.21.15.120:0/3416038890 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e77fe640 1 --2- 172.21.15.120:0/3416038890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155930 0x7f05e80d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05ecdc8640 1 --2- 172.21.15.120:0/3416038890 >> v2:172.21.15.203:3300/0 conn(0x7f05e80d07c0 0x7f05e80aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e6ffd640 1 -- 172.21.15.120:0/3416038890 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409029010 0 0) 0x7f05e80b40b0 con 0x7f05e8155550 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e6ffd640 1 -- 172.21.15.120:0/3416038890 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d0003520 con 0x7f05e8155550 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e77fe640 1 -- 172.21.15.120:0/3416038890 >> v2:172.21.15.203:3300/0 conn(0x7f05e80d07c0 msgr2=0x7f05e80aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e77fe640 1 --2- 172.21.15.120:0/3416038890 >> v2:172.21.15.203:3300/0 conn(0x7f05e80d07c0 0x7f05e80aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e77fe640 1 -- 172.21.15.120:0/3416038890 >> v1:172.21.15.120:6789/0 conn(0x7f05e8155550 legacy=0x7f05e815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.506+0000 7f05e77fe640 1 -- 172.21.15.120:0/3416038890 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e80b4950 con 0x7f05e8155930 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.507+0000 7f05e77fe640 1 --2- 172.21.15.120:0/3416038890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155930 0x7f05e80d0280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0097a0 tx=0x7f05dc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1490c7b4080b2cc7 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.507+0000 7f05e6ffd640 1 -- 172.21.15.120:0/3416038890 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc035020 con 0x7f05e8155930 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.507+0000 7f05e6ffd640 1 -- 172.21.15.120:0/3416038890 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05dc031830 con 0x7f05e8155930 2024-03-31T16:35:45.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.507+0000 7f05e6ffd640 1 -- 172.21.15.120:0/3416038890 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc031c00 con 0x7f05e8155930 2024-03-31T16:35:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.508+0000 7f05ee82b640 1 -- 172.21.15.120:0/3416038890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155930 msgr2=0x7f05e80d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.508+0000 7f05ee82b640 1 --2- 172.21.15.120:0/3416038890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155930 0x7f05e80d0280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0097a0 tx=0x7f05dc02b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.508+0000 7f05ee82b640 1 -- 172.21.15.120:0/3416038890 shutdown_connections 2024-03-31T16:35:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.508+0000 7f05ee82b640 1 --2- 172.21.15.120:0/3416038890 >> v2:172.21.15.203:3300/0 conn(0x7f05e80d07c0 0x7f05e80aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.508+0000 7f05ee82b640 1 --2- 172.21.15.120:0/3416038890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155930 0x7f05e80d0280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.508+0000 7f05ee82b640 1 -- 172.21.15.120:0/3416038890 >> 172.21.15.120:0/3416038890 conn(0x7f05e806b750 msgr2=0x7f05e806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:45.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.508+0000 7f05ee82b640 1 -- 172.21.15.120:0/3416038890 shutdown_connections 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.508+0000 7f05ee82b640 1 -- 172.21.15.120:0/3416038890 wait complete. 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.509+0000 7f05ee82b640 1 Processor -- start 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.509+0000 7f05ee82b640 1 -- start start 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ee82b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05e80d07c0 0x7f05e815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ee82b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155550 0x7f05e81f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ee82b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e8155930 0x7f05e809c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ee82b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f05e815bba0 con 0x7f05e80d07c0 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ee82b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05e815ba20 con 0x7f05e8155930 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ee82b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f05e80b3cf0 con 0x7f05e8155550 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05e80d07c0 0x7f05e815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05e80d07c0 0x7f05e815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55860/0 (socket says 172.21.15.120:55860) 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 -- 172.21.15.120:0/41937177 learned_addr learned my addr 172.21.15.120:0/41937177 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e77fe640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155550 0x7f05e81f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ecdc8640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e8155930 0x7f05e809c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 -- 172.21.15.120:0/41937177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155550 msgr2=0x7f05e81f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155550 0x7f05e81f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 -- 172.21.15.120:0/41937177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e8155930 msgr2=0x7f05e809c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e8155930 0x7f05e809c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 -- 172.21.15.120:0/41937177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e8071840 con 0x7f05e80d07c0 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e7fff640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05e80d07c0 0x7f05e815a680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c460 tx=0x7f05d800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e4ff9640 1 -- 172.21.15.120:0/41937177 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8017070 con 0x7f05e80d07c0 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e4ff9640 1 -- 172.21.15.120:0/41937177 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8005ce0 con 0x7f05e80d07c0 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05e4ff9640 1 -- 172.21.15.120:0/41937177 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8007290 con 0x7f05e80d07c0 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e80992a0 con 0x7f05e80d07c0 2024-03-31T16:35:45.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.510+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e815d030 con 0x7f05e80d07c0 2024-03-31T16:35:45.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.512+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e80685c0 con 0x7f05e80d07c0 2024-03-31T16:35:45.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.512+0000 7f05e4ff9640 1 -- 172.21.15.120:0/41937177 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05d801a070 con 0x7f05e80d07c0 2024-03-31T16:35:45.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.512+0000 7f05e4ff9640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05d406c920 0x7f05d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.512+0000 7f05e4ff9640 1 -- 172.21.15.120:0/41937177 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f05d808ad60 con 0x7f05e80d07c0 2024-03-31T16:35:45.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.512+0000 7f05e77fe640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05d406c920 0x7f05d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.518 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.513+0000 7f05e77fe640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05d406c920 0x7f05d406ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05dc036000 tx=0x7f05dc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.517+0000 7f05e4ff9640 1 -- 172.21.15.120:0/41937177 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f05d8058bd0 con 0x7f05e80d07c0 2024-03-31T16:35:45.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.690+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f05e80b3ad0 con 0x7f05e80d07c0 2024-03-31T16:35:45.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.690+0000 7f05e4ff9640 1 -- 172.21.15.120:0/41937177 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f05d805ced0 con 0x7f05e80d07c0 2024-03-31T16:35:45.695 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:35:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05d406c920 msgr2=0x7f05d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05d406c920 0x7f05d406ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05dc036000 tx=0x7f05dc008030 comp rx=0 tx=0).stop 2024-03-31T16:35:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05e80d07c0 msgr2=0x7f05e815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05e80d07c0 0x7f05e815a680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c460 tx=0x7f05d800c920 comp rx=0 tx=0).stop 2024-03-31T16:35:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 shutdown_connections 2024-03-31T16:35:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f05d406c920 0x7f05d406ede0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e8155930 0x7f05e809c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f05e8155550 0x7f05e81f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 --2- 172.21.15.120:0/41937177 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05e80d07c0 0x7f05e815a680 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 >> 172.21.15.120:0/41937177 conn(0x7f05e806b750 msgr2=0x7f05e8153740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 shutdown_connections 2024-03-31T16:35:45.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.692+0000 7f05ee82b640 1 -- 172.21.15.120:0/41937177 wait complete. 2024-03-31T16:35:45.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:35:45.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.806+0000 7f7134500640 1 Processor -- start 2024-03-31T16:35:45.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.806+0000 7f7134500640 1 -- start start 2024-03-31T16:35:45.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f7134500640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f712c0b4650 0x7f712c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f7134500640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712c15ede0 con 0x7f712c158580 2024-03-31T16:35:45.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f7134500640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712c141d80 con 0x7f712c0b4a30 2024-03-31T16:35:45.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f7134500640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f712c0b6320 con 0x7f712c0b4650 2024-03-31T16:35:45.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f713229c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f712c0b4650 0x7f712c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f7132a9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f712c158580 0x7f712c1589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36290/0 (socket says 172.21.15.120:36290) 2024-03-31T16:35:45.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f7132a9d640 1 -- 172.21.15.120:0/3794654769 learned_addr learned my addr 172.21.15.120:0/3794654769 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:45.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f713229c640 1 -- 172.21.15.120:0/3794654769 >> v1:172.21.15.203:6789/0 conn(0x7f712c0b4a30 legacy=0x7f712c0b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f713229c640 1 -- 172.21.15.120:0/3794654769 >> v1:172.21.15.120:6789/0 conn(0x7f712c158580 legacy=0x7f712c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f713129a640 1 -- 172.21.15.120:0/3794654769 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253087760 0 0) 0x7f712c141d80 con 0x7f712c0b4a30 2024-03-31T16:35:45.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.807+0000 7f713229c640 1 -- 172.21.15.120:0/3794654769 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712c142060 con 0x7f712c0b4650 2024-03-31T16:35:45.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.808+0000 7f713229c640 1 --2- 172.21.15.120:0/3794654769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4650 0x7f712c06c680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71280097a0 tx=0x7f712802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75dc9465f1db919 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.808+0000 7f713129a640 1 -- 172.21.15.120:0/3794654769 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128037070 con 0x7f712c0b4650 2024-03-31T16:35:45.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.808+0000 7f713129a640 1 -- 172.21.15.120:0/3794654769 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7128030710 con 0x7f712c0b4650 2024-03-31T16:35:45.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.808+0000 7f713129a640 1 -- 172.21.15.120:0/3794654769 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128030ae0 con 0x7f712c0b4650 2024-03-31T16:35:45.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.808+0000 7f7134500640 1 -- 172.21.15.120:0/3794654769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4650 msgr2=0x7f712c06c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.808+0000 7f7134500640 1 --2- 172.21.15.120:0/3794654769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4650 0x7f712c06c680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71280097a0 tx=0x7f712802b790 comp rx=0 tx=0).stop 2024-03-31T16:35:45.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.809+0000 7f7134500640 1 -- 172.21.15.120:0/3794654769 shutdown_connections 2024-03-31T16:35:45.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.809+0000 7f7134500640 1 --2- 172.21.15.120:0/3794654769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4650 0x7f712c06c680 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.809+0000 7f7134500640 1 -- 172.21.15.120:0/3794654769 >> 172.21.15.120:0/3794654769 conn(0x7f712c067670 msgr2=0x7f712c067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:45.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.809+0000 7f7134500640 1 -- 172.21.15.120:0/3794654769 shutdown_connections 2024-03-31T16:35:45.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.809+0000 7f7134500640 1 -- 172.21.15.120:0/3794654769 wait complete. 2024-03-31T16:35:45.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7134500640 1 Processor -- start 2024-03-31T16:35:45.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7134500640 1 -- start start 2024-03-31T16:35:45.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7134500640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f712c0b4650 0x7f712c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7134500640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4a30 0x7f712c1605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7134500640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f712c158580 0x7f712c160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7134500640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f712c142620 con 0x7f712c0b4a30 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7134500640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f712c141b30 con 0x7f712c158580 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7134500640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f712c142900 con 0x7f712c0b4650 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.810+0000 7f7131a9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4a30 0x7f712c1605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7131a9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4a30 0x7f712c1605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55876/0 (socket says 172.21.15.120:55876) 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7131a9b640 1 -- 172.21.15.120:0/80543187 learned_addr learned my addr 172.21.15.120:0/80543187 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f713229c640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f712c0b4650 0x7f712c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7132a9d640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f712c158580 0x7f712c160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7131a9b640 1 -- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f712c0b4650 msgr2=0x7f712c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7131a9b640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f712c0b4650 0x7f712c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7131a9b640 1 -- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f712c158580 msgr2=0x7f712c160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7131a9b640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f712c158580 0x7f712c160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7131a9b640 1 -- 172.21.15.120:0/80543187 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712c15a8a0 con 0x7f712c0b4a30 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7132a9d640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f712c158580 0x7f712c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7131a9b640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4a30 0x7f712c1605f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c520 tx=0x7f711c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7122ffd640 1 -- 172.21.15.120:0/80543187 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c017070 con 0x7f712c0b4a30 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7122ffd640 1 -- 172.21.15.120:0/80543187 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711c0035f0 con 0x7f712c0b4a30 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712c0ce1c0 con 0x7f712c0b4a30 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7122ffd640 1 -- 172.21.15.120:0/80543187 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c0039e0 con 0x7f712c0b4a30 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.811+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f712c0cb9e0 con 0x7f712c0b4a30 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.812+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f712c074f30 con 0x7f712c0b4a30 2024-03-31T16:35:45.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.812+0000 7f7122ffd640 1 -- 172.21.15.120:0/80543187 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f711c01a070 con 0x7f712c0b4a30 2024-03-31T16:35:45.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.813+0000 7f7122ffd640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f711006c8f0 0x7f711006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:45.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.813+0000 7f713229c640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f711006c8f0 0x7f711006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:45.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.813+0000 7f7122ffd640 1 -- 172.21.15.120:0/80543187 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f711c08ae60 con 0x7f712c0b4a30 2024-03-31T16:35:45.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.813+0000 7f713229c640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f711006c8f0 0x7f711006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7128034000 tx=0x7f712802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:45.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.817+0000 7f7122ffd640 1 -- 172.21.15.120:0/80543187 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f711c058cd0 con 0x7f712c0b4a30 2024-03-31T16:35:45.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.992+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f712c1614f0 con 0x7f712c0b4a30 2024-03-31T16:35:45.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.992+0000 7f7122ffd640 1 -- 172.21.15.120:0/80543187 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f711c05cfd0 con 0x7f712c0b4a30 2024-03-31T16:35:45.997 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f711006c8f0 msgr2=0x7f711006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f711006c8f0 0x7f711006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7128034000 tx=0x7f712802f000 comp rx=0 tx=0).stop 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4a30 msgr2=0x7f712c1605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4a30 0x7f712c1605f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c520 tx=0x7f711c00c9e0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 shutdown_connections 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f711006c8f0 0x7f711006edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f712c158580 0x7f712c160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f712c0b4a30 0x7f712c1605f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 --2- 172.21.15.120:0/80543187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f712c0b4650 0x7f712c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 >> 172.21.15.120:0/80543187 conn(0x7f712c067670 msgr2=0x7f712c06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:45.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 shutdown_connections 2024-03-31T16:35:46.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:45.994+0000 7f7134500640 1 -- 172.21.15.120:0/80543187 wait complete. 2024-03-31T16:35:46.009 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:35:46.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.105+0000 7f9f2e3af640 1 Processor -- start 2024-03-31T16:35:46.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.105+0000 7f9f2e3af640 1 -- start start 2024-03-31T16:35:46.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.105+0000 7f9f2e3af640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9f2815b260 0x7f9f280b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f2e3af640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2815ff50 con 0x7f9f2815b640 2024-03-31T16:35:46.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f2e3af640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2815f340 con 0x7f9f280b06b0 2024-03-31T16:35:46.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f2e3af640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2815f620 con 0x7f9f2815b260 2024-03-31T16:35:46.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f277fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9f2815b640 0x7f9f280affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36302/0 (socket says 172.21.15.120:36302) 2024-03-31T16:35:46.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f277fe640 1 -- 172.21.15.120:0/2119917885 learned_addr learned my addr 172.21.15.120:0/2119917885 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:46.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f27fff640 1 --2- 172.21.15.120:0/2119917885 >> v2:172.21.15.203:3300/0 conn(0x7f9f2815b260 0x7f9f280b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f26ffd640 1 -- 172.21.15.120:0/2119917885 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1219595101 0 0) 0x7f9f2815ff50 con 0x7f9f2815b640 2024-03-31T16:35:46.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f26ffd640 1 -- 172.21.15.120:0/2119917885 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f10003520 con 0x7f9f2815b640 2024-03-31T16:35:46.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f27fff640 1 -- 172.21.15.120:0/2119917885 >> v1:172.21.15.203:6789/0 conn(0x7f9f280b06b0 legacy=0x7f9f280aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f27fff640 1 -- 172.21.15.120:0/2119917885 >> v1:172.21.15.120:6789/0 conn(0x7f9f2815b640 legacy=0x7f9f280affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.106+0000 7f9f27fff640 1 -- 172.21.15.120:0/2119917885 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2815f900 con 0x7f9f2815b260 2024-03-31T16:35:46.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.107+0000 7f9f27fff640 1 --2- 172.21.15.120:0/2119917885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2815b260 0x7f9f280b40b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9f180097a0 tx=0x7f9f1802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad7ca1356c87b91c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.107+0000 7f9f26ffd640 1 -- 172.21.15.120:0/2119917885 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f18034070 con 0x7f9f2815b260 2024-03-31T16:35:46.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.107+0000 7f9f26ffd640 1 -- 172.21.15.120:0/2119917885 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f18030610 con 0x7f9f2815b260 2024-03-31T16:35:46.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.107+0000 7f9f26ffd640 1 -- 172.21.15.120:0/2119917885 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f180309c0 con 0x7f9f2815b260 2024-03-31T16:35:46.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.107+0000 7f9f2e3af640 1 -- 172.21.15.120:0/2119917885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2815b260 msgr2=0x7f9f280b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.107+0000 7f9f2e3af640 1 --2- 172.21.15.120:0/2119917885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2815b260 0x7f9f280b40b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9f180097a0 tx=0x7f9f1802b960 comp rx=0 tx=0).stop 2024-03-31T16:35:46.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.108+0000 7f9f2e3af640 1 -- 172.21.15.120:0/2119917885 shutdown_connections 2024-03-31T16:35:46.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.108+0000 7f9f2e3af640 1 --2- 172.21.15.120:0/2119917885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2815b260 0x7f9f280b40b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.108+0000 7f9f2e3af640 1 -- 172.21.15.120:0/2119917885 >> 172.21.15.120:0/2119917885 conn(0x7f9f280b65a0 msgr2=0x7f9f280b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:46.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.108+0000 7f9f2e3af640 1 -- 172.21.15.120:0/2119917885 shutdown_connections 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.108+0000 7f9f2e3af640 1 -- 172.21.15.120:0/2119917885 wait complete. 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.109+0000 7f9f2e3af640 1 Processor -- start 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.109+0000 7f9f2e3af640 1 -- start start 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.109+0000 7f9f2e3af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280b06b0 0x7f9f281e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2e3af640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2815b260 0x7f9f28150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2e3af640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f2815b640 0x7f9f2814cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2e3af640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2806e770 con 0x7f9f2815b640 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2e3af640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2815f010 con 0x7f9f280b06b0 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2e3af640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9f280b45f0 con 0x7f9f2815b260 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f2815b640 0x7f9f2814cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f2815b640 0x7f9f2814cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55878/0 (socket says 172.21.15.120:55878) 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 -- 172.21.15.120:0/500795642 learned_addr learned my addr 172.21.15.120:0/500795642 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f27fff640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280b06b0 0x7f9f281e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f277fe640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2815b260 0x7f9f28150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 -- 172.21.15.120:0/500795642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2815b260 msgr2=0x7f9f28150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2815b260 0x7f9f28150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 -- 172.21.15.120:0/500795642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280b06b0 msgr2=0x7f9f281e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280b06b0 0x7f9f281e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 -- 172.21.15.120:0/500795642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f280ce340 con 0x7f9f2815b640 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2c94c640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f2815b640 0x7f9f2814cb30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000c6c0 tx=0x7f9f2000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f24ff9640 1 -- 172.21.15.120:0/500795642 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20003b70 con 0x7f9f2815b640 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f24ff9640 1 -- 172.21.15.120:0/500795642 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f20003d10 con 0x7f9f2815b640 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f28151850 con 0x7f9f2815b640 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f24ff9640 1 -- 172.21.15.120:0/500795642 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f200052f0 con 0x7f9f2815b640 2024-03-31T16:35:46.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.110+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f28151e10 con 0x7f9f2815b640 2024-03-31T16:35:46.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.111+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f28068cd0 con 0x7f9f2815b640 2024-03-31T16:35:46.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.112+0000 7f9f24ff9640 1 -- 172.21.15.120:0/500795642 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f20005490 con 0x7f9f2815b640 2024-03-31T16:35:46.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.112+0000 7f9f24ff9640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f1406c920 0x7f9f1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.112+0000 7f9f27fff640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f1406c920 0x7f9f1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.112+0000 7f9f24ff9640 1 -- 172.21.15.120:0/500795642 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9f2008b7b0 con 0x7f9f2815b640 2024-03-31T16:35:46.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.112+0000 7f9f27fff640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f1406c920 0x7f9f1406ede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f18036000 tx=0x7f9f18008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.116+0000 7f9f24ff9640 1 -- 172.21.15.120:0/500795642 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9f20059620 con 0x7f9f2815b640 2024-03-31T16:35:46.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.328+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f280ce510 con 0x7f9f2815b640 2024-03-31T16:35:46.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.328+0000 7f9f24ff9640 1 -- 172.21.15.120:0/500795642 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f9f2005d920 con 0x7f9f2815b640 2024-03-31T16:35:46.333 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:46.333 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:35:31.420280+0000","modified":"2024-03-31T16:35:33.846906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-03-31T16:35:46.333 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f1406c920 msgr2=0x7f9f1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f1406c920 0x7f9f1406ede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f18036000 tx=0x7f9f18008030 comp rx=0 tx=0).stop 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f2815b640 msgr2=0x7f9f2814cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f2815b640 0x7f9f2814cb30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000c6c0 tx=0x7f9f2000cb80 comp rx=0 tx=0).stop 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 shutdown_connections 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f1406c920 0x7f9f1406ede0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f2815b640 0x7f9f2814cb30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2815b260 0x7f9f28150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 --2- 172.21.15.120:0/500795642 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f280b06b0 0x7f9f281e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.330+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 >> 172.21.15.120:0/500795642 conn(0x7f9f280b65a0 msgr2=0x7f9f2815a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:46.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.331+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 shutdown_connections 2024-03-31T16:35:46.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.331+0000 7f9f2e3af640 1 -- 172.21.15.120:0/500795642 wait complete. 2024-03-31T16:35:46.345 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:46.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.441+0000 7f764bf04640 1 Processor -- start 2024-03-31T16:35:46.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.442+0000 7f764bf04640 1 -- start start 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.442+0000 7f764bf04640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f7644169260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.442+0000 7f764bf04640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764406dfa0 con 0x7f76440d43d0 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.442+0000 7f764bf04640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764406e240 con 0x7f764415e860 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.442+0000 7f764bf04640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f76440cf220 con 0x7f76440d06c0 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.442+0000 7f764949f640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f76440d43d0 0x7f76440d47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36306/0 (socket says 172.21.15.120:36306) 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f764949f640 1 -- 172.21.15.120:0/3170516831 learned_addr learned my addr 172.21.15.120:0/3170516831 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f764a4a1640 1 --2- 172.21.15.120:0/3170516831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f7644169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f7648c9e640 1 -- 172.21.15.120:0/3170516831 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946256795 0 0) 0x7f764406dfa0 con 0x7f76440d43d0 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f7648c9e640 1 -- 172.21.15.120:0/3170516831 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7630003520 con 0x7f76440d43d0 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f7648c9e640 1 -- 172.21.15.120:0/3170516831 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782608087 0 0) 0x7f764406e240 con 0x7f764415e860 2024-03-31T16:35:46.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f7648c9e640 1 -- 172.21.15.120:0/3170516831 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f764406dfa0 con 0x7f764415e860 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f764a4a1640 1 -- 172.21.15.120:0/3170516831 >> v1:172.21.15.203:6789/0 conn(0x7f764415e860 legacy=0x7f764406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f764a4a1640 1 -- 172.21.15.120:0/3170516831 >> v1:172.21.15.120:6789/0 conn(0x7f76440d43d0 legacy=0x7f76440d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.443+0000 7f764a4a1640 1 -- 172.21.15.120:0/3170516831 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764406e520 con 0x7f76440d06c0 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f764a4a1640 1 --2- 172.21.15.120:0/3170516831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f7644169260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f763c009dc0 tx=0x7f763c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=774db1fd3e8bee66 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f7648c9e640 1 -- 172.21.15.120:0/3170516831 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c039070 con 0x7f76440d06c0 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f7648c9e640 1 -- 172.21.15.120:0/3170516831 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c02cc40 con 0x7f76440d06c0 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f7648c9e640 1 -- 172.21.15.120:0/3170516831 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c034440 con 0x7f76440d06c0 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f764bf04640 1 -- 172.21.15.120:0/3170516831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 msgr2=0x7f7644169260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f764bf04640 1 --2- 172.21.15.120:0/3170516831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f7644169260 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f763c009dc0 tx=0x7f763c02be90 comp rx=0 tx=0).stop 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f764bf04640 1 -- 172.21.15.120:0/3170516831 shutdown_connections 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f764bf04640 1 --2- 172.21.15.120:0/3170516831 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f7644169260 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f764bf04640 1 -- 172.21.15.120:0/3170516831 >> 172.21.15.120:0/3170516831 conn(0x7f764409d7d0 msgr2=0x7f764408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:46.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f764bf04640 1 -- 172.21.15.120:0/3170516831 shutdown_connections 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.444+0000 7f764bf04640 1 -- 172.21.15.120:0/3170516831 wait complete. 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.445+0000 7f764bf04640 1 Processor -- start 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764bf04640 1 -- start start 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764bf04640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f76441f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764bf04640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76440d43d0 0x7f76440b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764bf04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f764415e860 0x7f76440b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764bf04640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f764406dd80 con 0x7f764415e860 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764bf04640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f764406dc00 con 0x7f76440d43d0 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764bf04640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f76440cedb0 con 0x7f76440d06c0 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764a4a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f764415e860 0x7f76440b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764a4a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f764415e860 0x7f76440b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55892/0 (socket says 172.21.15.120:55892) 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764a4a1640 1 -- 172.21.15.120:0/1495463812 learned_addr learned my addr 172.21.15.120:0/1495463812 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f764949f640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76440d43d0 0x7f76440b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.446+0000 7f7649ca0640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f76441f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f764a4a1640 1 -- 172.21.15.120:0/1495463812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 msgr2=0x7f76441f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f764a4a1640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f76441f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f764a4a1640 1 -- 172.21.15.120:0/1495463812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76440d43d0 msgr2=0x7f76440b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f764a4a1640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76440d43d0 0x7f76440b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f764a4a1640 1 -- 172.21.15.120:0/1495463812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76440cc390 con 0x7f764415e860 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f764a4a1640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f764415e860 0x7f76440b21d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f763c037040 tx=0x7f763c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f763a7fc640 1 -- 172.21.15.120:0/1495463812 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c039050 con 0x7f764415e860 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f763a7fc640 1 -- 172.21.15.120:0/1495463812 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c045070 con 0x7f764415e860 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76440cd020 con 0x7f764415e860 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f763a7fc640 1 -- 172.21.15.120:0/1495463812 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c040690 con 0x7f764415e860 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.447+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76440cd5e0 con 0x7f764415e860 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.448+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76440685c0 con 0x7f764415e860 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.448+0000 7f763a7fc640 1 -- 172.21.15.120:0/1495463812 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f763c040830 con 0x7f764415e860 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.449+0000 7f763a7fc640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f762806c8f0 0x7f762806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.449+0000 7f763a7fc640 1 -- 172.21.15.120:0/1495463812 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f763c0ae2e0 con 0x7f764415e860 2024-03-31T16:35:46.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.449+0000 7f7649ca0640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f762806c8f0 0x7f762806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.449+0000 7f7649ca0640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f762806c8f0 0x7f762806edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7640007fd0 tx=0x7f7640009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.453+0000 7f763a7fc640 1 -- 172.21.15.120:0/1495463812 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f763c07c150 con 0x7f764415e860 2024-03-31T16:35:46.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.630+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76440b5ae0 con 0x7f764415e860 2024-03-31T16:35:46.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.631+0000 7f763a7fc640 1 -- 172.21.15.120:0/1495463812 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f763c080450 con 0x7f764415e860 2024-03-31T16:35:46.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:46.636 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:46.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f762806c8f0 msgr2=0x7f762806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f762806c8f0 0x7f762806edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7640007fd0 tx=0x7f7640009040 comp rx=0 tx=0).stop 2024-03-31T16:35:46.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f764415e860 msgr2=0x7f76440b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f764415e860 0x7f76440b21d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f763c037040 tx=0x7f763c004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:46.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 shutdown_connections 2024-03-31T16:35:46.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f762806c8f0 0x7f762806edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f764415e860 0x7f76440b21d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76440d43d0 0x7f76440b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 --2- 172.21.15.120:0/1495463812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76440d06c0 0x7f76441f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 >> 172.21.15.120:0/1495463812 conn(0x7f764409d7d0 msgr2=0x7f76440b53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:46.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 shutdown_connections 2024-03-31T16:35:46.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.633+0000 7f764bf04640 1 -- 172.21.15.120:0/1495463812 wait complete. 2024-03-31T16:35:46.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:35:46.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.745+0000 7f337eb11640 1 Processor -- start 2024-03-31T16:35:46.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.745+0000 7f337eb11640 1 -- start start 2024-03-31T16:35:46.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337eb11640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33780cd130 0x7f33780719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337eb11640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3378071f30 0x7f337806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337eb11640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33781463e0 con 0x7f3378146000 2024-03-31T16:35:46.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337eb11640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f337806dd80 con 0x7f3378071f30 2024-03-31T16:35:46.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337eb11640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f33780cd6b0 con 0x7f33780cd130 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337d0ae640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3378071f30 0x7f337806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337d0ae640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3378071f30 0x7f337806e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55904/0 (socket says 172.21.15.120:55904) 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337d0ae640 1 -- 172.21.15.120:0/2566068326 learned_addr learned my addr 172.21.15.120:0/2566068326 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f3377fff640 1 --2- 172.21.15.120:0/2566068326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33780cd130 0x7f33780719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337d0ae640 1 -- 172.21.15.120:0/2566068326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33780cd130 msgr2=0x7f33780719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337d0ae640 1 --2- 172.21.15.120:0/2566068326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33780cd130 0x7f33780719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337d0ae640 1 -- 172.21.15.120:0/2566068326 >> v1:172.21.15.203:6789/0 conn(0x7f3378146000 legacy=0x7f3378160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.746+0000 7f337d0ae640 1 -- 172.21.15.120:0/2566068326 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33780cd990 con 0x7f3378071f30 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337d0ae640 1 --2- 172.21.15.120:0/2566068326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378071f30 0x7f337806e210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3370009e50 tx=0x7f337002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7ed84bb159d736 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f33777fe640 1 -- 172.21.15.120:0/2566068326 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337002ca70 con 0x7f3378071f30 2024-03-31T16:35:46.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f33777fe640 1 -- 172.21.15.120:0/2566068326 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337002cc10 con 0x7f3378071f30 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f33777fe640 1 -- 172.21.15.120:0/2566068326 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33700343f0 con 0x7f3378071f30 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337eb11640 1 -- 172.21.15.120:0/2566068326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378071f30 msgr2=0x7f337806e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337eb11640 1 --2- 172.21.15.120:0/2566068326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378071f30 0x7f337806e210 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3370009e50 tx=0x7f337002bed0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337eb11640 1 -- 172.21.15.120:0/2566068326 shutdown_connections 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337eb11640 1 --2- 172.21.15.120:0/2566068326 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378071f30 0x7f337806e210 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337eb11640 1 --2- 172.21.15.120:0/2566068326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f33780cd130 0x7f33780719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337eb11640 1 -- 172.21.15.120:0/2566068326 >> 172.21.15.120:0/2566068326 conn(0x7f337806bba0 msgr2=0x7f33780b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337eb11640 1 -- 172.21.15.120:0/2566068326 shutdown_connections 2024-03-31T16:35:46.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.747+0000 7f337eb11640 1 -- 172.21.15.120:0/2566068326 wait complete. 2024-03-31T16:35:46.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.749+0000 7f337eb11640 1 Processor -- start 2024-03-31T16:35:46.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.749+0000 7f337eb11640 1 -- start start 2024-03-31T16:35:46.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.749+0000 7f337eb11640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3378071f30 0x7f33780a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.749+0000 7f337eb11640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f33780cd130 0x7f33780ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.749+0000 7f337eb11640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378146000 0x7f33780ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.749+0000 7f337eb11640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f337806e750 con 0x7f3378146000 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.749+0000 7f337eb11640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f337806da10 con 0x7f33780cd130 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.749+0000 7f337eb11640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f337806e8d0 con 0x7f3378071f30 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378146000 0x7f33780ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378146000 0x7f33780ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55908/0 (socket says 172.21.15.120:55908) 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 -- 172.21.15.120:0/4241030223 learned_addr learned my addr 172.21.15.120:0/4241030223 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337c8ad640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3378071f30 0x7f33780a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f3377fff640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f33780cd130 0x7f33780ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 -- 172.21.15.120:0/4241030223 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3378071f30 msgr2=0x7f33780a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3378071f30 0x7f33780a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 -- 172.21.15.120:0/4241030223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f33780cd130 msgr2=0x7f33780ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f33780cd130 0x7f33780ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 -- 172.21.15.120:0/4241030223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33780aa6a0 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337d0ae640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378146000 0x7f33780ab700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3370036040 tx=0x7f3370004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f33757fa640 1 -- 172.21.15.120:0/4241030223 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370043020 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f33757fa640 1 -- 172.21.15.120:0/4241030223 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337003e450 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33780aa9a0 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f33757fa640 1 -- 172.21.15.120:0/4241030223 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370009510 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.750+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33780ab1e0 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.751+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33780685c0 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.752+0000 7f33757fa640 1 -- 172.21.15.120:0/4241030223 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3370046020 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.752+0000 7f33757fa640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f335c06c920 0x7f335c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.752+0000 7f33757fa640 1 -- 172.21.15.120:0/4241030223 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f33700ae1a0 con 0x7f3378146000 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.752+0000 7f337c8ad640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f335c06c920 0x7f335c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:46.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.753+0000 7f337c8ad640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f335c06c920 0x7f335c06ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f33781e73c0 tx=0x7f336c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:46.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.757+0000 7f33757fa640 1 -- 172.21.15.120:0/4241030223 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f337004d030 con 0x7f3378146000 2024-03-31T16:35:46.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.968+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33780aab80 con 0x7f3378146000 2024-03-31T16:35:46.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.968+0000 7f33757fa640 1 -- 172.21.15.120:0/4241030223 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f33780aa9a0 con 0x7f3378146000 2024-03-31T16:35:46.973 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:46.973 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:35:31.420280+0000","modified":"2024-03-31T16:35:33.846906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-03-31T16:35:46.973 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-03-31T16:35:46.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.970+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f335c06c920 msgr2=0x7f335c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.970+0000 7f337eb11640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f335c06c920 0x7f335c06ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f33781e73c0 tx=0x7f336c009040 comp rx=0 tx=0).stop 2024-03-31T16:35:46.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.970+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378146000 msgr2=0x7f33780ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:46.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.970+0000 7f337eb11640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378146000 0x7f33780ab700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3370036040 tx=0x7f3370004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:46.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.970+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 shutdown_connections 2024-03-31T16:35:46.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.970+0000 7f337eb11640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f335c06c920 0x7f335c06ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.970+0000 7f337eb11640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3378146000 0x7f33780ab700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.971+0000 7f337eb11640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f33780cd130 0x7f33780ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.971+0000 7f337eb11640 1 --2- 172.21.15.120:0/4241030223 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3378071f30 0x7f33780a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:46.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.971+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 >> 172.21.15.120:0/4241030223 conn(0x7f337806bba0 msgr2=0x7f33780b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:46.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.971+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 shutdown_connections 2024-03-31T16:35:46.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:46.971+0000 7f337eb11640 1 -- 172.21.15.120:0/4241030223 wait complete. 2024-03-31T16:35:47.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-31T16:35:31.420280+0000', 'modified': '2024-03-31T16:35:33.846906+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6835/705983605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6833', 'nonce': 705983605}, {'type': 'v1', 'addr': '172.21.15.203:6835', 'nonce': 705983605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-03-31T16:35:47.389 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-31T16:35:47.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-31T16:35:47.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.489+0000 7f58125cd640 1 Processor -- start 2024-03-31T16:35:47.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.489+0000 7f58125cd640 1 -- start start 2024-03-31T16:35:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f58125cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c0d1bf0 0x7f580c15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f58125cd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f580c0705f0 0x7f580c06e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f58125cd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f580c15edc0 con 0x7f580c070170 2024-03-31T16:35:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f58125cd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f580c0d1fd0 con 0x7f580c0705f0 2024-03-31T16:35:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f58125cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f580c15eb80 con 0x7f580c0d1bf0 2024-03-31T16:35:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f5810b6a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f580c0705f0 0x7f580c06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f580b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f580c070170 0x7f580c06b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36316/0 (socket says 172.21.15.120:36316) 2024-03-31T16:35:47.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f580b7fe640 1 -- 172.21.15.120:0/1811183766 learned_addr learned my addr 172.21.15.120:0/1811183766 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f580bfff640 1 --2- 172.21.15.120:0/1811183766 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c0d1bf0 0x7f580c15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f580affd640 1 -- 172.21.15.120:0/1811183766 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179816408 0 0) 0x7f580c15edc0 con 0x7f580c070170 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f580affd640 1 -- 172.21.15.120:0/1811183766 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57f4003520 con 0x7f580c070170 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f5810b6a640 1 -- 172.21.15.120:0/1811183766 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c0d1bf0 msgr2=0x7f580c15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f5810b6a640 1 --2- 172.21.15.120:0/1811183766 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c0d1bf0 0x7f580c15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f5810b6a640 1 -- 172.21.15.120:0/1811183766 >> v1:172.21.15.120:6789/0 conn(0x7f580c070170 legacy=0x7f580c06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.490+0000 7f5810b6a640 1 -- 172.21.15.120:0/1811183766 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c0b5e60 con 0x7f580c0705f0 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f5810b6a640 1 --2- 172.21.15.120:0/1811183766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c06e750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5804009d90 tx=0x7f580402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7034f58f892333b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f580affd640 1 -- 172.21.15.120:0/1811183766 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804039070 con 0x7f580c0705f0 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f580affd640 1 -- 172.21.15.120:0/1811183766 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580402cc50 con 0x7f580c0705f0 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f580affd640 1 -- 172.21.15.120:0/1811183766 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804034440 con 0x7f580c0705f0 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f58125cd640 1 -- 172.21.15.120:0/1811183766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 msgr2=0x7f580c06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f58125cd640 1 --2- 172.21.15.120:0/1811183766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c06e750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5804009d90 tx=0x7f580402bea0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f58125cd640 1 -- 172.21.15.120:0/1811183766 shutdown_connections 2024-03-31T16:35:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f58125cd640 1 --2- 172.21.15.120:0/1811183766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c06e750 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f58125cd640 1 --2- 172.21.15.120:0/1811183766 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c0d1bf0 0x7f580c15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.491+0000 7f58125cd640 1 -- 172.21.15.120:0/1811183766 >> 172.21.15.120:0/1811183766 conn(0x7f580c0b6560 msgr2=0x7f580c0b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.492+0000 7f58125cd640 1 -- 172.21.15.120:0/1811183766 shutdown_connections 2024-03-31T16:35:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.492+0000 7f58125cd640 1 -- 172.21.15.120:0/1811183766 wait complete. 2024-03-31T16:35:47.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.493+0000 7f58125cd640 1 Processor -- start 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.493+0000 7f58125cd640 1 -- start start 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f58125cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c070170 0x7f580c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f58125cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f58125cd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c0d1bf0 0x7f580c1e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f58125cd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f580c15fae0 con 0x7f580c0705f0 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f58125cd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f580c15f080 con 0x7f580c0d1bf0 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f58125cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f580c0b5b10 con 0x7f580c070170 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c142a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55930/0 (socket says 172.21.15.120:55930) 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 -- 172.21.15.120:0/3235807843 learned_addr learned my addr 172.21.15.120:0/3235807843 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580bfff640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c070170 0x7f580c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f5810b6a640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c0d1bf0 0x7f580c1e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 -- 172.21.15.120:0/3235807843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c070170 msgr2=0x7f580c155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c070170 0x7f580c155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 -- 172.21.15.120:0/3235807843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c0d1bf0 msgr2=0x7f580c1e6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c0d1bf0 0x7f580c1e6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 -- 172.21.15.120:0/3235807843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c1433d0 con 0x7f580c0705f0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f580b7fe640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c142a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f580000c430 tx=0x7f580000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f5808ff9640 1 -- 172.21.15.120:0/3235807843 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800017070 con 0x7f580c0705f0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f5808ff9640 1 -- 172.21.15.120:0/3235807843 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5800005ce0 con 0x7f580c0705f0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f58125cd640 1 -- 172.21.15.120:0/3235807843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580c142f90 con 0x7f580c0705f0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f5808ff9640 1 -- 172.21.15.120:0/3235807843 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58000072f0 con 0x7f580c0705f0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.494+0000 7f58125cd640 1 -- 172.21.15.120:0/3235807843 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f580c143950 con 0x7f580c0705f0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.496+0000 7f5808ff9640 1 -- 172.21.15.120:0/3235807843 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f580001a070 con 0x7f580c0705f0 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.496+0000 7f5808ff9640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f57f806c8f0 0x7f57f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.496+0000 7f580bfff640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f57f806c8f0 0x7f57f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.496+0000 7f5808ff9640 1 -- 172.21.15.120:0/3235807843 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f580008aed0 con 0x7f580c0705f0 2024-03-31T16:35:47.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.496+0000 7f580bfff640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f57f806c8f0 0x7f57f806edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009aa0 tx=0x7f57fc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.497+0000 7f58151b5740 1 Processor -- start 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.497+0000 7f58151b5740 1 -- start start 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f58151b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f58151b5740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 0x564e941fb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f58151b5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e941cbc20 0x564e941fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f58151b5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564e94135020 con 0x564e941cbc20 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f58151b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e940dd5f0 con 0x564e941f8740 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f58151b5740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564e94130fd0 con 0x564e941f8b20 2024-03-31T16:35:47.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e941cbc20 0x564e941fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f580bfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f580b7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 0x564e941fb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e941cbc20 0x564e941fba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55938/0 (socket says 172.21.15.120:55938) 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 -- 172.21.15.120:0/428252118 learned_addr learned my addr 172.21.15.120:0/428252118 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 -- 172.21.15.120:0/428252118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 msgr2=0x564e941fb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 --2- 172.21.15.120:0/428252118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 0x564e941fb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 -- 172.21.15.120:0/428252118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 msgr2=0x564e941cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 --2- 172.21.15.120:0/428252118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 -- 172.21.15.120:0/428252118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e93e492d0 con 0x564e941cbc20 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.498+0000 7f5810b6a640 1 --2- 172.21.15.120:0/428252118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e941cbc20 0x564e941fba10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5804037040 tx=0x7f580402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b57098b310be4fe server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f57f1ffb640 1 -- 172.21.15.120:0/428252118 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804039040 con 0x564e941cbc20 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f57f1ffb640 1 -- 172.21.15.120:0/428252118 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580403a040 con 0x564e941cbc20 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f57f1ffb640 1 -- 172.21.15.120:0/428252118 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804034440 con 0x564e941cbc20 2024-03-31T16:35:47.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 -- 172.21.15.120:0/428252118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e941cbc20 msgr2=0x564e941fba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 --2- 172.21.15.120:0/428252118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e941cbc20 0x564e941fba10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5804037040 tx=0x7f580402e000 comp rx=0 tx=0).stop 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 -- 172.21.15.120:0/428252118 shutdown_connections 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 --2- 172.21.15.120:0/428252118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e941cbc20 0x564e941fba10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 --2- 172.21.15.120:0/428252118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 0x564e941fb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 --2- 172.21.15.120:0/428252118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 -- 172.21.15.120:0/428252118 >> 172.21.15.120:0/428252118 conn(0x564e941cd950 msgr2=0x564e942164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 -- 172.21.15.120:0/428252118 shutdown_connections 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.499+0000 7f58151b5740 1 -- 172.21.15.120:0/428252118 wait complete. 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.500+0000 7f58151b5740 1 -- start start 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.500+0000 7f58151b5740 1 Processor -- start 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f58151b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941f6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f58151b5740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 0x564e941fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f58151b5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94226d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f58151b5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564e941cfff0 con 0x564e94200510 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f58151b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e940f09c0 con 0x564e941f8740 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f58151b5740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564e941d2830 con 0x564e941f8b20 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f58151b5740 10 client.0 _ll_register_callbacks cb 0x564e940d4fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f580bfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f5810b6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94226d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f580bfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941f6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:36916/0 (socket says 172.21.15.120:36916) 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f580bfff640 1 -- 172.21.15.120:0/1673375528 learned_addr learned my addr 172.21.15.120:0/1673375528 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f580b7fe640 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 0x564e941fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f5810b6a640 1 -- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 msgr2=0x564e941fffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f5810b6a640 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 0x564e941fffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f5810b6a640 1 -- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 msgr2=0x564e941f6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f5810b6a640 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941f6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f5810b6a640 1 -- 172.21.15.120:0/1673375528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e93f136b0 con 0x564e94200510 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f5810b6a640 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94226d70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5804009d90 tx=0x7f5804004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6a525732e101d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f57eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f57eaffd640 1 -- 172.21.15.120:0/1673375528 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580404d070 con 0x564e94200510 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f57eaffd640 1 -- 172.21.15.120:0/1673375528 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5804034640 con 0x564e94200510 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.501+0000 7f58151b5740 1 -- 172.21.15.120:0/1673375528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f580403a040 con 0x564e94200510 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f57eaffd640 1 -- 172.21.15.120:0/1673375528 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f5804058050 con 0x564e94200510 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f58151b5740 10 client.4656 fetch_fsmap learned FSMap version 7 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f58151b5740 1 -- 172.21.15.120:0/1673375528 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x564e941fe120 con 0x564e94200510 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f57eaffd640 1 -- 172.21.15.120:0/1673375528 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580403a040 con 0x564e94200510 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f57eaffd640 1 -- 172.21.15.120:0/1673375528 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7f580405b020 con 0x564e94200510 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f58151b5740 10 client.4656 fetch_fsmap finished waiting for FSMap version 7 2024-03-31T16:35:47.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f58151b5740 10 client.4656 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f58151b5740 20 client.4656 populate_metadata read hostname 'smithi120' 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f58151b5740 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] conn(0x564e94230870 0x564e94234b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f58151b5740 4 client.4656 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f58151b5740 1 -- 172.21.15.120:0/1673375528 --> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e941094e0 con 0x564e94230870 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f580bfff640 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] conn(0x564e94230870 0x564e94234b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f57eaffd640 10 client.4656 ms_handle_connect on v2:172.21.15.203:6833/705983605 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.502+0000 7f580bfff640 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] conn(0x564e94230870 0x564e94234b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ad55e08f0ce33f7 server_cookie=399bdcb168fd5e33 in_seq=0 out_seq=0 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f57eaffd640 1 -- 172.21.15.120:0/1673375528 <== mds.0 v2:172.21.15.203:6833/705983605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564e941094e0 con 0x564e94230870 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f57eaffd640 10 client.4656 handle_command_reply: tid=0 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 client.4656 shutdown 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 -- 172.21.15.120:0/1673375528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 msgr2=0x564e94226d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94226d70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5804009d90 tx=0x7f5804004ab0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 -- 172.21.15.120:0/1673375528 shutdown_connections 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] conn(0x564e94230870 0x564e94234b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94226d70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8b20 0x564e941fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 --2- 172.21.15.120:0/1673375528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8740 0x564e941f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f57eaffd640 0 client.4656 ms_handle_reset on v2:172.21.15.203:6833/705983605 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 -- 172.21.15.120:0/1673375528 >> 172.21.15.120:0/1673375528 conn(0x564e941cbc20 msgr2=0x564e941cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 -- 172.21.15.120:0/1673375528 shutdown_connections 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 1 -- 172.21.15.120:0/1673375528 wait complete. 2024-03-31T16:35:47.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.503+0000 7f58151b5740 20 client.4656 trim_cache size 0 max 16384 2024-03-31T16:35:47.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.521+0000 7f58151b5740 1 Processor -- start 2024-03-31T16:35:47.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.521+0000 7f58151b5740 1 -- start start 2024-03-31T16:35:47.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f58151b5740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942876f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f58151b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 0x564e941fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f58151b5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e942018e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f58151b5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f580c15a7b0 con 0x564e94200510 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f58151b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f580c144df0 con 0x564e941f8b20 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f58151b5740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f580c15a160 con 0x564e941f8740 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f5810b6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e942018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f5810b6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e942018e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55970/0 (socket says 172.21.15.120:55970) 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f5810b6a640 1 -- 172.21.15.120:0/3122638610 learned_addr learned my addr 172.21.15.120:0/3122638610 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f580b7fe640 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 0x564e941fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.522+0000 7f580bfff640 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942876f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f5810b6a640 1 -- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 msgr2=0x564e942876f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f5810b6a640 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942876f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f5810b6a640 1 -- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 msgr2=0x564e941fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f5810b6a640 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 0x564e941fafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f5810b6a640 1 -- 172.21.15.120:0/3122638610 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e942270e0 con 0x564e94200510 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f580bfff640 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942876f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:47.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f5810b6a640 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e942018e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f580402c440 tx=0x7f5804036040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d354cf2e7c8c1834 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f57f17fa640 1 -- 172.21.15.120:0/3122638610 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580404d040 con 0x564e94200510 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f57f17fa640 1 -- 172.21.15.120:0/3122638610 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804034640 con 0x564e94200510 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f57f17fa640 1 -- 172.21.15.120:0/3122638610 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804039070 con 0x564e94200510 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 -- 172.21.15.120:0/3122638610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 msgr2=0x564e942018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e942018e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f580402c440 tx=0x7f5804036040 comp rx=0 tx=0).stop 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 -- 172.21.15.120:0/3122638610 shutdown_connections 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e942018e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 0x564e941fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 --2- 172.21.15.120:0/3122638610 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942876f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 -- 172.21.15.120:0/3122638610 >> 172.21.15.120:0/3122638610 conn(0x564e941cbc20 msgr2=0x564e941fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 -- 172.21.15.120:0/3122638610 shutdown_connections 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.523+0000 7f58151b5740 1 -- 172.21.15.120:0/3122638610 wait complete. 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.524+0000 7f58151b5740 1 -- start start 2024-03-31T16:35:47.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.524+0000 7f58151b5740 1 Processor -- start 2024-03-31T16:35:47.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f58151b5740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f58151b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 0x564e94201c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f58151b5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94217690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f58151b5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x564e942306f0 con 0x564e94200510 2024-03-31T16:35:47.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f58151b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e94230390 con 0x564e941f8b20 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f58151b5740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x564e94230ce0 con 0x564e941f8740 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f58151b5740 10 client.0 _ll_register_callbacks cb 0x7f57fc009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94217690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94217690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55978/0 (socket says 172.21.15.120:55978) 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 -- 172.21.15.120:0/1542888512 learned_addr learned my addr 172.21.15.120:0/1542888512 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f580b7fe640 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 0x564e94201c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f580bfff640 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 -- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 msgr2=0x564e942817c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942817c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 -- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 msgr2=0x564e94201c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 0x564e94201c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 -- 172.21.15.120:0/1542888512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e94281d00 con 0x564e94200510 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f5810b6a640 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94217690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5804034810 tx=0x7f580403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef70605db7f3e56 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.525+0000 7f57eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f57eaffd640 1 -- 172.21.15.120:0/1542888512 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804039030 con 0x564e94200510 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f57eaffd640 1 -- 172.21.15.120:0/1542888512 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5804003ba0 con 0x564e94200510 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 1 -- 172.21.15.120:0/1542888512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5804034640 con 0x564e94200510 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f57eaffd640 1 -- 172.21.15.120:0/1542888512 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f580406a050 con 0x564e94200510 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 10 client.4662 fetch_fsmap learned FSMap version 7 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 1 -- 172.21.15.120:0/1542888512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x564e94281f70 con 0x564e94200510 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f57eaffd640 1 -- 172.21.15.120:0/1542888512 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804034640 con 0x564e94200510 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f57eaffd640 1 -- 172.21.15.120:0/1542888512 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7f580405b040 con 0x564e94200510 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 10 client.4662 fetch_fsmap finished waiting for FSMap version 7 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 10 client.4662 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-31T16:35:47.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 20 client.4662 populate_metadata read hostname 'smithi120' 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] conn(0x564e94280ce0 0x564e942810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 4 client.4662 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f58151b5740 1 -- 172.21.15.120:0/1542888512 --> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] -- command(tid 0: {"prefix": "status"}) -- 0x564e94142560 con 0x564e94280ce0 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f580bfff640 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] conn(0x564e94280ce0 0x564e942810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f57eaffd640 10 client.4662 ms_handle_connect on v2:172.21.15.203:6833/705983605 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.526+0000 7f580bfff640 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] conn(0x564e94280ce0 0x564e942810c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cfa15fbd98aae38 server_cookie=72c559a2a9ebce71 in_seq=0 out_seq=0 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f57eaffd640 1 -- 172.21.15.120:0/1542888512 <== mds.0 v2:172.21.15.203:6833/705983605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x564e94142560 con 0x564e94280ce0 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f57eaffd640 10 client.4662 handle_command_reply: tid=0 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 client.4662 shutdown 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 -- 172.21.15.120:0/1542888512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 msgr2=0x564e94217690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94217690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5804034810 tx=0x7f580403f000 comp rx=0 tx=0).stop 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 -- 172.21.15.120:0/1542888512 shutdown_connections 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:6833/705983605,v1:172.21.15.203:6835/705983605] conn(0x564e94280ce0 0x564e942810c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564e94200510 0x564e94217690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f57eaffd640 0 client.4662 ms_handle_reset on v2:172.21.15.203:6833/705983605 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e941f8b20 0x564e94201c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 --2- 172.21.15.120:0/1542888512 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x564e941f8740 0x564e942817c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 -- 172.21.15.120:0/1542888512 >> 172.21.15.120:0/1542888512 conn(0x564e941cbc20 msgr2=0x564e94203fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 -- 172.21.15.120:0/1542888512 shutdown_connections 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 1 -- 172.21.15.120:0/1542888512 wait complete. 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58151b5740 20 client.4662 trim_cache size 0 max 16384 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-03-31T16:35:47.538 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "8cbda8ce-b993-4141-a43e-650fa7bfe1da", 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4287, 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 15.458726837, 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 7, 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 20, 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 20, 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 22.019342656999999 2024-03-31T16:35:47.539 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 -- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f57f806c8f0 msgr2=0x7f57f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f57f806c8f0 0x7f57f806edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009aa0 tx=0x7f57fc009190 comp rx=0 tx=0).stop 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 -- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 msgr2=0x7f580c142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c142a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f580000c430 tx=0x7f580000c8f0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 -- 172.21.15.120:0/3235807843 shutdown_connections 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f57f806c8f0 0x7f57f806edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f580c0d1bf0 0x7f580c1e6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f580c0705f0 0x7f580c142a50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 --2- 172.21.15.120:0/3235807843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f580c070170 0x7f580c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:47.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.527+0000 7f58125cd640 1 -- 172.21.15.120:0/3235807843 >> 172.21.15.120:0/3235807843 conn(0x7f580c0b6560 msgr2=0x7f580c0b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:47.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.528+0000 7f58125cd640 1 -- 172.21.15.120:0/3235807843 shutdown_connections 2024-03-31T16:35:47.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:47.528+0000 7f58125cd640 1 -- 172.21.15.120:0/3235807843 wait complete. 2024-03-31T16:35:47.543 INFO:teuthology.run_tasks:Running task sequential... 2024-03-31T16:35:47.553 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-31T16:35:47.553 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-31T16:35:47.554 INFO:teuthology.task.print:Enabling mgr modules 2024-03-31T16:35:47.554 INFO:teuthology.run_tasks:Running task kclient... 2024-03-31T16:35:47.578 INFO:tasks.kclient:Mounting kernel clients... 2024-03-31T16:35:47.578 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-31T16:35:47.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:47.579 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-03-31T16:35:47.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:47.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-03-31T16:35:47.662 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-03-31T16:35:47.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T16:35:47.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:47.664 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-03-31T16:35:47.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:47.720 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-03-31T16:35:47.787 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-03-31T16:35:47.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T16:35:47.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:47.789 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-03-31T16:35:47.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:47.804 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-03-31T16:35:47.872 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-03-31T16:35:47.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T16:35:47.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:47.874 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-03-31T16:35:47.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:47.929 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-03-31T16:35:47.996 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-03-31T16:35:47.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T16:35:47.998 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-31T16:35:47.998 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-31T16:35:47.998 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-31T16:35:47.998 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-31T16:35:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.098+0000 7fd86401b640 1 Processor -- start 2024-03-31T16:35:48.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.098+0000 7fd86401b640 1 -- start start 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd86401b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd85c155550 0x7fd85c155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd86401b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c15f800 0x7fd85c0d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd86401b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd85c0b40b0 con 0x7fd85c0d07c0 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd86401b640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd85c0d0c30 con 0x7fd85c155550 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd86401b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c0b4390 con 0x7fd85c15f800 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd8625b8640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd85c0d07c0 0x7fd85c0aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36330/0 (socket says 172.21.15.120:36330) 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd8625b8640 1 -- 172.21.15.120:0/2714653986 learned_addr learned my addr 172.21.15.120:0/2714653986 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd861db7640 1 --2- 172.21.15.120:0/2714653986 >> v2:172.21.15.203:3300/0 conn(0x7fd85c155550 0x7fd85c155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd8615b6640 1 --2- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c15f800 0x7fd85c0d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:48.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd860db5640 1 -- 172.21.15.120:0/2714653986 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326991067 0 0) 0x7fd85c0b40b0 con 0x7fd85c0d07c0 2024-03-31T16:35:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd860db5640 1 -- 172.21.15.120:0/2714653986 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd848003520 con 0x7fd85c0d07c0 2024-03-31T16:35:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd861db7640 1 -- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c15f800 msgr2=0x7fd85c0d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd861db7640 1 --2- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c15f800 0x7fd85c0d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd861db7640 1 -- 172.21.15.120:0/2714653986 >> v1:172.21.15.120:6789/0 conn(0x7fd85c0d07c0 legacy=0x7fd85c0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd861db7640 1 -- 172.21.15.120:0/2714653986 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c0b4670 con 0x7fd85c155550 2024-03-31T16:35:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.099+0000 7fd8615b6640 1 --2- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c15f800 0x7fd85c0d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:48.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.100+0000 7fd861db7640 1 --2- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c155550 0x7fd85c155930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8580097a0 tx=0x7fd85802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81b27fc9d528e86 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:48.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.100+0000 7fd860db5640 1 -- 172.21.15.120:0/2714653986 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858035020 con 0x7fd85c155550 2024-03-31T16:35:48.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.100+0000 7fd860db5640 1 -- 172.21.15.120:0/2714653986 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd858031830 con 0x7fd85c155550 2024-03-31T16:35:48.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.100+0000 7fd860db5640 1 -- 172.21.15.120:0/2714653986 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd858031be0 con 0x7fd85c155550 2024-03-31T16:35:48.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.101+0000 7fd86401b640 1 -- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c155550 msgr2=0x7fd85c155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.101+0000 7fd86401b640 1 --2- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c155550 0x7fd85c155930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8580097a0 tx=0x7fd85802b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.101+0000 7fd86401b640 1 -- 172.21.15.120:0/2714653986 shutdown_connections 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.101+0000 7fd86401b640 1 --2- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c15f800 0x7fd85c0d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.101+0000 7fd86401b640 1 --2- 172.21.15.120:0/2714653986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c155550 0x7fd85c155930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.101+0000 7fd86401b640 1 -- 172.21.15.120:0/2714653986 >> 172.21.15.120:0/2714653986 conn(0x7fd85c06b750 msgr2=0x7fd85c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.101+0000 7fd86401b640 1 -- 172.21.15.120:0/2714653986 shutdown_connections 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.101+0000 7fd86401b640 1 -- 172.21.15.120:0/2714653986 wait complete. 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.102+0000 7fd86401b640 1 Processor -- start 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.102+0000 7fd86401b640 1 -- start start 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd86401b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c0d07c0 0x7fd85c0cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd86401b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd85c155550 0x7fd85c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd86401b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c15f800 0x7fd85c1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:48.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd86401b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c15fc80 con 0x7fd85c155550 2024-03-31T16:35:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd86401b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c0b4c30 con 0x7fd85c15f800 2024-03-31T16:35:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd86401b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c15ba20 con 0x7fd85c0d07c0 2024-03-31T16:35:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8615b6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd85c155550 0x7fd85c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd861db7640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c0d07c0 0x7fd85c0cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd861db7640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c0d07c0 0x7fd85c0cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:49272/0 (socket says 172.21.15.120:49272) 2024-03-31T16:35:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8615b6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd85c155550 0x7fd85c0b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55990/0 (socket says 172.21.15.120:55990) 2024-03-31T16:35:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd861db7640 1 -- 172.21.15.120:0/3114546999 learned_addr learned my addr 172.21.15.120:0/3114546999 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:48.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8625b8640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c15f800 0x7fd85c1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:48.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8615b6640 1 -- 172.21.15.120:0/3114546999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c0d07c0 msgr2=0x7fd85c0cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:48.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8615b6640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c0d07c0 0x7fd85c0cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8615b6640 1 -- 172.21.15.120:0/3114546999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c15f800 msgr2=0x7fd85c1548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:48.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8615b6640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c15f800 0x7fd85c1548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8615b6640 1 -- 172.21.15.120:0/3114546999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c144d50 con 0x7fd85c155550 2024-03-31T16:35:48.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.103+0000 7fd8615b6640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd85c155550 0x7fd85c0b05e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00e900 tx=0x7fd84c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:48.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.105+0000 7fd8527fc640 1 -- 172.21.15.120:0/3114546999 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c017070 con 0x7fd85c155550 2024-03-31T16:35:48.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.105+0000 7fd8527fc640 1 -- 172.21.15.120:0/3114546999 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84c00ca00 con 0x7fd85c155550 2024-03-31T16:35:48.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.105+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c143cb0 con 0x7fd85c155550 2024-03-31T16:35:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.105+0000 7fd8527fc640 1 -- 172.21.15.120:0/3114546999 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00cdf0 con 0x7fd85c155550 2024-03-31T16:35:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.105+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c144270 con 0x7fd85c155550 2024-03-31T16:35:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.106+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85c0ad5d0 con 0x7fd85c155550 2024-03-31T16:35:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.106+0000 7fd8527fc640 1 -- 172.21.15.120:0/3114546999 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd84c01a070 con 0x7fd85c155550 2024-03-31T16:35:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.106+0000 7fd8527fc640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd84006c8f0 0x7fd84006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.106+0000 7fd861db7640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd84006c8f0 0x7fd84006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.106+0000 7fd8527fc640 1 -- 172.21.15.120:0/3114546999 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd84c08bd10 con 0x7fd85c155550 2024-03-31T16:35:48.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.107+0000 7fd861db7640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd84006c8f0 0x7fd84006edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd858009560 tx=0x7fd858008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:48.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.111+0000 7fd8527fc640 1 -- 172.21.15.120:0/3114546999 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd85c0ad5d0 con 0x7fd85c155550 2024-03-31T16:35:48.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.323+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd85c067db0 con 0x7fd85c155550 2024-03-31T16:35:48.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.323+0000 7fd8527fc640 1 -- 172.21.15.120:0/3114546999 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fd85c067db0 con 0x7fd85c155550 2024-03-31T16:35:48.328 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd84006c8f0 msgr2=0x7fd84006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd84006c8f0 0x7fd84006edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd858009560 tx=0x7fd858008030 comp rx=0 tx=0).stop 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd85c155550 msgr2=0x7fd85c0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd85c155550 0x7fd85c0b05e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00e900 tx=0x7fd84c00edc0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 shutdown_connections 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd84006c8f0 0x7fd84006edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd85c15f800 0x7fd85c1548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd85c155550 0x7fd85c0b05e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 --2- 172.21.15.120:0/3114546999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd85c0d07c0 0x7fd85c0cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:48.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 >> 172.21.15.120:0/3114546999 conn(0x7fd85c06b750 msgr2=0x7fd85c15c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:48.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 shutdown_connections 2024-03-31T16:35:48.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48.325+0000 7fd86401b640 1 -- 172.21.15.120:0/3114546999 wait complete. 2024-03-31T16:35:48.340 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-31T16:35:48.340 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-31T16:35:48.340 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-03-31T16:35:48.340 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-31T16:35:48.340 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-31T16:35:48.340 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-31T16:35:48.340 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-31T16:35:48.340 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-31T16:35:48.341 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-31T16:35:48.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:48.341 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-03-31T16:35:48.355 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:35:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:48.356 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-31T16:35:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-31T16:35:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42712sec preferred_lft 42712sec 2024-03-31T16:35:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-03-31T16:35:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:48.357 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-31T16:35:48.357 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:48.357 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:48.357 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-03-31T16:35:48.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-03-31T16:35:48.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-03-31T16:35:48.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-31T16:35:48.358 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:48.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:48.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:48.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:48.558 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-31T16:35:48.587 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-03-31T16:35:48.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:48.589 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-03-31T16:35:48.671 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-03-31T16:35:48.671 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-31T16:35:48.671 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-31T16:35:48.671 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-31T16:35:48.671 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-31T16:35:48.671 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:48.672 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:48.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-31T16:35:48.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-31T16:35:48.672 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-31T16:35:48.672 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:48.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:48.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:48.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:48.974 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-03-31T16:35:48.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:48.989 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-03-31T16:35:49.044 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:49.044 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:49.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-31T16:35:49.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-31T16:35:49.045 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:49.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:49.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:49.166 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-31T16:35:49.166 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:49.166 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:49.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-31T16:35:49.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-31T16:35:49.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-31T16:35:49.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-31T16:35:49.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-31T16:35:49.167 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:49.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:49.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:49.314 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:49.314 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:49.314 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-03-31T16:35:49.314 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-03-31T16:35:49.314 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:49.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:49.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:49.396 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:35:49.396 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-31T16:35:49.410 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-31T16:35:49.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:35:49.410 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-31T16:35:49.464 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-31T16:35:49.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:49.464 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-31T16:35:49.548 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-31T16:35:49.549 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-31T16:35:49.549 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:35:49.646 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-31T16:35:49.646 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-31T16:35:49.646 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:35:49.646 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:35:49.646 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:35:49.651 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-31T16:35:49.651 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-31T16:35:49.651 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:35:49.651 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:35:49.651 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:35:49.651 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790" 2024-03-31T16:35:49.651 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790:/ 2024-03-31T16:35:49.651 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8cbda8ce-b993-4141-a43e-650fa7bfe1da" will pass to kernel 2024-03-31T16:35:49.652 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-31T16:35:49.652 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-03-31T16:35:49.652 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-31T16:35:49.652 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-03-31T16:35:49.652 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-31T16:35:49.653 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-31T16:35:49.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:49.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-31T16:35:49.680 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:49.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:49.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:49.780 INFO:teuthology.orchestra.run.smithi120.stdout:client4627 2024-03-31T16:35:49.781 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:49.781 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:35:49.797 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:49.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:49.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:49.896 INFO:teuthology.orchestra.run.smithi120.stdout:client4627 2024-03-31T16:35:49.897 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:49.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:49.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:49.957 INFO:teuthology.orchestra.run.smithi120.stdout:client4627 2024-03-31T16:35:49.958 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/8cbda8ce-b993-4141-a43e-650fa7bfe1da.client4627/status') 2024-03-31T16:35:50.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:50.022 INFO:teuthology.orchestra.run.smithi120.stdout:instance: client.4627 (3)172.21.15.120:0/3373658729 2024-03-31T16:35:50.022 INFO:teuthology.orchestra.run.smithi120.stdout:blocklisted: false 2024-03-31T16:35:50.023 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records in 2024-03-31T16:35:50.023 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records out 2024-03-31T16:35:50.023 INFO:teuthology.orchestra.run.smithi120.stderr:71 bytes copied, 2.1266e-05 s, 3.3 MB/s 2024-03-31T16:35:50.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:50.029 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-03-31T16:35:50.029 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-31T16:35:50.030 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-31T16:35:50.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-31T16:35:50.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.126+0000 7fc2f0ac7640 1 Processor -- start 2024-03-31T16:35:50.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.126+0000 7fc2f0ac7640 1 -- start start 2024-03-31T16:35:50.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.127+0000 7fc2f0ac7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2ec0d43d0 0x7fc2ec0d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:50.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.127+0000 7fc2f0ac7640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec0cf6b0 0x7fc2ec0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:50.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.127+0000 7fc2f0ac7640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2ec0d4d20 con 0x7fc2ec15e860 2024-03-31T16:35:50.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.127+0000 7fc2f0ac7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fc2ec0cf220 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.127+0000 7fc2f0ac7640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ec06dfa0 con 0x7fc2ec0cf6b0 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2e9d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2ec0d43d0 0x7fc2ec0d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2ead9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec0cf6b0 0x7fc2ec0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2ead9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec0cf6b0 0x7fc2ec0cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:49280/0 (socket says 172.21.15.120:49280) 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2e9d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc2ec0d43d0 0x7fc2ec0d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56004/0 (socket says 172.21.15.120:56004) 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2ead9d640 1 -- 172.21.15.120:0/44822999 learned_addr learned my addr 172.21.15.120:0/44822999 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2ea59c640 1 --1- 172.21.15.120:0/44822999 >> v1:172.21.15.203:6789/0 conn(0x7fc2ec15e860 0x7fc2ec06d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:33454/0 (socket says 172.21.15.120:33454) 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2e9d9b640 1 -- 172.21.15.120:0/44822999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec0cf6b0 msgr2=0x7fc2ec0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2e9d9b640 1 --2- 172.21.15.120:0/44822999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec0cf6b0 0x7fc2ec0cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2e9d9b640 1 -- 172.21.15.120:0/44822999 >> v1:172.21.15.203:6789/0 conn(0x7fc2ec15e860 legacy=0x7fc2ec06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2e9d9b640 1 -- 172.21.15.120:0/44822999 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec06e240 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.128+0000 7fc2e959a640 1 -- 172.21.15.120:0/44822999 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2561320345 0 0) 0x7fc2e0001110 con 0x7fc2ec15e860 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2e9d9b640 1 --2- 172.21.15.120:0/44822999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec0d47e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0097a0 tx=0x7fc2dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639fcb9791610eba server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2e959a640 1 -- 172.21.15.120:0/44822999 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc035020 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2e959a640 1 -- 172.21.15.120:0/44822999 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc031830 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2e959a640 1 -- 172.21.15.120:0/44822999 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc031c00 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/44822999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 msgr2=0x7fc2ec0d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/44822999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec0d47e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0097a0 tx=0x7fc2dc02b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/44822999 shutdown_connections 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/44822999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec0cf6b0 0x7fc2ec0cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/44822999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec0d47e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/44822999 >> 172.21.15.120:0/44822999 conn(0x7fc2ec09d7d0 msgr2=0x7fc2ec08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:50.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/44822999 shutdown_connections 2024-03-31T16:35:50.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.129+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/44822999 wait complete. 2024-03-31T16:35:50.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.131+0000 7fc2f0ac7640 1 Processor -- start 2024-03-31T16:35:50.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.131+0000 7fc2f0ac7640 1 -- start start 2024-03-31T16:35:50.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.131+0000 7fc2f0ac7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2ec0cf6b0 0x7fc2ec1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.131+0000 7fc2f0ac7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec1606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.131+0000 7fc2f0ac7640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec15e860 0x7fc2ec0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.131+0000 7fc2f0ac7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec06dc00 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.131+0000 7fc2f0ac7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec0d2c50 con 0x7fc2ec0cf6b0 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.131+0000 7fc2f0ac7640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ec06dd80 con 0x7fc2ec15e860 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec1606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec1606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56018/0 (socket says 172.21.15.120:56018) 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 -- 172.21.15.120:0/2196163120 learned_addr learned my addr 172.21.15.120:0/2196163120 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2ea59c640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2ec0cf6b0 0x7fc2ec1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2ead9d640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec15e860 0x7fc2ec0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 -- 172.21.15.120:0/2196163120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec15e860 msgr2=0x7fc2ec0b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec15e860 0x7fc2ec0b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 -- 172.21.15.120:0/2196163120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2ec0cf6b0 msgr2=0x7fc2ec1528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:50.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2ec0cf6b0 0x7fc2ec1528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 -- 172.21.15.120:0/2196163120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec152e30 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2e9d9b640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec1606d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009890 tx=0x7fc2dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2daffd640 1 -- 172.21.15.120:0/2196163120 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc035040 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2daffd640 1 -- 172.21.15.120:0/2196163120 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc03b920 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2daffd640 1 -- 172.21.15.120:0/2196163120 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc03bd10 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec0c9bc0 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.132+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec0c8e00 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.133+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ec0685c0 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.134+0000 7fc2daffd640 1 -- 172.21.15.120:0/2196163120 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2dc038020 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.134+0000 7fc2daffd640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2cc06c920 0x7fc2cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.134+0000 7fc2daffd640 1 -- 172.21.15.120:0/2196163120 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc2dc0adb20 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.134+0000 7fc2ea59c640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2cc06c920 0x7fc2cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:50.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.135+0000 7fc2ea59c640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2cc06c920 0x7fc2cc06ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0007fd0 tx=0x7fc2e0007e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:50.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.138+0000 7fc2daffd640 1 -- 172.21.15.120:0/2196163120 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc2ec152e30 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.351+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc2ec06b570 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.351+0000 7fc2daffd640 1 -- 172.21.15.120:0/2196163120 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fc2dc031800 con 0x7fc2ec0d43d0 2024-03-31T16:35:50.355 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2cc06c920 msgr2=0x7fc2cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2cc06c920 0x7fc2cc06ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0007fd0 tx=0x7fc2e0007e00 comp rx=0 tx=0).stop 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 msgr2=0x7fc2ec1606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec1606d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009890 tx=0x7fc2dc0046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 shutdown_connections 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2cc06c920 0x7fc2cc06ede0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2ec15e860 0x7fc2ec0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2ec0d43d0 0x7fc2ec1606d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 --2- 172.21.15.120:0/2196163120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2ec0cf6b0 0x7fc2ec1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:50.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 >> 172.21.15.120:0/2196163120 conn(0x7fc2ec09d7d0 msgr2=0x7fc2ec06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:50.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 shutdown_connections 2024-03-31T16:35:50.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50.353+0000 7fc2f0ac7640 1 -- 172.21.15.120:0/2196163120 wait complete. 2024-03-31T16:35:50.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-31T16:35:50.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-31T16:35:50.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-03-31T16:35:50.368 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-31T16:35:50.369 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-31T16:35:50.369 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-31T16:35:50.369 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-31T16:35:50.369 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-31T16:35:50.369 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-31T16:35:50.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:50.369 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-03-31T16:35:50.384 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:35:50.384 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:35:50.384 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-31T16:35:50.385 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42710sec preferred_lft 42710sec 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:f2:d8:9a:13:40 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::3024:58ff:fea2:4615/64 scope link 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:f2:d8:9a:13:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::f2:d8ff:fe9a:1340/64 scope link tentative 2024-03-31T16:35:50.386 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:50.387 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-31T16:35:50.451 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-03-31T16:35:50.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:50.452 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-03-31T16:35:50.508 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-03-31T16:35:50.509 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-31T16:35:50.509 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-31T16:35:50.509 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-31T16:35:50.509 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-31T16:35:50.509 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:50.509 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:50.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-31T16:35:50.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-31T16:35:50.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-31T16:35:50.510 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:50.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:50.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:50.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:50.644 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-03-31T16:35:50.658 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-31T16:35:50.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:50.659 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-03-31T16:35:50.713 INFO:teuthology.orchestra.run.smithi120.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-31T16:35:50.714 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:50.714 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:50.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-31T16:35:50.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-31T16:35:50.714 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:50.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:50.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:50.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:50.836 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-31T16:35:50.862 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether e6:36:c9:49:1f:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::e436:c9ff:fe49:1f38/64 scope link 2024-03-31T16:35:50.863 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:50.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-31T16:35:50.931 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:35:50.931 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:35:50.931 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:35:50.931 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.932 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-03-31T16:35:50.932 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.932 INFO:teuthology.orchestra.run.smithi120.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-31T16:35:50.932 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether e6:36:c9:49:1f:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-31T16:35:50.932 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-31T16:35:50.932 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.932 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::e436:c9ff:fe49:1f38/64 scope link 2024-03-31T16:35:50.932 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:50.933 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-31T16:35:50.934 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:50.934 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:50.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-31T16:35:50.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-31T16:35:50.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-31T16:35:50.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-31T16:35:50.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-31T16:35:50.934 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:51.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:51.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:51.097 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:51.097 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:35:51.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.1 up 2024-03-31T16:35:51.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.1 master ceph-brx 2024-03-31T16:35:51.098 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:35:51.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:51.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:51.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:35:51.179 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-31T16:35:51.193 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-31T16:35:51.193 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:35:51.193 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-31T16:35:51.247 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-31T16:35:51.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:51.248 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-31T16:35:51.332 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-31T16:35:51.332 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-31T16:35:51.332 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:35:51.340 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-31T16:35:51.341 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-31T16:35:51.341 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:35:51.341 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:35:51.341 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:35:51.345 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-31T16:35:51.345 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-31T16:35:51.345 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:35:51.345 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:35:51.345 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:35:51.346 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790" 2024-03-31T16:35:51.346 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790:/ 2024-03-31T16:35:51.346 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=8cbda8ce-b993-4141-a43e-650fa7bfe1da" will pass to kernel 2024-03-31T16:35:51.346 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-31T16:35:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-03-31T16:35:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-31T16:35:51.346 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-03-31T16:35:51.347 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-31T16:35:51.347 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-31T16:35:51.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:51.348 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-31T16:35:51.374 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:51.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:51.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:51.468 INFO:teuthology.orchestra.run.smithi120.stdout:client4636 2024-03-31T16:35:51.469 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:35:51.469 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:35:51.486 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:51.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:51.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:51.584 INFO:teuthology.orchestra.run.smithi120.stdout:client4636 2024-03-31T16:35:51.584 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:51.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:51.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:51.643 INFO:teuthology.orchestra.run.smithi120.stdout:client4636 2024-03-31T16:35:51.644 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/8cbda8ce-b993-4141-a43e-650fa7bfe1da.client4636/status') 2024-03-31T16:35:51.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:51.707 INFO:teuthology.orchestra.run.smithi120.stdout:instance: client.4636 (3)172.21.15.120:0/1349665497 2024-03-31T16:35:51.708 INFO:teuthology.orchestra.run.smithi120.stdout:blocklisted: false 2024-03-31T16:35:51.708 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records in 2024-03-31T16:35:51.708 INFO:teuthology.orchestra.run.smithi120.stderr:0+1 records out 2024-03-31T16:35:51.708 INFO:teuthology.orchestra.run.smithi120.stderr:71 bytes copied, 2.1716e-05 s, 3.3 MB/s 2024-03-31T16:35:51.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:51.715 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-03-31T16:35:51.715 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-31T16:35:51.715 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-31T16:35:51.715 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-31T16:35:51.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.813+0000 7f17ae515640 1 Processor -- start 2024-03-31T16:35:51.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.813+0000 7f17ae515640 1 -- start start 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17ae515640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17a8070170 0x7f17a806b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17ae515640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f17a80705f0 0x7f17a806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17ae515640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a815edc0 con 0x7f17a80d1bf0 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17ae515640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f17a80d1fd0 con 0x7f17a8070170 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17ae515640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f17a815eb80 con 0x7f17a80705f0 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17a77fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17a8070170 0x7f17a806b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17a77fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f17a8070170 0x7f17a806b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56020/0 (socket says 172.21.15.120:56020) 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17a77fe640 1 -- 172.21.15.120:0/1347407554 learned_addr learned my addr 172.21.15.120:0/1347407554 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17acab2640 1 --2- 172.21.15.120:0/1347407554 >> v2:172.21.15.203:3300/0 conn(0x7f17a80705f0 0x7f17a806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:51.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17a77fe640 1 -- 172.21.15.120:0/1347407554 >> v2:172.21.15.203:3300/0 conn(0x7f17a80705f0 msgr2=0x7f17a806bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17a77fe640 1 --2- 172.21.15.120:0/1347407554 >> v2:172.21.15.203:3300/0 conn(0x7f17a80705f0 0x7f17a806bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17a77fe640 1 -- 172.21.15.120:0/1347407554 >> v1:172.21.15.203:6789/0 conn(0x7f17a80d1bf0 legacy=0x7f17a815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.814+0000 7f17a77fe640 1 -- 172.21.15.120:0/1347407554 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a80b5e60 con 0x7f17a8070170 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17a77fe640 1 --2- 172.21.15.120:0/1347407554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a8070170 0x7f17a806b570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17a806fd40 tx=0x7f179c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc583b0797bb03f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17a6ffd640 1 -- 172.21.15.120:0/1347407554 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c035020 con 0x7f17a8070170 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17a6ffd640 1 -- 172.21.15.120:0/1347407554 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c031870 con 0x7f17a8070170 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17a6ffd640 1 -- 172.21.15.120:0/1347407554 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c031c40 con 0x7f17a8070170 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17ae515640 1 -- 172.21.15.120:0/1347407554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a8070170 msgr2=0x7f17a806b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17ae515640 1 --2- 172.21.15.120:0/1347407554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a8070170 0x7f17a806b570 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17a806fd40 tx=0x7f179c02b910 comp rx=0 tx=0).stop 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17ae515640 1 -- 172.21.15.120:0/1347407554 shutdown_connections 2024-03-31T16:35:51.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17ae515640 1 --2- 172.21.15.120:0/1347407554 >> v2:172.21.15.203:3300/0 conn(0x7f17a80705f0 0x7f17a806bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:51.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17ae515640 1 --2- 172.21.15.120:0/1347407554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a8070170 0x7f17a806b570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:51.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.815+0000 7f17ae515640 1 -- 172.21.15.120:0/1347407554 >> 172.21.15.120:0/1347407554 conn(0x7f17a80b6560 msgr2=0x7f17a80b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:51.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.816+0000 7f17ae515640 1 -- 172.21.15.120:0/1347407554 shutdown_connections 2024-03-31T16:35:51.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.816+0000 7f17ae515640 1 -- 172.21.15.120:0/1347407554 wait complete. 2024-03-31T16:35:51.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.817+0000 7f17ae515640 1 Processor -- start 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.817+0000 7f17ae515640 1 -- start start 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.817+0000 7f17ae515640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17a8070170 0x7f17a8146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.817+0000 7f17ae515640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17a80705f0 0x7f17a81594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.817+0000 7f17ae515640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a80d1bf0 0x7f17a8160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.817+0000 7f17ae515640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17a80b5b10 con 0x7f17a80d1bf0 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17ae515640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17a815f080 con 0x7f17a8070170 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17ae515640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f17a80b4220 con 0x7f17a80705f0 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a80d1bf0 0x7f17a8160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a80d1bf0 0x7f17a8160ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56040/0 (socket says 172.21.15.120:56040) 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 -- 172.21.15.120:0/3128842847 learned_addr learned my addr 172.21.15.120:0/3128842847 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17a77fe640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17a80705f0 0x7f17a81594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17a7fff640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17a8070170 0x7f17a8146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:51.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 -- 172.21.15.120:0/3128842847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17a80705f0 msgr2=0x7f17a81594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17a80705f0 0x7f17a81594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 -- 172.21.15.120:0/3128842847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17a8070170 msgr2=0x7f17a8146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17a8070170 0x7f17a8146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 -- 172.21.15.120:0/3128842847 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a81470c0 con 0x7f17a80d1bf0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17acab2640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a80d1bf0 0x7f17a8160ad0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17a000efc0 tx=0x7f17a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17a4ff9640 1 -- 172.21.15.120:0/3128842847 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a0018020 con 0x7f17a80d1bf0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17a4ff9640 1 -- 172.21.15.120:0/3128842847 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a0014480 con 0x7f17a80d1bf0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a8159db0 con 0x7f17a80d1bf0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17a4ff9640 1 -- 172.21.15.120:0/3128842847 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a0014870 con 0x7f17a80d1bf0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.818+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a815a370 con 0x7f17a80d1bf0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.819+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a80685c0 con 0x7f17a80d1bf0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.820+0000 7f17a4ff9640 1 -- 172.21.15.120:0/3128842847 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17a0005d10 con 0x7f17a80d1bf0 2024-03-31T16:35:51.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.820+0000 7f17a4ff9640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f179406c8f0 0x7f179406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:51.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.820+0000 7f17a4ff9640 1 -- 172.21.15.120:0/3128842847 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f17a008c500 con 0x7f17a80d1bf0 2024-03-31T16:35:51.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.820+0000 7f17a7fff640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f179406c8f0 0x7f179406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:51.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.821+0000 7f17a7fff640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f179406c8f0 0x7f179406edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f17980016e0 tx=0x7f1798009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:51.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:51.825+0000 7f17a4ff9640 1 -- 172.21.15.120:0/3128842847 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f17a0022070 con 0x7f17a80d1bf0 2024-03-31T16:35:52.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.039+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f17a80b0290 con 0x7f17a80d1bf0 2024-03-31T16:35:52.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.040+0000 7f17a4ff9640 1 -- 172.21.15.120:0/3128842847 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f17a0010040 con 0x7f17a80d1bf0 2024-03-31T16:35:52.044 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f179406c8f0 msgr2=0x7f179406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f179406c8f0 0x7f179406edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f17980016e0 tx=0x7f1798009040 comp rx=0 tx=0).stop 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a80d1bf0 msgr2=0x7f17a8160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a80d1bf0 0x7f17a8160ad0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17a000efc0 tx=0x7f17a000c490 comp rx=0 tx=0).stop 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 shutdown_connections 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f179406c8f0 0x7f179406edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17a80d1bf0 0x7f17a8160ad0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17a80705f0 0x7f17a81594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:52.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 --2- 172.21.15.120:0/3128842847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17a8070170 0x7f17a8146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:52.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.041+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 >> 172.21.15.120:0/3128842847 conn(0x7f17a80b6560 msgr2=0x7f17a80b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:52.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.042+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 shutdown_connections 2024-03-31T16:35:52.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:52.042+0000 7f17ae515640 1 -- 172.21.15.120:0/3128842847 wait complete. 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-31T16:35:52.057 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-31T16:35:52.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:52.057 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-03-31T16:35:52.072 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:35:52.072 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:35:52.072 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:35:52.072 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:52.072 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-03-31T16:35:52.072 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:52.072 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-03-31T16:35:52.073 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:52.073 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-31T16:35:52.074 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:52.074 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:52.074 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add name ceph-brx type bridge 2024-03-31T16:35:52.074 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr flush dev ceph-brx 2024-03-31T16:35:52.074 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set ceph-brx up 2024-03-31T16:35:52.074 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-31T16:35:52.074 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:52.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:52.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:52.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:52.267 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-31T16:35:52.293 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-03-31T16:35:52.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:52.294 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-03-31T16:35:52.368 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-03-31T16:35:52.368 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-31T16:35:52.368 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-31T16:35:52.368 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-31T16:35:52.368 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-31T16:35:52.369 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:52.369 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:52.369 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-31T16:35:52.369 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-31T16:35:52.369 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-31T16:35:52.369 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:52.456 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:52.675 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:52.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:52.681 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-03-31T16:35:52.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:52.697 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2024-03-31T16:35:52.753 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:52.753 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:52.753 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-31T16:35:52.753 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-31T16:35:52.753 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:52.841 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:52.870 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:52.876 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-31T16:35:52.876 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:52.876 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:52.877 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-31T16:35:52.877 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-31T16:35:52.877 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-31T16:35:52.877 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-31T16:35:52.877 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-31T16:35:52.877 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:52.926 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:53.012 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:53.021 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:53.021 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:53.021 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2024-03-31T16:35:53.021 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.0 master ceph-brx 2024-03-31T16:35:53.021 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:53.069 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:53.097 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:53.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:35:53.105 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-31T16:35:53.125 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-31T16:35:53.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:35:53.125 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-31T16:35:53.180 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-31T16:35:53.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:53.180 DEBUG:teuthology.orchestra.run.smithi203:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-31T16:35:53.267 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-31T16:35:53.267 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-31T16:35:53.267 INFO:teuthology.orchestra.run.smithi203.stdout:invalid new device string format 2024-03-31T16:35:53.410 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-31T16:35:53.410 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-31T16:35:53.410 INFO:teuthology.orchestra.run.smithi203.stdout:invalid new device string format 2024-03-31T16:35:53.410 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:35:53.410 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:35:53.413 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-31T16:35:53.414 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-31T16:35:53.414 INFO:teuthology.orchestra.run.smithi203.stdout:invalid new device string format 2024-03-31T16:35:53.414 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:35:53.414 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:35:53.414 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790" 2024-03-31T16:35:53.414 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790:/ 2024-03-31T16:35:53.414 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=8cbda8ce-b993-4141-a43e-650fa7bfe1da" will pass to kernel 2024-03-31T16:35:53.415 INFO:teuthology.orchestra.run.smithi203.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-31T16:35:53.415 INFO:teuthology.orchestra.run.smithi203.stdout: You just mounted a file system that supports labels which does not 2024-03-31T16:35:53.415 INFO:teuthology.orchestra.run.smithi203.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-31T16:35:53.415 INFO:teuthology.orchestra.run.smithi203.stdout: applications will generate AVC messages and not be allowed access to 2024-03-31T16:35:53.415 INFO:teuthology.orchestra.run.smithi203.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-31T16:35:53.417 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-31T16:35:53.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:53.417 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-31T16:35:53.450 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:53.539 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:53.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:53.547 INFO:teuthology.orchestra.run.smithi203.stdout:client4648 2024-03-31T16:35:53.547 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:53.547 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:35:53.562 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:53.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:53.651 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:53.657 INFO:teuthology.orchestra.run.smithi203.stdout:client4648 2024-03-31T16:35:53.658 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:53.706 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:53.707 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:53.713 INFO:teuthology.orchestra.run.smithi203.stdout:client4648 2024-03-31T16:35:53.713 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/8cbda8ce-b993-4141-a43e-650fa7bfe1da.client4648/status') 2024-03-31T16:35:53.762 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:53.778 INFO:teuthology.orchestra.run.smithi203.stdout:instance: client.4648 (3)192.168.0.1:0/2084277237 2024-03-31T16:35:53.778 INFO:teuthology.orchestra.run.smithi203.stdout:blocklisted: false 2024-03-31T16:35:53.779 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records in 2024-03-31T16:35:53.779 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records out 2024-03-31T16:35:53.779 INFO:teuthology.orchestra.run.smithi203.stderr:69 bytes copied, 2.0318e-05 s, 3.4 MB/s 2024-03-31T16:35:53.779 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:53.788 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-03-31T16:35:53.788 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-31T16:35:53.788 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-31T16:35:53.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-31T16:35:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.897+0000 7f7830edd640 1 Processor -- start 2024-03-31T16:35:53.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.897+0000 7f7830edd640 1 -- start start 2024-03-31T16:35:53.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f7830edd640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f782c06c580 0x7f782c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f7830edd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f782c06ea40 0x7f782c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f7830edd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782c067900 con 0x7f782c1590c0 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f7830edd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f782c06e5b0 con 0x7f782c06ea40 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f7830edd640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f782c0b47d0 con 0x7f782c06c580 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f782a59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f782c1590c0 0x7f782c15f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36340/0 (socket says 172.21.15.120:36340) 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f782ad9d640 1 --2- 172.21.15.120:0/70958462 >> v2:172.21.15.120:3300/0 conn(0x7f782c06ea40 0x7f782c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f782a59c640 1 -- 172.21.15.120:0/70958462 learned_addr learned my addr 172.21.15.120:0/70958462 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f7829d9b640 1 --2- 172.21.15.120:0/70958462 >> v2:172.21.15.203:3300/0 conn(0x7f782c06c580 0x7f782c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f782ad9d640 1 -- 172.21.15.120:0/70958462 >> v2:172.21.15.203:3300/0 conn(0x7f782c06c580 msgr2=0x7f782c06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f782ad9d640 1 --2- 172.21.15.120:0/70958462 >> v2:172.21.15.203:3300/0 conn(0x7f782c06c580 0x7f782c06ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f782ad9d640 1 -- 172.21.15.120:0/70958462 >> v1:172.21.15.120:6789/0 conn(0x7f782c1590c0 legacy=0x7f782c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f782ad9d640 1 -- 172.21.15.120:0/70958462 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c0b4ab0 con 0x7f782c06ea40 2024-03-31T16:35:53.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.898+0000 7f782959a640 1 -- 172.21.15.120:0/70958462 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2526026147 0 0) 0x7f782c067900 con 0x7f782c1590c0 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.899+0000 7f782ad9d640 1 --2- 172.21.15.120:0/70958462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c06eef0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f782c073710 tx=0x7f782402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993a0be27edebfb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.899+0000 7f782959a640 1 -- 172.21.15.120:0/70958462 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824039070 con 0x7f782c06ea40 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.899+0000 7f782959a640 1 -- 172.21.15.120:0/70958462 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782402cc80 con 0x7f782c06ea40 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.899+0000 7f782959a640 1 -- 172.21.15.120:0/70958462 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824034660 con 0x7f782c06ea40 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.900+0000 7f7830edd640 1 -- 172.21.15.120:0/70958462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 msgr2=0x7f782c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.900+0000 7f7830edd640 1 --2- 172.21.15.120:0/70958462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c06eef0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f782c073710 tx=0x7f782402bed0 comp rx=0 tx=0).stop 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.900+0000 7f7830edd640 1 -- 172.21.15.120:0/70958462 shutdown_connections 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.900+0000 7f7830edd640 1 --2- 172.21.15.120:0/70958462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c06eef0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.900+0000 7f7830edd640 1 --2- 172.21.15.120:0/70958462 >> v2:172.21.15.203:3300/0 conn(0x7f782c06c580 0x7f782c06ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.900+0000 7f7830edd640 1 -- 172.21.15.120:0/70958462 >> 172.21.15.120:0/70958462 conn(0x7f782c071e60 msgr2=0x7f782c072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.900+0000 7f7830edd640 1 -- 172.21.15.120:0/70958462 shutdown_connections 2024-03-31T16:35:53.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.900+0000 7f7830edd640 1 -- 172.21.15.120:0/70958462 wait complete. 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.901+0000 7f7830edd640 1 Processor -- start 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.901+0000 7f7830edd640 1 -- start start 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7830edd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f782c06c580 0x7f782c14e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7830edd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7830edd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f782c1590c0 0x7f782c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7830edd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0b4380 con 0x7f782c06ea40 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7830edd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f782c06e240 con 0x7f782c1590c0 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7830edd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f782c0b4500 con 0x7f782c06c580 2024-03-31T16:35:53.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7829d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7829d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c1546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56054/0 (socket says 172.21.15.120:56054) 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7829d9b640 1 -- 172.21.15.120:0/4264732450 learned_addr learned my addr 172.21.15.120:0/4264732450 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f782ad9d640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f782c1590c0 0x7f782c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f782a59c640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f782c06c580 0x7f782c14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7829d9b640 1 -- 172.21.15.120:0/4264732450 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f782c06c580 msgr2=0x7f782c14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7829d9b640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f782c06c580 0x7f782c14e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7829d9b640 1 -- 172.21.15.120:0/4264732450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f782c1590c0 msgr2=0x7f782c154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7829d9b640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f782c1590c0 0x7f782c154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.902+0000 7f7829d9b640 1 -- 172.21.15.120:0/4264732450 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c14ec50 con 0x7f782c06ea40 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.903+0000 7f7829d9b640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c1546a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f782000e980 tx=0x7f782000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:53.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.903+0000 7f781affd640 1 -- 172.21.15.120:0/4264732450 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820017070 con 0x7f782c06ea40 2024-03-31T16:35:53.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.903+0000 7f781affd640 1 -- 172.21.15.120:0/4264732450 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782000ca00 con 0x7f782c06ea40 2024-03-31T16:35:53.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.903+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782c153480 con 0x7f782c06ea40 2024-03-31T16:35:53.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.903+0000 7f781affd640 1 -- 172.21.15.120:0/4264732450 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782000cdd0 con 0x7f782c06ea40 2024-03-31T16:35:53.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.903+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782c153a40 con 0x7f782c06ea40 2024-03-31T16:35:53.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.904+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782c0685c0 con 0x7f782c06ea40 2024-03-31T16:35:53.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.904+0000 7f781affd640 1 -- 172.21.15.120:0/4264732450 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f782001a070 con 0x7f782c06ea40 2024-03-31T16:35:53.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.904+0000 7f781affd640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f780c06c8f0 0x7f780c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:53.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.905+0000 7f781affd640 1 -- 172.21.15.120:0/4264732450 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f782008bab0 con 0x7f782c06ea40 2024-03-31T16:35:53.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.905+0000 7f782a59c640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f780c06c8f0 0x7f780c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:53.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.905+0000 7f782a59c640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f780c06c8f0 0x7f780c06edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f781c007fd0 tx=0x7f781c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:53.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:53.909+0000 7f781affd640 1 -- 172.21.15.120:0/4264732450 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7820059890 con 0x7f782c06ea40 2024-03-31T16:35:54.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.120+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f782c067590 con 0x7f782c06ea40 2024-03-31T16:35:54.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.121+0000 7f781affd640 1 -- 172.21.15.120:0/4264732450 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f782005db90 con 0x7f782c06ea40 2024-03-31T16:35:54.125 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-31T16:35:54.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f780c06c8f0 msgr2=0x7f780c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:54.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f780c06c8f0 0x7f780c06edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f781c007fd0 tx=0x7f781c007de0 comp rx=0 tx=0).stop 2024-03-31T16:35:54.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 msgr2=0x7f782c1546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:54.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c1546a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f782000e980 tx=0x7f782000ee40 comp rx=0 tx=0).stop 2024-03-31T16:35:54.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 shutdown_connections 2024-03-31T16:35:54.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f780c06c8f0 0x7f780c06edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:54.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f782c1590c0 0x7f782c154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:54.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f782c06ea40 0x7f782c1546a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:54.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 --2- 172.21.15.120:0/4264732450 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f782c06c580 0x7f782c14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:54.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 >> 172.21.15.120:0/4264732450 conn(0x7f782c071e60 msgr2=0x7f782c06ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:54.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 shutdown_connections 2024-03-31T16:35:54.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:54.123+0000 7f7830edd640 1 -- 172.21.15.120:0/4264732450 wait complete. 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-31T16:35:54.138 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-31T16:35:54.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:54.139 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-03-31T16:35:54.154 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:35:54.154 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:35:54.154 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:35:54.154 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.154 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-03-31T16:35:54.154 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-31T16:35:54.155 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42693sec preferred_lft 42693sec 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 96:4c:c8:80:25:dc brd ff:ff:ff:ff:ff:ff 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::3cce:ddff:fe03:91b5/64 scope link 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 96:4c:c8:80:25:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::944c:c8ff:fe80:25dc/64 scope link tentative 2024-03-31T16:35:54.156 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:54.157 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-31T16:35:54.220 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-03-31T16:35:54.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:54.221 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-03-31T16:35:54.277 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-03-31T16:35:54.277 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-31T16:35:54.278 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-31T16:35:54.278 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-31T16:35:54.278 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-31T16:35:54.278 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:54.278 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:54.278 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-31T16:35:54.278 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-31T16:35:54.278 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-31T16:35:54.278 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:54.365 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:54.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:54.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:54.413 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-03-31T16:35:54.428 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-31T16:35:54.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:54.429 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2024-03-31T16:35:54.483 INFO:teuthology.orchestra.run.smithi203.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-31T16:35:54.484 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:54.484 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:54.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-31T16:35:54.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-31T16:35:54.484 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:54.572 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:54.601 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:54.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:54.607 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-31T16:35:54.634 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:35:54.634 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:35:54.634 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:35:54.634 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.634 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-03-31T16:35:54.634 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.634 INFO:teuthology.orchestra.run.smithi203.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-31T16:35:54.635 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 1e:3d:c0:0c:aa:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-31T16:35:54.635 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-31T16:35:54.635 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.635 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::1c3d:c0ff:fe0c:aa6d/64 scope link tentative 2024-03-31T16:35:54.635 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:54.638 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-31T16:35:54.703 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:35:54.703 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 1e:3d:c0:0c:aa:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::1c3d:c0ff:fe0c:aa6d/64 scope link tentative 2024-03-31T16:35:54.704 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:35:54.705 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-31T16:35:54.705 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:54.705 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:54.706 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-31T16:35:54.706 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-31T16:35:54.706 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-31T16:35:54.706 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-31T16:35:54.706 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-31T16:35:54.706 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:54.793 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:54.865 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:54.872 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:35:54.872 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-03-31T16:35:54.872 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.1 up 2024-03-31T16:35:54.873 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.1 master ceph-brx 2024-03-31T16:35:54.873 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-03-31T16:35:54.921 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:54.949 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:54.956 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:35:54.956 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-31T16:35:54.970 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-31T16:35:54.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:35:54.971 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-31T16:35:55.025 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-31T16:35:55.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:55.026 DEBUG:teuthology.orchestra.run.smithi203:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-31T16:35:55.111 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-31T16:35:55.111 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-31T16:35:55.112 INFO:teuthology.orchestra.run.smithi203.stdout:invalid new device string format 2024-03-31T16:35:55.119 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-31T16:35:55.120 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-31T16:35:55.120 INFO:teuthology.orchestra.run.smithi203.stdout:invalid new device string format 2024-03-31T16:35:55.120 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:35:55.120 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:35:55.129 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-31T16:35:55.129 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-31T16:35:55.129 INFO:teuthology.orchestra.run.smithi203.stdout:invalid new device string format 2024-03-31T16:35:55.129 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:35:55.129 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:35:55.129 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790" 2024-03-31T16:35:55.129 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790:/ 2024-03-31T16:35:55.129 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=8cbda8ce-b993-4141-a43e-650fa7bfe1da" will pass to kernel 2024-03-31T16:35:55.130 INFO:teuthology.orchestra.run.smithi203.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-31T16:35:55.130 INFO:teuthology.orchestra.run.smithi203.stdout: You just mounted a file system that supports labels which does not 2024-03-31T16:35:55.130 INFO:teuthology.orchestra.run.smithi203.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-31T16:35:55.130 INFO:teuthology.orchestra.run.smithi203.stdout: applications will generate AVC messages and not be allowed access to 2024-03-31T16:35:55.130 INFO:teuthology.orchestra.run.smithi203.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-31T16:35:55.131 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-31T16:35:55.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:35:55.132 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-31T16:35:55.162 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:55.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:55.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:55.257 INFO:teuthology.orchestra.run.smithi203.stdout:client4657 2024-03-31T16:35:55.257 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:35:55.257 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:35:55.273 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:55.360 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:55.362 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:55.367 INFO:teuthology.orchestra.run.smithi203.stdout:client4657 2024-03-31T16:35:55.368 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:35:55.415 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:35:55.416 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:55.422 INFO:teuthology.orchestra.run.smithi203.stdout:client4657 2024-03-31T16:35:55.422 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/8cbda8ce-b993-4141-a43e-650fa7bfe1da.client4657/status') 2024-03-31T16:35:55.470 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:35:55.483 INFO:teuthology.orchestra.run.smithi203.stdout:instance: client.4657 (3)192.168.0.2:0/3207012977 2024-03-31T16:35:55.483 INFO:teuthology.orchestra.run.smithi203.stdout:blocklisted: false 2024-03-31T16:35:55.483 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records in 2024-03-31T16:35:55.483 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records out 2024-03-31T16:35:55.483 INFO:teuthology.orchestra.run.smithi203.stderr:69 bytes copied, 2.1331e-05 s, 3.2 MB/s 2024-03-31T16:35:55.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-03-31T16:35:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:35:55.490 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-31T16:35:55.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:55.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.614+0000 7f1f5f39d640 1 Processor -- start 2024-03-31T16:35:55.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.614+0000 7f1f5f39d640 1 -- start start 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5f39d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1f5815e420 0x7f1f580b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5f39d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f580d1a90 0x7f1f580d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5f39d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f580d2fd0 con 0x7f1f580b3460 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5f39d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1f580cfa70 con 0x7f1f5815e420 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5f39d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1f580cf790 con 0x7f1f580d1a90 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5db9a640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1f580b3460 0x7f1f580d1380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53200/0 (socket says 172.21.15.120:53200) 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5db9a640 1 -- 172.21.15.120:0/3351091299 learned_addr learned my addr 172.21.15.120:0/3351091299 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5eb9c640 1 --2- 172.21.15.120:0/3351091299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f580d1a90 0x7f1f580d3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5e39b640 1 --2- 172.21.15.120:0/3351091299 >> v2:172.21.15.203:3300/0 conn(0x7f1f5815e420 0x7f1f580b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5d399640 1 -- 172.21.15.120:0/3351091299 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857031866 0 0) 0x7f1f580d2fd0 con 0x7f1f580b3460 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5d399640 1 -- 172.21.15.120:0/3351091299 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f44003520 con 0x7f1f580b3460 2024-03-31T16:35:55.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5eb9c640 1 -- 172.21.15.120:0/3351091299 >> v2:172.21.15.203:3300/0 conn(0x7f1f5815e420 msgr2=0x7f1f580b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:55.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5eb9c640 1 --2- 172.21.15.120:0/3351091299 >> v2:172.21.15.203:3300/0 conn(0x7f1f5815e420 0x7f1f580b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5eb9c640 1 -- 172.21.15.120:0/3351091299 >> v1:172.21.15.120:6789/0 conn(0x7f1f580b3460 legacy=0x7f1f580d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5eb9c640 1 -- 172.21.15.120:0/3351091299 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f580d3270 con 0x7f1f580d1a90 2024-03-31T16:35:55.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.615+0000 7f1f5e39b640 1 --2- 172.21.15.120:0/3351091299 >> v2:172.21.15.203:3300/0 conn(0x7f1f5815e420 0x7f1f580b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:55.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.616+0000 7f1f5eb9c640 1 --2- 172.21.15.120:0/3351091299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f580d1a90 0x7f1f580d3a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009d90 tx=0x7f1f5002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f86ed1888546429 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:55.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.616+0000 7f1f5d399640 1 -- 172.21.15.120:0/3351091299 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50039070 con 0x7f1f580d1a90 2024-03-31T16:35:55.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.616+0000 7f1f5d399640 1 -- 172.21.15.120:0/3351091299 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5002cce0 con 0x7f1f580d1a90 2024-03-31T16:35:55.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.616+0000 7f1f5d399640 1 -- 172.21.15.120:0/3351091299 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50034660 con 0x7f1f580d1a90 2024-03-31T16:35:55.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.617+0000 7f1f5f39d640 1 -- 172.21.15.120:0/3351091299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f580d1a90 msgr2=0x7f1f580d3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.617+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/3351091299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f580d1a90 0x7f1f580d3a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009d90 tx=0x7f1f5002bf30 comp rx=0 tx=0).stop 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.617+0000 7f1f5f39d640 1 -- 172.21.15.120:0/3351091299 shutdown_connections 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.617+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/3351091299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f580d1a90 0x7f1f580d3a70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.617+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/3351091299 >> v2:172.21.15.203:3300/0 conn(0x7f1f5815e420 0x7f1f580b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.617+0000 7f1f5f39d640 1 -- 172.21.15.120:0/3351091299 >> 172.21.15.120:0/3351091299 conn(0x7f1f58067670 msgr2=0x7f1f58067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.617+0000 7f1f5f39d640 1 -- 172.21.15.120:0/3351091299 shutdown_connections 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.617+0000 7f1f5f39d640 1 -- 172.21.15.120:0/3351091299 wait complete. 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.618+0000 7f1f5f39d640 1 Processor -- start 2024-03-31T16:35:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.618+0000 7f1f5f39d640 1 -- start start 2024-03-31T16:35:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5f39d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f580b3460 0x7f1f580c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5f39d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f580d1a90 0x7f1f5815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5f39d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f5815e420 0x7f1f580b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5f39d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1f580cf420 con 0x7f1f580b3460 2024-03-31T16:35:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5f39d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5815e800 con 0x7f1f580d1a90 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5f39d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1f580d3fb0 con 0x7f1f5815e420 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5e39b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f580b3460 0x7f1f580c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5db9a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f580d1a90 0x7f1f5815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5eb9c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f5815e420 0x7f1f580b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5e39b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f580b3460 0x7f1f580c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37380/0 (socket says 172.21.15.120:37380) 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5e39b640 1 -- 172.21.15.120:0/2474406890 learned_addr learned my addr 172.21.15.120:0/2474406890 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5e39b640 1 -- 172.21.15.120:0/2474406890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f5815e420 msgr2=0x7f1f580b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5e39b640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f5815e420 0x7f1f580b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5e39b640 1 -- 172.21.15.120:0/2474406890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f580d1a90 msgr2=0x7f1f5815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5e39b640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f580d1a90 0x7f1f5815ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.619+0000 7f1f5e39b640 1 -- 172.21.15.120:0/2474406890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f580cad20 con 0x7f1f580b3460 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.620+0000 7f1f5e39b640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f580b3460 0x7f1f580c9920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e960 tx=0x7f1f5400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.620+0000 7f1f4effd640 1 -- 172.21.15.120:0/2474406890 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54017070 con 0x7f1f580b3460 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.620+0000 7f1f4effd640 1 -- 172.21.15.120:0/2474406890 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5400ca00 con 0x7f1f580b3460 2024-03-31T16:35:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.620+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f581612b0 con 0x7f1f580b3460 2024-03-31T16:35:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.620+0000 7f1f4effd640 1 -- 172.21.15.120:0/2474406890 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5400cdd0 con 0x7f1f580b3460 2024-03-31T16:35:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.620+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f58159cc0 con 0x7f1f580b3460 2024-03-31T16:35:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.621+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f58075940 con 0x7f1f580b3460 2024-03-31T16:35:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.621+0000 7f1f4effd640 1 -- 172.21.15.120:0/2474406890 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f5401a070 con 0x7f1f580b3460 2024-03-31T16:35:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.621+0000 7f1f4effd640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1f3c06c8f0 0x7f1f3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.622+0000 7f1f4effd640 1 -- 172.21.15.120:0/2474406890 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1f5408b950 con 0x7f1f580b3460 2024-03-31T16:35:55.627 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.622+0000 7f1f5db9a640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1f3c06c8f0 0x7f1f3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.622+0000 7f1f5db9a640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1f3c06c8f0 0x7f1f3c06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f580c79a0 tx=0x7f1f48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:55.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.626+0000 7f1f4effd640 1 -- 172.21.15.120:0/2474406890 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1f54059730 con 0x7f1f580b3460 2024-03-31T16:35:55.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.802+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f5815ec30 con 0x7f1f580b3460 2024-03-31T16:35:55.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.803+0000 7f1f4effd640 1 -- 172.21.15.120:0/2474406890 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f1f5405da30 con 0x7f1f580b3460 2024-03-31T16:35:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:55.808 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1f3c06c8f0 msgr2=0x7f1f3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1f3c06c8f0 0x7f1f3c06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f580c79a0 tx=0x7f1f48009040 comp rx=0 tx=0).stop 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f580b3460 msgr2=0x7f1f580c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f580b3460 0x7f1f580c9920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400e960 tx=0x7f1f5400ee20 comp rx=0 tx=0).stop 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 shutdown_connections 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1f3c06c8f0 0x7f1f3c06edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1f5815e420 0x7f1f580b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f580d1a90 0x7f1f5815ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 --2- 172.21.15.120:0/2474406890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f580b3460 0x7f1f580c9920 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 >> 172.21.15.120:0/2474406890 conn(0x7f1f58067670 msgr2=0x7f1f58157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:55.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 shutdown_connections 2024-03-31T16:35:55.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.805+0000 7f1f5f39d640 1 -- 172.21.15.120:0/2474406890 wait complete. 2024-03-31T16:35:55.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:35:55.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:35:55.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.920+0000 7efe167cd640 1 Processor -- start 2024-03-31T16:35:55.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.920+0000 7efe167cd640 1 -- start start 2024-03-31T16:35:55.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe167cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1006c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe167cd640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7efe10158580 0x7efe101589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe167cd640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1015ede0 con 0x7efe100b4a30 2024-03-31T16:35:55.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe167cd640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7efe100b6320 con 0x7efe10158580 2024-03-31T16:35:55.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe167cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efe10141b30 con 0x7efe100b4650 2024-03-31T16:35:55.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe0ffff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe14d6a640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7efe10158580 0x7efe101589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe0ffff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1006c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:38764/0 (socket says 172.21.15.120:38764) 2024-03-31T16:35:55.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe0ffff640 1 -- 172.21.15.120:0/2409370403 learned_addr learned my addr 172.21.15.120:0/2409370403 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:55.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.921+0000 7efe0f7fe640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7efe100b4a30 0x7efe100b5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:37776/0 (socket says 172.21.15.120:37776) 2024-03-31T16:35:55.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.922+0000 7efe0ffff640 1 -- 172.21.15.120:0/2409370403 >> v2:172.21.15.203:3300/0 conn(0x7efe10158580 msgr2=0x7efe101589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:55.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.922+0000 7efe0ffff640 1 --2- 172.21.15.120:0/2409370403 >> v2:172.21.15.203:3300/0 conn(0x7efe10158580 0x7efe101589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.922+0000 7efe0ffff640 1 -- 172.21.15.120:0/2409370403 >> v1:172.21.15.203:6789/0 conn(0x7efe100b4a30 legacy=0x7efe100b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.922+0000 7efe0ffff640 1 -- 172.21.15.120:0/2409370403 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe10141d80 con 0x7efe100b4650 2024-03-31T16:35:55.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.922+0000 7efe0ffff640 1 --2- 172.21.15.120:0/2409370403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1006c680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe00009870 tx=0x7efe0002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445d3025f294a9b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:55.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.922+0000 7efe0effd640 1 -- 172.21.15.120:0/2409370403 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00034070 con 0x7efe100b4650 2024-03-31T16:35:55.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe0effd640 1 -- 172.21.15.120:0/2409370403 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe00030840 con 0x7efe100b4650 2024-03-31T16:35:55.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe0effd640 1 -- 172.21.15.120:0/2409370403 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00030c10 con 0x7efe100b4650 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe167cd640 1 -- 172.21.15.120:0/2409370403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 msgr2=0x7efe1006c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe167cd640 1 --2- 172.21.15.120:0/2409370403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1006c680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe00009870 tx=0x7efe0002b980 comp rx=0 tx=0).stop 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe167cd640 1 -- 172.21.15.120:0/2409370403 shutdown_connections 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe167cd640 1 --2- 172.21.15.120:0/2409370403 >> v2:172.21.15.203:3300/0 conn(0x7efe10158580 0x7efe101589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe167cd640 1 --2- 172.21.15.120:0/2409370403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1006c680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe167cd640 1 -- 172.21.15.120:0/2409370403 >> 172.21.15.120:0/2409370403 conn(0x7efe10067670 msgr2=0x7efe10067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe167cd640 1 -- 172.21.15.120:0/2409370403 shutdown_connections 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.923+0000 7efe167cd640 1 -- 172.21.15.120:0/2409370403 wait complete. 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.924+0000 7efe167cd640 1 Processor -- start 2024-03-31T16:35:55.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.924+0000 7efe167cd640 1 -- start start 2024-03-31T16:35:55.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe167cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1013f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe167cd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100b4a30 0x7efe1013fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe167cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe10158580 0x7efe10160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe167cd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efe10142620 con 0x7efe10158580 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe167cd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe10142340 con 0x7efe100b4a30 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe167cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efe10142900 con 0x7efe100b4650 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe14d6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe10158580 0x7efe10160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe0ffff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1013f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe14d6a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe10158580 0x7efe10160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37396/0 (socket says 172.21.15.120:37396) 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe14d6a640 1 -- 172.21.15.120:0/2536784772 learned_addr learned my addr 172.21.15.120:0/2536784772 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.925+0000 7efe0f7fe640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100b4a30 0x7efe1013fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe14d6a640 1 -- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 msgr2=0x7efe1013f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe14d6a640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1013f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe14d6a640 1 -- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100b4a30 msgr2=0x7efe1013fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe14d6a640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100b4a30 0x7efe1013fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe14d6a640 1 -- 172.21.15.120:0/2536784772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe10161370 con 0x7efe10158580 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe0ffff640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1013f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:55.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe0f7fe640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100b4a30 0x7efe1013fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:55.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe14d6a640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe10158580 0x7efe10160600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efe0800efc0 tx=0x7efe0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:55.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe0cff9640 1 -- 172.21.15.120:0/2536784772 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe08018020 con 0x7efe10158580 2024-03-31T16:35:55.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe0cff9640 1 -- 172.21.15.120:0/2536784772 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe08014480 con 0x7efe10158580 2024-03-31T16:35:55.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe100cb720 con 0x7efe10158580 2024-03-31T16:35:55.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe0cff9640 1 -- 172.21.15.120:0/2536784772 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe08014870 con 0x7efe10158580 2024-03-31T16:35:55.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.926+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe10157900 con 0x7efe10158580 2024-03-31T16:35:55.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.927+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe10074f30 con 0x7efe10158580 2024-03-31T16:35:55.933 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.927+0000 7efe0cff9640 1 -- 172.21.15.120:0/2536784772 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe08005d10 con 0x7efe10158580 2024-03-31T16:35:55.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.928+0000 7efe0cff9640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efdfc06c8f0 0x7efdfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:55.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.928+0000 7efe0cff9640 1 -- 172.21.15.120:0/2536784772 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efe0808c4d0 con 0x7efe10158580 2024-03-31T16:35:55.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.928+0000 7efe0ffff640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efdfc06c8f0 0x7efdfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:55.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.928+0000 7efe0ffff640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efdfc06c8f0 0x7efdfc06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe00036000 tx=0x7efe00008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:55.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:55.932+0000 7efe0cff9640 1 -- 172.21.15.120:0/2536784772 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efe08022070 con 0x7efe10158580 2024-03-31T16:35:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.109+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efe1015c160 con 0x7efe10158580 2024-03-31T16:35:56.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.109+0000 7efe0cff9640 1 -- 172.21.15.120:0/2536784772 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7efe0808ae20 con 0x7efe10158580 2024-03-31T16:35:56.113 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:35:56.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efdfc06c8f0 msgr2=0x7efdfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efdfc06c8f0 0x7efdfc06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efe00036000 tx=0x7efe00008030 comp rx=0 tx=0).stop 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe10158580 msgr2=0x7efe10160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe10158580 0x7efe10160600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efe0800efc0 tx=0x7efe0800c490 comp rx=0 tx=0).stop 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 shutdown_connections 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efdfc06c8f0 0x7efdfc06edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe10158580 0x7efe10160600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe100b4a30 0x7efe1013fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 --2- 172.21.15.120:0/2536784772 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe100b4650 0x7efe1013f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 >> 172.21.15.120:0/2536784772 conn(0x7efe10067670 msgr2=0x7efe101433e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 shutdown_connections 2024-03-31T16:35:56.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.111+0000 7efe167cd640 1 -- 172.21.15.120:0/2536784772 wait complete. 2024-03-31T16:35:56.126 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:35:56.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.226+0000 7f51b1d88640 1 Processor -- start 2024-03-31T16:35:56.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.226+0000 7f51b1d88640 1 -- start start 2024-03-31T16:35:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51b1d88640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51ac153580 0x7f51ac0d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51b1d88640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 0x7f51ac0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51b1d88640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac0afab0 con 0x7f51ac0af2e0 2024-03-31T16:35:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51b1d88640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f51ac0d0c00 con 0x7f51ac153580 2024-03-31T16:35:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51b1d88640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac15cc80 con 0x7f51ac0d07c0 2024-03-31T16:35:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51ab7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51ac153580 0x7f51ac0d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51ab7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f51ac153580 0x7f51ac0d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37412/0 (socket says 172.21.15.120:37412) 2024-03-31T16:35:56.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51ab7fe640 1 -- 172.21.15.120:0/2689788994 learned_addr learned my addr 172.21.15.120:0/2689788994 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51aaffd640 1 --2- 172.21.15.120:0/2689788994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 0x7f51ac0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51ab7fe640 1 -- 172.21.15.120:0/2689788994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 msgr2=0x7f51ac0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51ab7fe640 1 --2- 172.21.15.120:0/2689788994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 0x7f51ac0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51ab7fe640 1 -- 172.21.15.120:0/2689788994 >> v1:172.21.15.203:6789/0 conn(0x7f51ac0af2e0 legacy=0x7f51ac06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.227+0000 7f51ab7fe640 1 -- 172.21.15.120:0/2689788994 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac15da00 con 0x7f51ac153580 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.228+0000 7f51ab7fe640 1 --2- 172.21.15.120:0/2689788994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac153580 0x7f51ac0d0280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f519c009870 tx=0x7f519c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a00dec2163e5876 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.228+0000 7f51aa7fc640 1 -- 172.21.15.120:0/2689788994 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c035020 con 0x7f51ac153580 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.228+0000 7f51aa7fc640 1 -- 172.21.15.120:0/2689788994 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c031640 con 0x7f51ac153580 2024-03-31T16:35:56.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.228+0000 7f51aa7fc640 1 -- 172.21.15.120:0/2689788994 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c02d040 con 0x7f51ac153580 2024-03-31T16:35:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.228+0000 7f51b1d88640 1 -- 172.21.15.120:0/2689788994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac153580 msgr2=0x7f51ac0d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.228+0000 7f51b1d88640 1 --2- 172.21.15.120:0/2689788994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac153580 0x7f51ac0d0280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f519c009870 tx=0x7f519c02b8f0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.229+0000 7f51b1d88640 1 -- 172.21.15.120:0/2689788994 shutdown_connections 2024-03-31T16:35:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.229+0000 7f51b1d88640 1 --2- 172.21.15.120:0/2689788994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 0x7f51ac0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.229+0000 7f51b1d88640 1 --2- 172.21.15.120:0/2689788994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac153580 0x7f51ac0d0280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.229+0000 7f51b1d88640 1 -- 172.21.15.120:0/2689788994 >> 172.21.15.120:0/2689788994 conn(0x7f51ac06b750 msgr2=0x7f51ac06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.229+0000 7f51b1d88640 1 -- 172.21.15.120:0/2689788994 shutdown_connections 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.229+0000 7f51b1d88640 1 -- 172.21.15.120:0/2689788994 wait complete. 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.230+0000 7f51b1d88640 1 Processor -- start 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.230+0000 7f51b1d88640 1 -- start start 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51b1d88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac0af2e0 0x7f51ac1e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51b1d88640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 0x7f51ac099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51b1d88640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51ac153580 0x7f51ac0b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51b1d88640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac15d4e0 con 0x7f51ac0af2e0 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51b1d88640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac15d200 con 0x7f51ac153580 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51b1d88640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac153960 con 0x7f51ac0d07c0 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac0af2e0 0x7f51ac1e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac0af2e0 0x7f51ac1e6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37420/0 (socket says 172.21.15.120:37420) 2024-03-31T16:35:56.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 -- 172.21.15.120:0/1867343955 learned_addr learned my addr 172.21.15.120:0/1867343955 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51aaffd640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 0x7f51ac099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51abfff640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51ac153580 0x7f51ac0b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 -- 172.21.15.120:0/1867343955 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 msgr2=0x7f51ac099840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 0x7f51ac099840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 -- 172.21.15.120:0/1867343955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51ac153580 msgr2=0x7f51ac0b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51ac153580 0x7f51ac0b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 -- 172.21.15.120:0/1867343955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac0cf270 con 0x7f51ac0af2e0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51ab7fe640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac0af2e0 0x7f51ac1e6060 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f519c02b930 tx=0x7f519c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f5193fff640 1 -- 172.21.15.120:0/1867343955 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c040070 con 0x7f51ac0af2e0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f5193fff640 1 -- 172.21.15.120:0/1867343955 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c03e070 con 0x7f51ac0af2e0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac0cf550 con 0x7f51ac0af2e0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f5193fff640 1 -- 172.21.15.120:0/1867343955 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c035040 con 0x7f51ac0af2e0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.231+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac0cfb10 con 0x7f51ac0af2e0 2024-03-31T16:35:56.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.232+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac0685c0 con 0x7f51ac0af2e0 2024-03-31T16:35:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.233+0000 7f5193fff640 1 -- 172.21.15.120:0/1867343955 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f519c038020 con 0x7f51ac0af2e0 2024-03-31T16:35:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.233+0000 7f5193fff640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f519806c8f0 0x7f519806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.233+0000 7f5193fff640 1 -- 172.21.15.120:0/1867343955 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f519c0ad350 con 0x7f51ac0af2e0 2024-03-31T16:35:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.233+0000 7f51aaffd640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f519806c8f0 0x7f519806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.234+0000 7f51aaffd640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f519806c8f0 0x7f519806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51ac06ff70 tx=0x7f51a0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.238+0000 7f5193fff640 1 -- 172.21.15.120:0/1867343955 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f519c07b130 con 0x7f51ac0af2e0 2024-03-31T16:35:56.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.412+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f51ac15ad40 con 0x7f51ac0af2e0 2024-03-31T16:35:56.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.412+0000 7f5193fff640 1 -- 172.21.15.120:0/1867343955 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f519c07f430 con 0x7f51ac0af2e0 2024-03-31T16:35:56.416 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f519806c8f0 msgr2=0x7f519806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f519806c8f0 0x7f519806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51ac06ff70 tx=0x7f51a0009190 comp rx=0 tx=0).stop 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac0af2e0 msgr2=0x7f51ac1e6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac0af2e0 0x7f51ac1e6060 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f519c02b930 tx=0x7f519c0046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 shutdown_connections 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f519806c8f0 0x7f519806edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51ac153580 0x7f51ac0b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51ac0d07c0 0x7f51ac099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 --2- 172.21.15.120:0/1867343955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51ac0af2e0 0x7f51ac1e6060 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.414+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 >> 172.21.15.120:0/1867343955 conn(0x7f51ac06b750 msgr2=0x7f51ac15b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:56.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.415+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 shutdown_connections 2024-03-31T16:35:56.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.415+0000 7f51b1d88640 1 -- 172.21.15.120:0/1867343955 wait complete. 2024-03-31T16:35:56.430 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:35:56.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.529+0000 7f243897b640 1 Processor -- start 2024-03-31T16:35:56.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.529+0000 7f243897b640 1 -- start start 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243897b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f243415e7b0 0x7f24340b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243897b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24340d0080 con 0x7f24340d1ce0 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243897b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24340d0360 con 0x7f24340c7810 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243897b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f24340cfe30 con 0x7f243415e7b0 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f2431d9b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f24340d1ce0 0x7f24340c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53214/0 (socket says 172.21.15.120:53214) 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f2431d9b640 1 -- 172.21.15.120:0/4230410707 learned_addr learned my addr 172.21.15.120:0/4230410707 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243259c640 1 --2- 172.21.15.120:0/4230410707 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f243415e7b0 0x7f24340b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243159a640 1 -- 172.21.15.120:0/4230410707 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062880770 0 0) 0x7f24340d0080 con 0x7f24340d1ce0 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243159a640 1 -- 172.21.15.120:0/4230410707 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f241c003520 con 0x7f24340d1ce0 2024-03-31T16:35:56.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243159a640 1 -- 172.21.15.120:0/4230410707 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499916423 0 0) 0x7f24340d0360 con 0x7f24340c7810 2024-03-31T16:35:56.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.530+0000 7f243159a640 1 -- 172.21.15.120:0/4230410707 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24340d0080 con 0x7f24340c7810 2024-03-31T16:35:56.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.531+0000 7f243259c640 1 -- 172.21.15.120:0/4230410707 >> v1:172.21.15.203:6789/0 conn(0x7f24340c7810 legacy=0x7f243406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.531+0000 7f243259c640 1 -- 172.21.15.120:0/4230410707 >> v1:172.21.15.120:6789/0 conn(0x7f24340d1ce0 legacy=0x7f24340c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.531+0000 7f243259c640 1 -- 172.21.15.120:0/4230410707 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24340d0640 con 0x7f243415e7b0 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.531+0000 7f243259c640 1 --2- 172.21.15.120:0/4230410707 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f243415e7b0 0x7f24340b4980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2424009dc0 tx=0x7f242402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1228231fc993db87 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.531+0000 7f243159a640 1 -- 172.21.15.120:0/4230410707 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424039070 con 0x7f243415e7b0 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243159a640 1 -- 172.21.15.120:0/4230410707 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242402ccd0 con 0x7f243415e7b0 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243159a640 1 -- 172.21.15.120:0/4230410707 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424034640 con 0x7f243415e7b0 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243897b640 1 -- 172.21.15.120:0/4230410707 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f243415e7b0 msgr2=0x7f24340b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243897b640 1 --2- 172.21.15.120:0/4230410707 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f243415e7b0 0x7f24340b4980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2424009dc0 tx=0x7f242402bf20 comp rx=0 tx=0).stop 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243897b640 1 -- 172.21.15.120:0/4230410707 shutdown_connections 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243897b640 1 --2- 172.21.15.120:0/4230410707 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f243415e7b0 0x7f24340b4980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243897b640 1 -- 172.21.15.120:0/4230410707 >> 172.21.15.120:0/4230410707 conn(0x7f24340b3e90 msgr2=0x7f24340b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243897b640 1 -- 172.21.15.120:0/4230410707 shutdown_connections 2024-03-31T16:35:56.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.532+0000 7f243897b640 1 -- 172.21.15.120:0/4230410707 wait complete. 2024-03-31T16:35:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.533+0000 7f243897b640 1 Processor -- start 2024-03-31T16:35:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f243897b640 1 -- start start 2024-03-31T16:35:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f243897b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24340c7810 0x7f24341448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f243897b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24340d1ce0 0x7f2434145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f243897b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f243415e7b0 0x7f24341e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f243897b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f24340d1120 con 0x7f24340d1ce0 2024-03-31T16:35:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f243897b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f24340d0c00 con 0x7f243415e7b0 2024-03-31T16:35:56.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f243897b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f243406d140 con 0x7f24340c7810 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24340d1ce0 0x7f2434145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24340d1ce0 0x7f2434145090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37422/0 (socket says 172.21.15.120:37422) 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f2431d9b640 1 -- 172.21.15.120:0/28426972 learned_addr learned my addr 172.21.15.120:0/28426972 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f243259c640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24340c7810 0x7f24341448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.534+0000 7f2432d9d640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f243415e7b0 0x7f24341e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2431d9b640 1 -- 172.21.15.120:0/28426972 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24340c7810 msgr2=0x7f24341448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2431d9b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24340c7810 0x7f24341448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2431d9b640 1 -- 172.21.15.120:0/28426972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f243415e7b0 msgr2=0x7f24341e74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2431d9b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f243415e7b0 0x7f24341e74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2431d9b640 1 -- 172.21.15.120:0/28426972 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24341455d0 con 0x7f24340d1ce0 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2431d9b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24340d1ce0 0x7f2434145090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f242800c500 tx=0x7f242800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2422ffd640 1 -- 172.21.15.120:0/28426972 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428017070 con 0x7f24340d1ce0 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2422ffd640 1 -- 172.21.15.120:0/28426972 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2428005ce0 con 0x7f24340d1ce0 2024-03-31T16:35:56.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24341e7a00 con 0x7f24340d1ce0 2024-03-31T16:35:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f2422ffd640 1 -- 172.21.15.120:0/28426972 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24280072f0 con 0x7f24340d1ce0 2024-03-31T16:35:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.535+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24341477e0 con 0x7f24340d1ce0 2024-03-31T16:35:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.536+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2434068cd0 con 0x7f24340d1ce0 2024-03-31T16:35:56.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.536+0000 7f2422ffd640 1 -- 172.21.15.120:0/28426972 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f242801a070 con 0x7f24340d1ce0 2024-03-31T16:35:56.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.537+0000 7f2422ffd640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f241406c920 0x7f241406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.537+0000 7f2422ffd640 1 -- 172.21.15.120:0/28426972 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f242808adb0 con 0x7f24340d1ce0 2024-03-31T16:35:56.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.537+0000 7f243259c640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f241406c920 0x7f241406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.537+0000 7f243259c640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f241406c920 0x7f241406ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2424036000 tx=0x7f2424030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.541+0000 7f2422ffd640 1 -- 172.21.15.120:0/28426972 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2428058c20 con 0x7f24340d1ce0 2024-03-31T16:35:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.716+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f24340cf620 con 0x7f24340d1ce0 2024-03-31T16:35:56.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.716+0000 7f2422ffd640 1 -- 172.21.15.120:0/28426972 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f242805cf20 con 0x7f24340d1ce0 2024-03-31T16:35:56.720 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:35:56.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f241406c920 msgr2=0x7f241406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f241406c920 0x7f241406ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2424036000 tx=0x7f2424030000 comp rx=0 tx=0).stop 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24340d1ce0 msgr2=0x7f2434145090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24340d1ce0 0x7f2434145090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f242800c500 tx=0x7f242800c9c0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 shutdown_connections 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f241406c920 0x7f241406ede0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f243415e7b0 0x7f24341e74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24340d1ce0 0x7f2434145090 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 --2- 172.21.15.120:0/28426972 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24340c7810 0x7f24341448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 >> 172.21.15.120:0/28426972 conn(0x7f24340b3e90 msgr2=0x7f2434071000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 shutdown_connections 2024-03-31T16:35:56.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.718+0000 7f243897b640 1 -- 172.21.15.120:0/28426972 wait complete. 2024-03-31T16:35:56.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:56.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.829+0000 7f5ada13f640 1 Processor -- start 2024-03-31T16:35:56.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.829+0000 7f5ada13f640 1 -- start start 2024-03-31T16:35:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ada13f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad415e7b0 0x7f5ad40b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ada13f640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5ad40d1d70 0x7f5ad40c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ada13f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ad40c7640 0x7f5ad4071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ada13f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad40d1240 con 0x7f5ad40c7640 2024-03-31T16:35:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ada13f640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad40d01a0 con 0x7f5ad40d1d70 2024-03-31T16:35:56.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ada13f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad40d0480 con 0x7f5ad415e7b0 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad415e7b0 0x7f5ad40b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ad3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ad40c7640 0x7f5ad4071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ad2ffd640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5ad40d1d70 0x7f5ad40c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad415e7b0 0x7f5ad40b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:38802/0 (socket says 172.21.15.120:38802) 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ad2ffd640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5ad40d1d70 0x7f5ad40c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:54928/0 (socket says 172.21.15.120:54928) 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ad3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5ad40c7640 0x7f5ad4071000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37434/0 (socket says 172.21.15.120:37434) 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.830+0000 7f5ad37fe640 1 -- 172.21.15.120:0/1266600173 learned_addr learned my addr 172.21.15.120:0/1266600173 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.831+0000 7f5ad37fe640 1 -- 172.21.15.120:0/1266600173 >> v2:172.21.15.203:3300/0 conn(0x7f5ad40d1d70 msgr2=0x7f5ad40c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.831+0000 7f5ad37fe640 1 --2- 172.21.15.120:0/1266600173 >> v2:172.21.15.203:3300/0 conn(0x7f5ad40d1d70 0x7f5ad40c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.831+0000 7f5ad37fe640 1 -- 172.21.15.120:0/1266600173 >> v2:172.21.15.120:3300/0 conn(0x7f5ad40c7640 msgr2=0x7f5ad4071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.831+0000 7f5ad37fe640 1 --2- 172.21.15.120:0/1266600173 >> v2:172.21.15.120:3300/0 conn(0x7f5ad40c7640 0x7f5ad4071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.831+0000 7f5ad37fe640 1 -- 172.21.15.120:0/1266600173 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad40d0760 con 0x7f5ad415e7b0 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.831+0000 7f5ad2ffd640 1 --2- 172.21.15.120:0/1266600173 >> v2:172.21.15.203:3300/0 conn(0x7f5ad40d1d70 0x7f5ad40c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:56.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.831+0000 7f5ad3fff640 1 --2- 172.21.15.120:0/1266600173 >> v2:172.21.15.120:3300/0 conn(0x7f5ad40c7640 0x7f5ad4071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:35:56.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.831+0000 7f5ad37fe640 1 --2- 172.21.15.120:0/1266600173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad415e7b0 0x7f5ad40b4980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4068260 tx=0x7f5ac402b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32c6f4727c9c46e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ad27fc640 1 -- 172.21.15.120:0/1266600173 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4035020 con 0x7f5ad415e7b0 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ad27fc640 1 -- 172.21.15.120:0/1266600173 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac4031870 con 0x7f5ad415e7b0 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ad27fc640 1 -- 172.21.15.120:0/1266600173 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4031c40 con 0x7f5ad415e7b0 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 -- 172.21.15.120:0/1266600173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad415e7b0 msgr2=0x7f5ad40b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 --2- 172.21.15.120:0/1266600173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad415e7b0 0x7f5ad40b4980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4068260 tx=0x7f5ac402b910 comp rx=0 tx=0).stop 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 -- 172.21.15.120:0/1266600173 shutdown_connections 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 --2- 172.21.15.120:0/1266600173 >> v2:172.21.15.120:3300/0 conn(0x7f5ad40c7640 0x7f5ad4071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 --2- 172.21.15.120:0/1266600173 >> v2:172.21.15.203:3300/0 conn(0x7f5ad40d1d70 0x7f5ad40c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 --2- 172.21.15.120:0/1266600173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad415e7b0 0x7f5ad40b4980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 -- 172.21.15.120:0/1266600173 >> 172.21.15.120:0/1266600173 conn(0x7f5ad40b3e90 msgr2=0x7f5ad40b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 -- 172.21.15.120:0/1266600173 shutdown_connections 2024-03-31T16:35:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.832+0000 7f5ada13f640 1 -- 172.21.15.120:0/1266600173 wait complete. 2024-03-31T16:35:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.833+0000 7f5ada13f640 1 Processor -- start 2024-03-31T16:35:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ada13f640 1 -- start start 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ada13f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad40c7640 0x7f5ad41418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ada13f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad40d1d70 0x7f5ad4154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ada13f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ad415e7b0 0x7f5ad4152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ada13f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad40cfe30 con 0x7f5ad40c7640 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ada13f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad40d0d20 con 0x7f5ad415e7b0 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ada13f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad4071540 con 0x7f5ad40d1d70 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad40c7640 0x7f5ad41418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad40c7640 0x7f5ad41418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37448/0 (socket says 172.21.15.120:37448) 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ad37fe640 1 -- 172.21.15.120:0/3221850994 learned_addr learned my addr 172.21.15.120:0/3221850994 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ad2ffd640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad40d1d70 0x7f5ad4154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.834+0000 7f5ad3fff640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ad415e7b0 0x7f5ad4152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5ad37fe640 1 -- 172.21.15.120:0/3221850994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad40d1d70 msgr2=0x7f5ad4154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5ad37fe640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad40d1d70 0x7f5ad4154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5ad37fe640 1 -- 172.21.15.120:0/3221850994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ad415e7b0 msgr2=0x7f5ad4152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5ad37fe640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ad415e7b0 0x7f5ad4152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5ad37fe640 1 -- 172.21.15.120:0/3221850994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad40caa70 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5ad37fe640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad40c7640 0x7f5ad41418c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ac402b950 tx=0x7f5ac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5abbfff640 1 -- 172.21.15.120:0/3221850994 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4035040 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5abbfff640 1 -- 172.21.15.120:0/3221850994 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac4030d00 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad40cad50 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5abbfff640 1 -- 172.21.15.120:0/3221850994 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40456c0 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.835+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad40cb310 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.836+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad4068cd0 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.836+0000 7f5abbfff640 1 -- 172.21.15.120:0/3221850994 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ac4038020 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.837+0000 7f5abbfff640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5ac006c8f0 0x7f5ac006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.837+0000 7f5abbfff640 1 -- 172.21.15.120:0/3221850994 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5ac40adcd0 con 0x7f5ad40c7640 2024-03-31T16:35:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.837+0000 7f5ad2ffd640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5ac006c8f0 0x7f5ac006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:56.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.837+0000 7f5ad2ffd640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5ac006c8f0 0x7f5ac006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009560 tx=0x7f5ac8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:56.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:56.841+0000 7f5abbfff640 1 -- 172.21.15.120:0/3221850994 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5ac407c100 con 0x7f5ad40c7640 2024-03-31T16:35:57.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.015+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ad41551e0 con 0x7f5ad40c7640 2024-03-31T16:35:57.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.016+0000 7f5abbfff640 1 -- 172.21.15.120:0/3221850994 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f5ac407ba00 con 0x7f5ad40c7640 2024-03-31T16:35:57.021 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:57.021 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:57.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5ac006c8f0 msgr2=0x7f5ac006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5ac006c8f0 0x7f5ac006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009560 tx=0x7f5ac8009190 comp rx=0 tx=0).stop 2024-03-31T16:35:57.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad40c7640 msgr2=0x7f5ad41418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad40c7640 0x7f5ad41418c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5ac402b950 tx=0x7f5ac40046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 shutdown_connections 2024-03-31T16:35:57.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5ac006c8f0 0x7f5ac006edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ad415e7b0 0x7f5ad4152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5ad40d1d70 0x7f5ad4154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 --2- 172.21.15.120:0/3221850994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ad40c7640 0x7f5ad41418c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 >> 172.21.15.120:0/3221850994 conn(0x7f5ad40b3e90 msgr2=0x7f5ad4158a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:57.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.018+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 shutdown_connections 2024-03-31T16:35:57.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.019+0000 7f5ada13f640 1 -- 172.21.15.120:0/3221850994 wait complete. 2024-03-31T16:35:57.034 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:35:57.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:35:57.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.135+0000 7fdcb560d640 1 Processor -- start 2024-03-31T16:35:57.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.135+0000 7fdcb560d640 1 -- start start 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.135+0000 7fdcb560d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdcb00d06c0 0x7fdcb0169260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.135+0000 7fdcb560d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb006dfa0 con 0x7fdcb00d43d0 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.135+0000 7fdcb560d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb006e240 con 0x7fdcb015e860 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.135+0000 7fdcb560d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb00cf220 con 0x7fdcb00d06c0 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.136+0000 7fdcaf7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdcb00d06c0 0x7fdcb0169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.136+0000 7fdcae7fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fdcb00d43d0 0x7fdcb00d47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53228/0 (socket says 172.21.15.120:53228) 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.136+0000 7fdcae7fc640 1 -- 172.21.15.120:0/2921094989 learned_addr learned my addr 172.21.15.120:0/2921094989 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.136+0000 7fdcaf7fe640 1 -- 172.21.15.120:0/2921094989 >> v1:172.21.15.203:6789/0 conn(0x7fdcb015e860 legacy=0x7fdcb006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.136+0000 7fdcaf7fe640 1 -- 172.21.15.120:0/2921094989 >> v1:172.21.15.120:6789/0 conn(0x7fdcb00d43d0 legacy=0x7fdcb00d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.136+0000 7fdcaf7fe640 1 -- 172.21.15.120:0/2921094989 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb006e520 con 0x7fdcb00d06c0 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.136+0000 7fdcaf7fe640 1 --2- 172.21.15.120:0/2921094989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb00d06c0 0x7fdcb0169260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009d90 tx=0x7fdca802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910c03a4135859bb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcadffb640 1 -- 172.21.15.120:0/2921094989 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8039070 con 0x7fdcb00d06c0 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcadffb640 1 -- 172.21.15.120:0/2921094989 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca802cd00 con 0x7fdcb00d06c0 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcadffb640 1 -- 172.21.15.120:0/2921094989 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8034660 con 0x7fdcb00d06c0 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcb560d640 1 -- 172.21.15.120:0/2921094989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb00d06c0 msgr2=0x7fdcb0169260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcb560d640 1 --2- 172.21.15.120:0/2921094989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb00d06c0 0x7fdcb0169260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009d90 tx=0x7fdca802bf50 comp rx=0 tx=0).stop 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcb560d640 1 -- 172.21.15.120:0/2921094989 shutdown_connections 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcb560d640 1 --2- 172.21.15.120:0/2921094989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb00d06c0 0x7fdcb0169260 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcb560d640 1 -- 172.21.15.120:0/2921094989 >> 172.21.15.120:0/2921094989 conn(0x7fdcb009d7d0 msgr2=0x7fdcb008bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcb560d640 1 -- 172.21.15.120:0/2921094989 shutdown_connections 2024-03-31T16:35:57.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.137+0000 7fdcb560d640 1 -- 172.21.15.120:0/2921094989 wait complete. 2024-03-31T16:35:57.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcb560d640 1 Processor -- start 2024-03-31T16:35:57.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcb560d640 1 -- start start 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcb560d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcb00d06c0 0x7fdcb00cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcb560d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcb00d43d0 0x7fdcb014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcb560d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb015e860 0x7fdcb01f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcb560d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb006dd80 con 0x7fdcb015e860 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcb560d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb006dc00 con 0x7fdcb00d06c0 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcb560d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb00cedb0 con 0x7fdcb00d43d0 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb015e860 0x7fdcb01f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb015e860 0x7fdcb01f7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37472/0 (socket says 172.21.15.120:37472) 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.139+0000 7fdcaf7fe640 1 -- 172.21.15.120:0/1604530066 learned_addr learned my addr 172.21.15.120:0/1604530066 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcae7fc640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcb00d43d0 0x7fdcb014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcaeffd640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcb00d06c0 0x7fdcb00cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcaf7fe640 1 -- 172.21.15.120:0/1604530066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcb00d43d0 msgr2=0x7fdcb014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcaf7fe640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcb00d43d0 0x7fdcb014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcaf7fe640 1 -- 172.21.15.120:0/1604530066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcb00d06c0 msgr2=0x7fdcb00cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcaf7fe640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcb00d06c0 0x7fdcb00cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcaf7fe640 1 -- 172.21.15.120:0/1604530066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb00b7df0 con 0x7fdcb015e860 2024-03-31T16:35:57.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcaf7fe640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb015e860 0x7fdcb01f7ff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009d90 tx=0x7fdca8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdc977fe640 1 -- 172.21.15.120:0/1604530066 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8039050 con 0x7fdcb015e860 2024-03-31T16:35:57.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdc977fe640 1 -- 172.21.15.120:0/1604530066 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca8045070 con 0x7fdcb015e860 2024-03-31T16:35:57.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb00cdff0 con 0x7fdcb015e860 2024-03-31T16:35:57.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdc977fe640 1 -- 172.21.15.120:0/1604530066 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca803e830 con 0x7fdcb015e860 2024-03-31T16:35:57.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.140+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb00ce5b0 con 0x7fdcb015e860 2024-03-31T16:35:57.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.141+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb00b7fc0 con 0x7fdcb015e860 2024-03-31T16:35:57.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.142+0000 7fdc977fe640 1 -- 172.21.15.120:0/1604530066 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdca803e9d0 con 0x7fdcb015e860 2024-03-31T16:35:57.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.142+0000 7fdc977fe640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.142+0000 7fdc977fe640 1 -- 172.21.15.120:0/1604530066 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdca80ae930 con 0x7fdcb015e860 2024-03-31T16:35:57.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.142+0000 7fdcaeffd640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.142+0000 7fdcaeffd640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00d31d0 tx=0x7fdca0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.146+0000 7fdc977fe640 1 -- 172.21.15.120:0/1604530066 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdca807c830 con 0x7fdcb015e860 2024-03-31T16:35:57.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.321+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdcb0073100 con 0x7fdcb015e860 2024-03-31T16:35:57.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.321+0000 7fdc977fe640 1 -- 172.21.15.120:0/1604530066 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fdca8080b30 con 0x7fdcb015e860 2024-03-31T16:35:57.326 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdc9c06c8f0 msgr2=0x7fdc9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00d31d0 tx=0x7fdca0009040 comp rx=0 tx=0).stop 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb015e860 msgr2=0x7fdcb01f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb015e860 0x7fdcb01f7ff0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdca8009d90 tx=0x7fdca8004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 shutdown_connections 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcb015e860 0x7fdcb01f7ff0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcb00d43d0 0x7fdcb014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 --2- 172.21.15.120:0/1604530066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcb00d06c0 0x7fdcb00cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 >> 172.21.15.120:0/1604530066 conn(0x7fdcb009d7d0 msgr2=0x7fdcb00b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 shutdown_connections 2024-03-31T16:35:57.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.323+0000 7fdcb560d640 1 -- 172.21.15.120:0/1604530066 wait complete. 2024-03-31T16:35:57.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:35:57.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.438+0000 7fe359c1b640 1 Processor -- start 2024-03-31T16:35:57.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.438+0000 7fe359c1b640 1 -- start start 2024-03-31T16:35:57.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe359c1b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe3541590c0 0x7fe35415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe359c1b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe35406c580 0x7fe35406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe359c1b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 0x7fe3541628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe359c1b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe35406e5b0 con 0x7fe3541590c0 2024-03-31T16:35:57.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe359c1b640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe35415fe10 con 0x7fe35406c580 2024-03-31T16:35:57.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe359c1b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe354067900 con 0x7fe354162440 2024-03-31T16:35:57.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe3537fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe3541590c0 0x7fe35415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe3537fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe3541590c0 0x7fe35415f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37478/0 (socket says 172.21.15.120:37478) 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe3537fe640 1 -- 172.21.15.120:0/1056285332 learned_addr learned my addr 172.21.15.120:0/1056285332 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe352ffd640 1 --2- 172.21.15.120:0/1056285332 >> v2:172.21.15.203:3300/0 conn(0x7fe35406c580 0x7fe35406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe353fff640 1 --2- 172.21.15.120:0/1056285332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 0x7fe3541628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe3537fe640 1 -- 172.21.15.120:0/1056285332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 msgr2=0x7fe3541628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe3537fe640 1 --2- 172.21.15.120:0/1056285332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 0x7fe3541628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe3537fe640 1 -- 172.21.15.120:0/1056285332 >> v2:172.21.15.203:3300/0 conn(0x7fe35406c580 msgr2=0x7fe35406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe3537fe640 1 --2- 172.21.15.120:0/1056285332 >> v2:172.21.15.203:3300/0 conn(0x7fe35406c580 0x7fe35406ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.439+0000 7fe3537fe640 1 -- 172.21.15.120:0/1056285332 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3540b47d0 con 0x7fe3541590c0 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.440+0000 7fe3537fe640 1 --2- 172.21.15.120:0/1056285332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe35415f8d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe354073710 tx=0x7fe34402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4767f2aad887ad server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.440+0000 7fe3527fc640 1 -- 172.21.15.120:0/1056285332 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344035020 con 0x7fe3541590c0 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.440+0000 7fe3527fc640 1 -- 172.21.15.120:0/1056285332 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344031870 con 0x7fe3541590c0 2024-03-31T16:35:57.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.440+0000 7fe3527fc640 1 -- 172.21.15.120:0/1056285332 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344031c40 con 0x7fe3541590c0 2024-03-31T16:35:57.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 -- 172.21.15.120:0/1056285332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 msgr2=0x7fe35415f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 --2- 172.21.15.120:0/1056285332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe35415f8d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe354073710 tx=0x7fe34402b910 comp rx=0 tx=0).stop 2024-03-31T16:35:57.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 -- 172.21.15.120:0/1056285332 shutdown_connections 2024-03-31T16:35:57.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 --2- 172.21.15.120:0/1056285332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 0x7fe3541628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 --2- 172.21.15.120:0/1056285332 >> v2:172.21.15.203:3300/0 conn(0x7fe35406c580 0x7fe35406ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 --2- 172.21.15.120:0/1056285332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe35415f8d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 -- 172.21.15.120:0/1056285332 >> 172.21.15.120:0/1056285332 conn(0x7fe354071e60 msgr2=0x7fe354072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 -- 172.21.15.120:0/1056285332 shutdown_connections 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.441+0000 7fe359c1b640 1 -- 172.21.15.120:0/1056285332 wait complete. 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.442+0000 7fe359c1b640 1 Processor -- start 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.442+0000 7fe359c1b640 1 -- start start 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe359c1b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe35406c580 0x7fe354145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe359c1b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe3540af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe359c1b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 0x7fe354145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe359c1b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe35406e240 con 0x7fe3541590c0 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe359c1b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe35406df60 con 0x7fe35406c580 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe359c1b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540b4380 con 0x7fe354162440 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe3540af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe3540af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37480/0 (socket says 172.21.15.120:37480) 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 -- 172.21.15.120:0/2323825793 learned_addr learned my addr 172.21.15.120:0/2323825793 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:57.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe3537fe640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe35406c580 0x7fe354145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe353fff640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 0x7fe354145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 -- 172.21.15.120:0/2323825793 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 msgr2=0x7fe354145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 0x7fe354145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 -- 172.21.15.120:0/2323825793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe35406c580 msgr2=0x7fe354145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe35406c580 0x7fe354145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 -- 172.21.15.120:0/2323825793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe354146520 con 0x7fe3541590c0 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.443+0000 7fe352ffd640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe3540af040 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe34800e840 tx=0x7fe34800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.444+0000 7fe33bfff640 1 -- 172.21.15.120:0/2323825793 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348017070 con 0x7fe3541590c0 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.444+0000 7fe33bfff640 1 -- 172.21.15.120:0/2323825793 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34800c730 con 0x7fe3541590c0 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.444+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe354146800 con 0x7fe3541590c0 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.444+0000 7fe33bfff640 1 -- 172.21.15.120:0/2323825793 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34800cb00 con 0x7fe3541590c0 2024-03-31T16:35:57.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.444+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe354146dc0 con 0x7fe3541590c0 2024-03-31T16:35:57.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.444+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3540af580 con 0x7fe3541590c0 2024-03-31T16:35:57.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.445+0000 7fe33bfff640 1 -- 172.21.15.120:0/2323825793 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe34801a070 con 0x7fe3541590c0 2024-03-31T16:35:57.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.445+0000 7fe33bfff640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe34006c8f0 0x7fe34006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.446+0000 7fe33bfff640 1 -- 172.21.15.120:0/2323825793 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe34808bc60 con 0x7fe3541590c0 2024-03-31T16:35:57.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.446+0000 7fe3537fe640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe34006c8f0 0x7fe34006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.446+0000 7fe3537fe640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe34006c8f0 0x7fe34006edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe344036000 tx=0x7fe34403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.451+0000 7fe33bfff640 1 -- 172.21.15.120:0/2323825793 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe348059a40 con 0x7fe3541590c0 2024-03-31T16:35:57.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.624+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe3540685c0 con 0x7fe3541590c0 2024-03-31T16:35:57.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.624+0000 7fe33bfff640 1 -- 172.21.15.120:0/2323825793 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe34805dd40 con 0x7fe3541590c0 2024-03-31T16:35:57.628 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:35:57.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe34006c8f0 msgr2=0x7fe34006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe34006c8f0 0x7fe34006edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe344036000 tx=0x7fe34403c040 comp rx=0 tx=0).stop 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 msgr2=0x7fe3540af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe3540af040 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe34800e840 tx=0x7fe34800ed00 comp rx=0 tx=0).stop 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 shutdown_connections 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe34006c8f0 0x7fe34006edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe354162440 0x7fe354145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3541590c0 0x7fe3540af040 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 --2- 172.21.15.120:0/2323825793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe35406c580 0x7fe354145e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 >> 172.21.15.120:0/2323825793 conn(0x7fe354071e60 msgr2=0x7fe35406f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 shutdown_connections 2024-03-31T16:35:57.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.626+0000 7fe359c1b640 1 -- 172.21.15.120:0/2323825793 wait complete. 2024-03-31T16:35:57.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:35:57.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.740+0000 7fac21eeb640 1 Processor -- start 2024-03-31T16:35:57.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.740+0000 7fac21eeb640 1 -- start start 2024-03-31T16:35:57.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac21eeb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fac1c146000 0x7fac1c160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac21eeb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 0x7fac1c06e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac21eeb640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c161130 con 0x7fac1c0cd130 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac21eeb640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fac1c06dd80 con 0x7fac1c146000 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac21eeb640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c1463e0 con 0x7fac1c072100 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fac1c146000 0x7fac1c160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac12ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fac1c0cd130 0x7fac1c0719f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53236/0 (socket says 172.21.15.120:53236) 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fac1c146000 0x7fac1c160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37486/0 (socket says 172.21.15.120:37486) 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac12ffd640 1 -- 172.21.15.120:0/1481563158 learned_addr learned my addr 172.21.15.120:0/1481563158 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1bfff640 1 --2- 172.21.15.120:0/1481563158 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 0x7fac1c06e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1b7fe640 1 -- 172.21.15.120:0/1481563158 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 msgr2=0x7fac1c06e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:57.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1b7fe640 1 --2- 172.21.15.120:0/1481563158 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 0x7fac1c06e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1b7fe640 1 -- 172.21.15.120:0/1481563158 >> v1:172.21.15.120:6789/0 conn(0x7fac1c0cd130 legacy=0x7fac1c0719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1b7fe640 1 -- 172.21.15.120:0/1481563158 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c0cd6b0 con 0x7fac1c146000 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1affd640 1 -- 172.21.15.120:0/1481563158 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279977425 0 0) 0x7fac04001110 con 0x7fac1c0cd130 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1b7fe640 1 --2- 172.21.15.120:0/1481563158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c146000 0x7fac1c160bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0097a0 tx=0x7fac0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d960fe3ff827adf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1affd640 1 -- 172.21.15.120:0/1481563158 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0315a0 con 0x7fac1c146000 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1affd640 1 -- 172.21.15.120:0/1481563158 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0c037070 con 0x7fac1c146000 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.742+0000 7fac1affd640 1 -- 172.21.15.120:0/1481563158 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c031960 con 0x7fac1c146000 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.743+0000 7fac21eeb640 1 -- 172.21.15.120:0/1481563158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c146000 msgr2=0x7fac1c160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.743+0000 7fac21eeb640 1 --2- 172.21.15.120:0/1481563158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c146000 0x7fac1c160bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0097a0 tx=0x7fac0c02b840 comp rx=0 tx=0).stop 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.743+0000 7fac21eeb640 1 -- 172.21.15.120:0/1481563158 shutdown_connections 2024-03-31T16:35:57.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.743+0000 7fac21eeb640 1 --2- 172.21.15.120:0/1481563158 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 0x7fac1c06e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.743+0000 7fac21eeb640 1 --2- 172.21.15.120:0/1481563158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c146000 0x7fac1c160bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.743+0000 7fac21eeb640 1 -- 172.21.15.120:0/1481563158 >> 172.21.15.120:0/1481563158 conn(0x7fac1c06bba0 msgr2=0x7fac1c0b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:57.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.743+0000 7fac21eeb640 1 -- 172.21.15.120:0/1481563158 shutdown_connections 2024-03-31T16:35:57.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.743+0000 7fac21eeb640 1 -- 172.21.15.120:0/1481563158 wait complete. 2024-03-31T16:35:57.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.744+0000 7fac21eeb640 1 Processor -- start 2024-03-31T16:35:57.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.744+0000 7fac21eeb640 1 -- start start 2024-03-31T16:35:57.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac21eeb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 0x7fac1c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac21eeb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c0cd130 0x7fac1c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac21eeb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac1c146000 0x7fac1c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac21eeb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c06da10 con 0x7fac1c0cd130 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac21eeb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c0cdc70 con 0x7fac1c146000 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac21eeb640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c06e750 con 0x7fac1c072100 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac12ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c0cd130 0x7fac1c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac12ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c0cd130 0x7fac1c0b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37490/0 (socket says 172.21.15.120:37490) 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac12ffd640 1 -- 172.21.15.120:0/2332306733 learned_addr learned my addr 172.21.15.120:0/2332306733 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac1bfff640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac1c146000 0x7fac1c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac1b7fe640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 0x7fac1c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac12ffd640 1 -- 172.21.15.120:0/2332306733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 msgr2=0x7fac1c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac12ffd640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 0x7fac1c151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac12ffd640 1 -- 172.21.15.120:0/2332306733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac1c146000 msgr2=0x7fac1c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac12ffd640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac1c146000 0x7fac1c0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.745+0000 7fac12ffd640 1 -- 172.21.15.120:0/2332306733 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c15e760 con 0x7fac1c0cd130 2024-03-31T16:35:57.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.746+0000 7fac12ffd640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c0cd130 0x7fac1c0b1080 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac0400c7b0 tx=0x7fac0400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.746+0000 7fac18ff9640 1 -- 172.21.15.120:0/2332306733 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04018070 con 0x7fac1c0cd130 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.746+0000 7fac18ff9640 1 -- 172.21.15.120:0/2332306733 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac040072d0 con 0x7fac1c0cd130 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.746+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c15ea40 con 0x7fac1c0cd130 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.746+0000 7fac18ff9640 1 -- 172.21.15.120:0/2332306733 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac040047e0 con 0x7fac1c0cd130 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.746+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c15f000 con 0x7fac1c0cd130 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.747+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1c0685c0 con 0x7fac1c0cd130 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.747+0000 7fac18ff9640 1 -- 172.21.15.120:0/2332306733 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac0401b070 con 0x7fac1c0cd130 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.748+0000 7fac18ff9640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabfc06c8f0 0x7fabfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.748+0000 7fac1b7fe640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabfc06c8f0 0x7fabfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.748+0000 7fac18ff9640 1 -- 172.21.15.120:0/2332306733 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fac0408ad80 con 0x7fac1c0cd130 2024-03-31T16:35:57.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.748+0000 7fac1b7fe640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabfc06c8f0 0x7fabfc06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac0c036000 tx=0x7fac0c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:57.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.752+0000 7fac18ff9640 1 -- 172.21.15.120:0/2332306733 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fac1c161130 con 0x7fac1c0cd130 2024-03-31T16:35:57.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.930+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fac1c0b1dd0 con 0x7fac1c0cd130 2024-03-31T16:35:57.934 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.930+0000 7fac18ff9640 1 -- 172.21.15.120:0/2332306733 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fac04058bf0 con 0x7fac1c0cd130 2024-03-31T16:35:57.935 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:35:57.936 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabfc06c8f0 msgr2=0x7fabfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabfc06c8f0 0x7fabfc06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac0c036000 tx=0x7fac0c008030 comp rx=0 tx=0).stop 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c0cd130 msgr2=0x7fac1c0b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c0cd130 0x7fac1c0b1080 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac0400c7b0 tx=0x7fac0400cc70 comp rx=0 tx=0).stop 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 shutdown_connections 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fabfc06c8f0 0x7fabfc06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac1c146000 0x7fac1c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac1c0cd130 0x7fac1c0b1080 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 --2- 172.21.15.120:0/2332306733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac1c072100 0x7fac1c151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 >> 172.21.15.120:0/2332306733 conn(0x7fac1c06bba0 msgr2=0x7fac1c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 shutdown_connections 2024-03-31T16:35:57.937 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:57.932+0000 7fac21eeb640 1 -- 172.21.15.120:0/2332306733 wait complete. 2024-03-31T16:35:57.947 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:58.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.043+0000 7fc2fa759640 1 Processor -- start 2024-03-31T16:35:58.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.043+0000 7fc2fa759640 1 -- start start 2024-03-31T16:35:58.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2fa759640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc2f40b4a30 0x7fc2f40b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2fa759640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f415ede0 con 0x7fc2f4158580 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2fa759640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f4141d80 con 0x7fc2f40b4650 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2fa759640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f4141b30 con 0x7fc2f40b4a30 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2f8cf6640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc2f4158580 0x7fc2f41589a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53244/0 (socket says 172.21.15.120:53244) 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2f8cf6640 1 -- 172.21.15.120:0/946468321 learned_addr learned my addr 172.21.15.120:0/946468321 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2f37fe640 1 --2- 172.21.15.120:0/946468321 >> v2:172.21.15.203:3300/0 conn(0x7fc2f40b4a30 0x7fc2f40b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2f2ffd640 1 -- 172.21.15.120:0/946468321 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346652373 0 0) 0x7fc2f415ede0 con 0x7fc2f4158580 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2f2ffd640 1 -- 172.21.15.120:0/946468321 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2dc003520 con 0x7fc2f4158580 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2f37fe640 1 -- 172.21.15.120:0/946468321 >> v1:172.21.15.203:6789/0 conn(0x7fc2f40b4650 legacy=0x7fc2f406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2f37fe640 1 -- 172.21.15.120:0/946468321 >> v1:172.21.15.120:6789/0 conn(0x7fc2f4158580 legacy=0x7fc2f41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.044+0000 7fc2f37fe640 1 -- 172.21.15.120:0/946468321 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f4142060 con 0x7fc2f40b4a30 2024-03-31T16:35:58.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.045+0000 7fc2f37fe640 1 --2- 172.21.15.120:0/946468321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f40b4a30 0x7fc2f40b5c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097a0 tx=0x7fc2e802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68bec33365097b13 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.045+0000 7fc2f2ffd640 1 -- 172.21.15.120:0/946468321 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8034070 con 0x7fc2f40b4a30 2024-03-31T16:35:58.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.045+0000 7fc2f2ffd640 1 -- 172.21.15.120:0/946468321 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e8030610 con 0x7fc2f40b4a30 2024-03-31T16:35:58.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.045+0000 7fc2f2ffd640 1 -- 172.21.15.120:0/946468321 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80309c0 con 0x7fc2f40b4a30 2024-03-31T16:35:58.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.046+0000 7fc2fa759640 1 -- 172.21.15.120:0/946468321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f40b4a30 msgr2=0x7fc2f40b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.046+0000 7fc2fa759640 1 --2- 172.21.15.120:0/946468321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f40b4a30 0x7fc2f40b5c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80097a0 tx=0x7fc2e802b960 comp rx=0 tx=0).stop 2024-03-31T16:35:58.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.046+0000 7fc2fa759640 1 -- 172.21.15.120:0/946468321 shutdown_connections 2024-03-31T16:35:58.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.046+0000 7fc2fa759640 1 --2- 172.21.15.120:0/946468321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f40b4a30 0x7fc2f40b5c10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.046+0000 7fc2fa759640 1 -- 172.21.15.120:0/946468321 >> 172.21.15.120:0/946468321 conn(0x7fc2f4067670 msgr2=0x7fc2f4067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:58.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.046+0000 7fc2fa759640 1 -- 172.21.15.120:0/946468321 shutdown_connections 2024-03-31T16:35:58.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.046+0000 7fc2fa759640 1 -- 172.21.15.120:0/946468321 wait complete. 2024-03-31T16:35:58.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.047+0000 7fc2fa759640 1 Processor -- start 2024-03-31T16:35:58.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.047+0000 7fc2fa759640 1 -- start start 2024-03-31T16:35:58.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2fa759640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f40b4650 0x7fc2f4157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2fa759640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2f40b4a30 0x7fc2f40cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2fa759640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f4158580 0x7fc2f40cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2fa759640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4142900 con 0x7fc2f40b4650 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2fa759640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4142620 con 0x7fc2f4158580 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2fa759640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f40b6150 con 0x7fc2f40b4a30 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f40b4650 0x7fc2f4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f40b4650 0x7fc2f4157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37500/0 (socket says 172.21.15.120:37500) 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 -- 172.21.15.120:0/2368599736 learned_addr learned my addr 172.21.15.120:0/2368599736 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f37fe640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2f40b4a30 0x7fc2f40cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f8cf6640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f4158580 0x7fc2f40cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 -- 172.21.15.120:0/2368599736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2f40b4a30 msgr2=0x7fc2f40cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2f40b4a30 0x7fc2f40cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 -- 172.21.15.120:0/2368599736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f4158580 msgr2=0x7fc2f40cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f4158580 0x7fc2f40cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 -- 172.21.15.120:0/2368599736 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f40cb620 con 0x7fc2f40b4650 2024-03-31T16:35:58.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f3fff640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f40b4650 0x7fc2f4157790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c3f0 tx=0x7fc2e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f0ff9640 1 -- 172.21.15.120:0/2368599736 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40052d0 con 0x7fc2f40b4650 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f0ff9640 1 -- 172.21.15.120:0/2368599736 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e4005490 con 0x7fc2f40b4650 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2f0ff9640 1 -- 172.21.15.120:0/2368599736 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4007260 con 0x7fc2f40b4650 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f40cb900 con 0x7fc2f40b4650 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.048+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f40cbec0 con 0x7fc2f40b4650 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.049+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f4074f30 con 0x7fc2f40b4650 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.050+0000 7fc2f0ff9640 1 -- 172.21.15.120:0/2368599736 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2e4007400 con 0x7fc2f40b4650 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.050+0000 7fc2f0ff9640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2e006c8f0 0x7fc2e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.050+0000 7fc2f0ff9640 1 -- 172.21.15.120:0/2368599736 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc2e408aee0 con 0x7fc2f40b4650 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.050+0000 7fc2f37fe640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2e006c8f0 0x7fc2e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.051+0000 7fc2f37fe640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2e006c8f0 0x7fc2e006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8036000 tx=0x7fc2e8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.055+0000 7fc2f0ff9640 1 -- 172.21.15.120:0/2368599736 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc2e4058cc0 con 0x7fc2f40b4650 2024-03-31T16:35:58.235 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.231+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2f40685c0 con 0x7fc2f40b4650 2024-03-31T16:35:58.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.232+0000 7fc2f0ff9640 1 -- 172.21.15.120:0/2368599736 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7fc2e405cfc0 con 0x7fc2f40b4650 2024-03-31T16:35:58.237 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:58.237 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2e006c8f0 msgr2=0x7fc2e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2e006c8f0 0x7fc2e006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8036000 tx=0x7fc2e8008030 comp rx=0 tx=0).stop 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f40b4650 msgr2=0x7fc2f4157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f40b4650 0x7fc2f4157790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c3f0 tx=0x7fc2e400c8b0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 shutdown_connections 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc2e006c8f0 0x7fc2e006edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2f4158580 0x7fc2f40cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2f40b4a30 0x7fc2f40cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.234+0000 7fc2fa759640 1 --2- 172.21.15.120:0/2368599736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc2f40b4650 0x7fc2f4157790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.235+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 >> 172.21.15.120:0/2368599736 conn(0x7fc2f4067670 msgr2=0x7fc2f406ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:58.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.235+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 shutdown_connections 2024-03-31T16:35:58.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.235+0000 7fc2fa759640 1 -- 172.21.15.120:0/2368599736 wait complete. 2024-03-31T16:35:58.250 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:35:58.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:35:58.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.351+0000 7fce9ac06640 1 Processor -- start 2024-03-31T16:35:58.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.351+0000 7fce9ac06640 1 -- start start 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.351+0000 7fce9ac06640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fce94155550 0x7fce94155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.351+0000 7fce9ac06640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fce940d0990 0x7fce940aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.351+0000 7fce9ac06640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce940b40b0 con 0x7fce9415f800 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.351+0000 7fce9ac06640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fce940b4390 con 0x7fce94155550 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.351+0000 7fce9ac06640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fce940b4670 con 0x7fce940d0990 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.352+0000 7fce989a2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fce94155550 0x7fce94155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.352+0000 7fce989a2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fce94155550 0x7fce94155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37508/0 (socket says 172.21.15.120:37508) 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.352+0000 7fce989a2640 1 -- 172.21.15.120:0/1411479421 learned_addr learned my addr 172.21.15.120:0/1411479421 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.352+0000 7fce991a3640 1 --2- 172.21.15.120:0/1411479421 >> v2:172.21.15.203:3300/0 conn(0x7fce940d0990 0x7fce940aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.352+0000 7fce989a2640 1 -- 172.21.15.120:0/1411479421 >> v2:172.21.15.203:3300/0 conn(0x7fce940d0990 msgr2=0x7fce940aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.352+0000 7fce989a2640 1 --2- 172.21.15.120:0/1411479421 >> v2:172.21.15.203:3300/0 conn(0x7fce940d0990 0x7fce940aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.352+0000 7fce989a2640 1 -- 172.21.15.120:0/1411479421 >> v1:172.21.15.203:6789/0 conn(0x7fce9415f800 legacy=0x7fce940d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.352+0000 7fce989a2640 1 -- 172.21.15.120:0/1411479421 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940b4950 con 0x7fce94155550 2024-03-31T16:35:58.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce989a2640 1 --2- 172.21.15.120:0/1411479421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce94155550 0x7fce94155930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce940b3610 tx=0x7fce8802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53914c0f01ed05a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce937fe640 1 -- 172.21.15.120:0/1411479421 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88035020 con 0x7fce94155550 2024-03-31T16:35:58.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce937fe640 1 -- 172.21.15.120:0/1411479421 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce88031870 con 0x7fce94155550 2024-03-31T16:35:58.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce937fe640 1 -- 172.21.15.120:0/1411479421 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88031c40 con 0x7fce94155550 2024-03-31T16:35:58.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce9ac06640 1 -- 172.21.15.120:0/1411479421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce94155550 msgr2=0x7fce94155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce9ac06640 1 --2- 172.21.15.120:0/1411479421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce94155550 0x7fce94155930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce940b3610 tx=0x7fce8802b910 comp rx=0 tx=0).stop 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce9ac06640 1 -- 172.21.15.120:0/1411479421 shutdown_connections 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce9ac06640 1 --2- 172.21.15.120:0/1411479421 >> v2:172.21.15.203:3300/0 conn(0x7fce940d0990 0x7fce940aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce9ac06640 1 --2- 172.21.15.120:0/1411479421 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce94155550 0x7fce94155930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce9ac06640 1 -- 172.21.15.120:0/1411479421 >> 172.21.15.120:0/1411479421 conn(0x7fce9406b750 msgr2=0x7fce9406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce9ac06640 1 -- 172.21.15.120:0/1411479421 shutdown_connections 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.353+0000 7fce9ac06640 1 -- 172.21.15.120:0/1411479421 wait complete. 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.354+0000 7fce9ac06640 1 Processor -- start 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.354+0000 7fce9ac06640 1 -- start start 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce9ac06640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce940d0990 0x7fce9409dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce9ac06640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94155550 0x7fce940b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce9ac06640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9415f800 0x7fce9414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce9ac06640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fce9415ba20 con 0x7fce9415f800 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce9ac06640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce9415fc80 con 0x7fce94155550 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce9ac06640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fce9415bba0 con 0x7fce940d0990 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce991a3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9415f800 0x7fce9414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce991a3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9415f800 0x7fce9414fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37520/0 (socket says 172.21.15.120:37520) 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.355+0000 7fce991a3640 1 -- 172.21.15.120:0/2405848980 learned_addr learned my addr 172.21.15.120:0/2405848980 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce989a2640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce940d0990 0x7fce9409dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce93fff640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94155550 0x7fce940b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce991a3640 1 -- 172.21.15.120:0/2405848980 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce940d0990 msgr2=0x7fce9409dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce991a3640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce940d0990 0x7fce9409dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce991a3640 1 -- 172.21.15.120:0/2405848980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94155550 msgr2=0x7fce940b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce991a3640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94155550 0x7fce940b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce991a3640 1 -- 172.21.15.120:0/2405848980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce941501b0 con 0x7fce9415f800 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce991a3640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9415f800 0x7fce9414fc70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00efc0 tx=0x7fce8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce917fa640 1 -- 172.21.15.120:0/2405848980 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c018020 con 0x7fce9415f800 2024-03-31T16:35:58.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce917fa640 1 -- 172.21.15.120:0/2405848980 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c014480 con 0x7fce9415f800 2024-03-31T16:35:58.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce94150450 con 0x7fce9415f800 2024-03-31T16:35:58.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce917fa640 1 -- 172.21.15.120:0/2405848980 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c014870 con 0x7fce9415f800 2024-03-31T16:35:58.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.356+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce94150a10 con 0x7fce9415f800 2024-03-31T16:35:58.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.357+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce940685c0 con 0x7fce9415f800 2024-03-31T16:35:58.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.358+0000 7fce917fa640 1 -- 172.21.15.120:0/2405848980 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce8c005d10 con 0x7fce9415f800 2024-03-31T16:35:58.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.358+0000 7fce917fa640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fce7806c8f0 0x7fce7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.358+0000 7fce917fa640 1 -- 172.21.15.120:0/2405848980 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fce8c08c470 con 0x7fce9415f800 2024-03-31T16:35:58.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.358+0000 7fce989a2640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fce7806c8f0 0x7fce7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.358+0000 7fce989a2640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fce7806c8f0 0x7fce7806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fce88036000 tx=0x7fce8803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.363+0000 7fce917fa640 1 -- 172.21.15.120:0/2405848980 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fce8c022070 con 0x7fce9415f800 2024-03-31T16:35:58.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.536+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fce940b3ad0 con 0x7fce9415f800 2024-03-31T16:35:58.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.536+0000 7fce917fa640 1 -- 172.21.15.120:0/2405848980 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fce8c010040 con 0x7fce9415f800 2024-03-31T16:35:58.540 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:35:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fce7806c8f0 msgr2=0x7fce7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fce7806c8f0 0x7fce7806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fce88036000 tx=0x7fce8803c040 comp rx=0 tx=0).stop 2024-03-31T16:35:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9415f800 msgr2=0x7fce9414fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9415f800 0x7fce9414fc70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00efc0 tx=0x7fce8c00c490 comp rx=0 tx=0).stop 2024-03-31T16:35:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 shutdown_connections 2024-03-31T16:35:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fce7806c8f0 0x7fce7806edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9415f800 0x7fce9414fc70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94155550 0x7fce940b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.538+0000 7fce9ac06640 1 --2- 172.21.15.120:0/2405848980 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fce940d0990 0x7fce9409dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.539+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 >> 172.21.15.120:0/2405848980 conn(0x7fce9406b750 msgr2=0x7fce94071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.539+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 shutdown_connections 2024-03-31T16:35:58.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.539+0000 7fce9ac06640 1 -- 172.21.15.120:0/2405848980 wait complete. 2024-03-31T16:35:58.552 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:35:58.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.654+0000 7fa0c0759640 1 Processor -- start 2024-03-31T16:35:58.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.654+0000 7fa0c0759640 1 -- start start 2024-03-31T16:35:58.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0c0759640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa0b8155550 0x7fa0b8155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0c0759640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa0b815f800 0x7fa0b80d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0c0759640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b80b40b0 con 0x7fa0b80d07c0 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0c0759640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b80d0bf0 con 0x7fa0b8155550 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0c0759640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b80b4390 con 0x7fa0b815f800 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0be4f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa0b8155550 0x7fa0b8155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0be4f5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa0b8155550 0x7fa0b8155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37524/0 (socket says 172.21.15.120:37524) 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0be4f5640 1 -- 172.21.15.120:0/912775306 learned_addr learned my addr 172.21.15.120:0/912775306 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0bdcf4640 1 --2- 172.21.15.120:0/912775306 >> v2:172.21.15.203:3300/0 conn(0x7fa0b815f800 0x7fa0b80d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0be4f5640 1 -- 172.21.15.120:0/912775306 >> v2:172.21.15.203:3300/0 conn(0x7fa0b815f800 msgr2=0x7fa0b80d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0be4f5640 1 --2- 172.21.15.120:0/912775306 >> v2:172.21.15.203:3300/0 conn(0x7fa0b815f800 0x7fa0b80d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0be4f5640 1 -- 172.21.15.120:0/912775306 >> v1:172.21.15.203:6789/0 conn(0x7fa0b80d07c0 legacy=0x7fa0b80aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.655+0000 7fa0be4f5640 1 -- 172.21.15.120:0/912775306 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b80b4670 con 0x7fa0b8155550 2024-03-31T16:35:58.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.656+0000 7fa0be4f5640 1 --2- 172.21.15.120:0/912775306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b8155930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80d0dd0 tx=0x7fa0b402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc9011223a78779 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.656+0000 7fa0bd4f3640 1 -- 172.21.15.120:0/912775306 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b402ea90 con 0x7fa0b8155550 2024-03-31T16:35:58.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.656+0000 7fa0bd4f3640 1 -- 172.21.15.120:0/912775306 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b402ec30 con 0x7fa0b8155550 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.656+0000 7fa0bd4f3640 1 -- 172.21.15.120:0/912775306 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4009600 con 0x7fa0b8155550 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.657+0000 7fa0c0759640 1 -- 172.21.15.120:0/912775306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 msgr2=0x7fa0b8155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.657+0000 7fa0c0759640 1 --2- 172.21.15.120:0/912775306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b8155930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80d0dd0 tx=0x7fa0b402e0f0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.657+0000 7fa0c0759640 1 -- 172.21.15.120:0/912775306 shutdown_connections 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.657+0000 7fa0c0759640 1 --2- 172.21.15.120:0/912775306 >> v2:172.21.15.203:3300/0 conn(0x7fa0b815f800 0x7fa0b80d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.657+0000 7fa0c0759640 1 --2- 172.21.15.120:0/912775306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b8155930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.657+0000 7fa0c0759640 1 -- 172.21.15.120:0/912775306 >> 172.21.15.120:0/912775306 conn(0x7fa0b806b750 msgr2=0x7fa0b806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.657+0000 7fa0c0759640 1 -- 172.21.15.120:0/912775306 shutdown_connections 2024-03-31T16:35:58.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.657+0000 7fa0c0759640 1 -- 172.21.15.120:0/912775306 wait complete. 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.658+0000 7fa0c0759640 1 Processor -- start 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.658+0000 7fa0c0759640 1 -- start start 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0c0759640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0b80d07c0 0x7fa0b8099a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0c0759640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b81535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0c0759640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0b815f800 0x7fa0b80ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0c0759640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b815fc80 con 0x7fa0b8155550 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0c0759640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b80b4c30 con 0x7fa0b815f800 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0c0759640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b815ba20 con 0x7fa0b80d07c0 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b81535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b81535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37528/0 (socket says 172.21.15.120:37528) 2024-03-31T16:35:58.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 -- 172.21.15.120:0/3539414084 learned_addr learned my addr 172.21.15.120:0/3539414084 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0be4f5640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0b80d07c0 0x7fa0b8099a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0becf6640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0b815f800 0x7fa0b80ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 -- 172.21.15.120:0/3539414084 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0b80d07c0 msgr2=0x7fa0b8099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0b80d07c0 0x7fa0b8099a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 -- 172.21.15.120:0/3539414084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0b815f800 msgr2=0x7fa0b80ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0b815f800 0x7fa0b80ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 -- 172.21.15.120:0/3539414084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b80ce7a0 con 0x7fa0b8155550 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0bdcf4640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b81535a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800e9b0 tx=0x7fa0a800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0aeffd640 1 -- 172.21.15.120:0/3539414084 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8017070 con 0x7fa0b8155550 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0aeffd640 1 -- 172.21.15.120:0/3539414084 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a800c9a0 con 0x7fa0b8155550 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b80cea40 con 0x7fa0b8155550 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0aeffd640 1 -- 172.21.15.120:0/3539414084 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800cd90 con 0x7fa0b8155550 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.659+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b80cf000 con 0x7fa0b8155550 2024-03-31T16:35:58.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.660+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b80685c0 con 0x7fa0b8155550 2024-03-31T16:35:58.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.661+0000 7fa0aeffd640 1 -- 172.21.15.120:0/3539414084 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa0a801a070 con 0x7fa0b8155550 2024-03-31T16:35:58.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.661+0000 7fa0aeffd640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa09c06c8f0 0x7fa09c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.661+0000 7fa0aeffd640 1 -- 172.21.15.120:0/3539414084 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa0a808bab0 con 0x7fa0b8155550 2024-03-31T16:35:58.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.661+0000 7fa0be4f5640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa09c06c8f0 0x7fa09c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.662+0000 7fa0be4f5640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa09c06c8f0 0x7fa09c06edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4037000 tx=0x7fa0b4032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.666+0000 7fa0aeffd640 1 -- 172.21.15.120:0/3539414084 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa0a8059890 con 0x7fa0b8155550 2024-03-31T16:35:58.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.842+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa0b8155330 con 0x7fa0b8155550 2024-03-31T16:35:58.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.842+0000 7fa0aeffd640 1 -- 172.21.15.120:0/3539414084 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fa0a805db90 con 0x7fa0b8155550 2024-03-31T16:35:58.845 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:35:58.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa09c06c8f0 msgr2=0x7fa09c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa09c06c8f0 0x7fa09c06edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4037000 tx=0x7fa0b4032000 comp rx=0 tx=0).stop 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 msgr2=0x7fa0b81535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b81535a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800e9b0 tx=0x7fa0a800ee70 comp rx=0 tx=0).stop 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 shutdown_connections 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa09c06c8f0 0x7fa09c06edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0b815f800 0x7fa0b80ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa0b8155550 0x7fa0b81535a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 --2- 172.21.15.120:0/3539414084 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0b80d07c0 0x7fa0b8099a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 >> 172.21.15.120:0/3539414084 conn(0x7fa0b806b750 msgr2=0x7fa0b806e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 shutdown_connections 2024-03-31T16:35:58.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.844+0000 7fa0c0759640 1 -- 172.21.15.120:0/3539414084 wait complete. 2024-03-31T16:35:58.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:35:58.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.958+0000 7efcbf7b5640 1 Processor -- start 2024-03-31T16:35:58.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.958+0000 7efcbf7b5640 1 -- start start 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbf7b5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efcb815e7b0 0x7efcb80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbf7b5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb80d1ce0 0x7efcb80c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbf7b5640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb806da40 con 0x7efcb80c7640 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbf7b5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7efcb80cfe30 con 0x7efcb815e7b0 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbf7b5640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efcb80c7a70 con 0x7efcb80d1ce0 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbd551640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efcb815e7b0 0x7efcb80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbd551640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efcb815e7b0 0x7efcb80b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37532/0 (socket says 172.21.15.120:37532) 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbd551640 1 -- 172.21.15.120:0/2773015713 learned_addr learned my addr 172.21.15.120:0/2773015713 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbcd50640 1 --2- 172.21.15.120:0/2773015713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb80d1ce0 0x7efcb80c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbd551640 1 -- 172.21.15.120:0/2773015713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb80d1ce0 msgr2=0x7efcb80c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbd551640 1 --2- 172.21.15.120:0/2773015713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb80d1ce0 0x7efcb80c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbd551640 1 -- 172.21.15.120:0/2773015713 >> v1:172.21.15.203:6789/0 conn(0x7efcb80c7640 legacy=0x7efcb8071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.959+0000 7efcbd551640 1 -- 172.21.15.120:0/2773015713 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb80d0080 con 0x7efcb815e7b0 2024-03-31T16:35:58.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.960+0000 7efcbd551640 1 --2- 172.21.15.120:0/2773015713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb815e7b0 0x7efcb80b4980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009e50 tx=0x7efcb402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbafe30dc240325 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.960+0000 7efcaffff640 1 -- 172.21.15.120:0/2773015713 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb402cb00 con 0x7efcb815e7b0 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.960+0000 7efcaffff640 1 -- 172.21.15.120:0/2773015713 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb402cca0 con 0x7efcb815e7b0 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.960+0000 7efcaffff640 1 -- 172.21.15.120:0/2773015713 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4034610 con 0x7efcb815e7b0 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.961+0000 7efcbf7b5640 1 -- 172.21.15.120:0/2773015713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb815e7b0 msgr2=0x7efcb80b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.961+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/2773015713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb815e7b0 0x7efcb80b4980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009e50 tx=0x7efcb402bf60 comp rx=0 tx=0).stop 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.961+0000 7efcbf7b5640 1 -- 172.21.15.120:0/2773015713 shutdown_connections 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.961+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/2773015713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb80d1ce0 0x7efcb80c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.961+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/2773015713 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb815e7b0 0x7efcb80b4980 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.961+0000 7efcbf7b5640 1 -- 172.21.15.120:0/2773015713 >> 172.21.15.120:0/2773015713 conn(0x7efcb80b3e90 msgr2=0x7efcb80b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.961+0000 7efcbf7b5640 1 -- 172.21.15.120:0/2773015713 shutdown_connections 2024-03-31T16:35:58.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.961+0000 7efcbf7b5640 1 -- 172.21.15.120:0/2773015713 wait complete. 2024-03-31T16:35:58.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.962+0000 7efcbf7b5640 1 Processor -- start 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.962+0000 7efcbf7b5640 1 -- start start 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbf7b5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb80c7640 0x7efcb8160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbf7b5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcb80d1ce0 0x7efcb81f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbf7b5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb815e7b0 0x7efcb8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbf7b5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80d0920 con 0x7efcb80c7640 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbf7b5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80d0640 con 0x7efcb80d1ce0 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbf7b5640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efcb80d0c00 con 0x7efcb815e7b0 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb80c7640 0x7efcb8160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb80c7640 0x7efcb8160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37536/0 (socket says 172.21.15.120:37536) 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 -- 172.21.15.120:0/13827269 learned_addr learned my addr 172.21.15.120:0/13827269 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbcd50640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcb80d1ce0 0x7efcb81f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.968 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbdd52640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb815e7b0 0x7efcb8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 -- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb815e7b0 msgr2=0x7efcb8157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb815e7b0 0x7efcb8157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 -- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcb80d1ce0 msgr2=0x7efcb81f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcb80d1ce0 0x7efcb81f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 -- 172.21.15.120:0/13827269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb80b6870 con 0x7efcb80c7640 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbdd52640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb815e7b0 0x7efcb8157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbd551640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb80c7640 0x7efcb8160520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcb4000f80 tx=0x7efcb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcadffb640 1 -- 172.21.15.120:0/13827269 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4043020 con 0x7efcb80c7640 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcadffb640 1 -- 172.21.15.120:0/13827269 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb402ce50 con 0x7efcb80c7640 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb8158950 con 0x7efcb80c7640 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.963+0000 7efcadffb640 1 -- 172.21.15.120:0/13827269 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4009510 con 0x7efcb80c7640 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.964+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb80b6e10 con 0x7efcb80c7640 2024-03-31T16:35:58.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.965+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb8068cd0 con 0x7efcb80c7640 2024-03-31T16:35:58.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.965+0000 7efcadffb640 1 -- 172.21.15.120:0/13827269 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efcb4046020 con 0x7efcb80c7640 2024-03-31T16:35:58.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.965+0000 7efcadffb640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efc9c06c8f0 0x7efc9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:58.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.966+0000 7efcadffb640 1 -- 172.21.15.120:0/13827269 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efcb40ae0a0 con 0x7efcb80c7640 2024-03-31T16:35:58.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.966+0000 7efcbcd50640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efc9c06c8f0 0x7efc9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:58.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.966+0000 7efcbcd50640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efc9c06c8f0 0x7efc9c06edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efcb80cf4d0 tx=0x7efca8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:58.970+0000 7efcadffb640 1 -- 172.21.15.120:0/13827269 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efcb404d030 con 0x7efcb80c7640 2024-03-31T16:35:59.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.146+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efcb80b26a0 con 0x7efcb80c7640 2024-03-31T16:35:59.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.147+0000 7efcadffb640 1 -- 172.21.15.120:0/13827269 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7efcb407c4e0 con 0x7efcb80c7640 2024-03-31T16:35:59.150 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:35:59.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efc9c06c8f0 msgr2=0x7efc9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efc9c06c8f0 0x7efc9c06edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efcb80cf4d0 tx=0x7efca8009190 comp rx=0 tx=0).stop 2024-03-31T16:35:59.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb80c7640 msgr2=0x7efcb8160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb80c7640 0x7efcb8160520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcb4000f80 tx=0x7efcb4004a40 comp rx=0 tx=0).stop 2024-03-31T16:35:59.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 shutdown_connections 2024-03-31T16:35:59.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efc9c06c8f0 0x7efc9c06edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efcb815e7b0 0x7efcb8157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efcb80d1ce0 0x7efcb81f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 --2- 172.21.15.120:0/13827269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efcb80c7640 0x7efcb8160520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 >> 172.21.15.120:0/13827269 conn(0x7efcb80b3e90 msgr2=0x7efcb80b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:59.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 shutdown_connections 2024-03-31T16:35:59.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.149+0000 7efcbf7b5640 1 -- 172.21.15.120:0/13827269 wait complete. 2024-03-31T16:35:59.163 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:35:59.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6d69cd640 1 Processor -- start 2024-03-31T16:35:59.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6d69cd640 1 -- start start 2024-03-31T16:35:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6d69cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6d69cd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff6d00d4ae0 0x7ff6d00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6d69cd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d006dfa0 con 0x7ff6d006da30 2024-03-31T16:35:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6d69cd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d00cf220 con 0x7ff6d00d4ae0 2024-03-31T16:35:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6d69cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d006e240 con 0x7ff6d015e860 2024-03-31T16:35:59.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6d4f6a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff6d00d4ae0 0x7ff6d00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6cf7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff6d006da30 0x7ff6d00d43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53250/0 (socket says 172.21.15.120:53250) 2024-03-31T16:35:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.260+0000 7ff6cf7fe640 1 -- 172.21.15.120:0/3735224588 learned_addr learned my addr 172.21.15.120:0/3735224588 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.261+0000 7ff6cffff640 1 --2- 172.21.15.120:0/3735224588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.261+0000 7ff6d4f6a640 1 -- 172.21.15.120:0/3735224588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 msgr2=0x7ff6d006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.261+0000 7ff6d4f6a640 1 --2- 172.21.15.120:0/3735224588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d006d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.261+0000 7ff6d4f6a640 1 -- 172.21.15.120:0/3735224588 >> v1:172.21.15.120:6789/0 conn(0x7ff6d006da30 legacy=0x7ff6d00d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.261+0000 7ff6d4f6a640 1 -- 172.21.15.120:0/3735224588 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d006e520 con 0x7ff6d00d4ae0 2024-03-31T16:35:59.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.261+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3735224588 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052303840 0 0) 0x7ff6d006dfa0 con 0x7ff6d006da30 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d4f6a640 1 --2- 172.21.15.120:0/3735224588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d00d4ae0 0x7ff6d00cf6b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009d90 tx=0x7ff6c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44baa51f6073e50e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3735224588 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8039070 con 0x7ff6d00d4ae0 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3735224588 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c802cc50 con 0x7ff6d00d4ae0 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3735224588 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8034440 con 0x7ff6d00d4ae0 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d69cd640 1 -- 172.21.15.120:0/3735224588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d00d4ae0 msgr2=0x7ff6d00cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/3735224588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d00d4ae0 0x7ff6d00cf6b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009d90 tx=0x7ff6c802bea0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d69cd640 1 -- 172.21.15.120:0/3735224588 shutdown_connections 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/3735224588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d00d4ae0 0x7ff6d00cf6b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/3735224588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d006d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d69cd640 1 -- 172.21.15.120:0/3735224588 >> 172.21.15.120:0/3735224588 conn(0x7ff6d009d7d0 msgr2=0x7ff6d008bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:59.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d69cd640 1 -- 172.21.15.120:0/3735224588 shutdown_connections 2024-03-31T16:35:59.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.262+0000 7ff6d69cd640 1 -- 172.21.15.120:0/3735224588 wait complete. 2024-03-31T16:35:59.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.263+0000 7ff6d69cd640 1 Processor -- start 2024-03-31T16:35:59.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6d69cd640 1 -- start start 2024-03-31T16:35:59.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6d69cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d006da30 0x7ff6d01f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6d69cd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d00d4ae0 0x7ff6d0157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6d69cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d00cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6d69cd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d00cef30 con 0x7ff6d006da30 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6d69cd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d00cedb0 con 0x7ff6d00d4ae0 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6d69cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d00cfbf0 con 0x7ff6d015e860 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6cffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d006da30 0x7ff6d01f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6cffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d006da30 0x7ff6d01f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37544/0 (socket says 172.21.15.120:37544) 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.264+0000 7ff6cffff640 1 -- 172.21.15.120:0/4289196983 learned_addr learned my addr 172.21.15.120:0/4289196983 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6cf7fe640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d00d4ae0 0x7ff6d0157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6d4f6a640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d00cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6cffff640 1 -- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 msgr2=0x7ff6d00cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6cffff640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d00cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6cffff640 1 -- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d00d4ae0 msgr2=0x7ff6d0157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6cffff640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d00d4ae0 0x7ff6d0157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6cffff640 1 -- 172.21.15.120:0/4289196983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d00cdd30 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6d4f6a640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d00cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6cf7fe640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d00d4ae0 0x7ff6d0157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6cffff640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d006da30 0x7ff6d01f4a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000e870 tx=0x7ff6c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6ccff9640 1 -- 172.21.15.120:0/4289196983 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0017070 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6ccff9640 1 -- 172.21.15.120:0/4289196983 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6c000c940 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d00ccc90 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6ccff9640 1 -- 172.21.15.120:0/4289196983 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000cd30 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.265+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d00cd250 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.266+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d00685c0 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.267+0000 7ff6ccff9640 1 -- 172.21.15.120:0/4289196983 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff6c001a070 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.267+0000 7ff6ccff9640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff6bc06c920 0x7ff6bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.267+0000 7ff6ccff9640 1 -- 172.21.15.120:0/4289196983 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff6c008ba20 con 0x7ff6d006da30 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.267+0000 7ff6cf7fe640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff6bc06c920 0x7ff6bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.268+0000 7ff6cf7fe640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff6bc06c920 0x7ff6bc06ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4007fd0 tx=0x7ff6c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.271+0000 7ff6ccff9640 1 -- 172.21.15.120:0/4289196983 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff6c0059e50 con 0x7ff6d006da30 2024-03-31T16:35:59.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.446+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6d00d1950 con 0x7ff6d006da30 2024-03-31T16:35:59.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.447+0000 7ff6ccff9640 1 -- 172.21.15.120:0/4289196983 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7ff6c0059750 con 0x7ff6d006da30 2024-03-31T16:35:59.451 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:35:59.451 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff6bc06c920 msgr2=0x7ff6bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff6bc06c920 0x7ff6bc06ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4007fd0 tx=0x7ff6c4009040 comp rx=0 tx=0).stop 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d006da30 msgr2=0x7ff6d01f4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d006da30 0x7ff6d01f4a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000e870 tx=0x7ff6c000ed30 comp rx=0 tx=0).stop 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 shutdown_connections 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff6bc06c920 0x7ff6bc06ede0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff6d015e860 0x7ff6d00cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d00d4ae0 0x7ff6d0157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 --2- 172.21.15.120:0/4289196983 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6d006da30 0x7ff6d01f4a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 >> 172.21.15.120:0/4289196983 conn(0x7ff6d009d7d0 msgr2=0x7ff6d00b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.449+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 shutdown_connections 2024-03-31T16:35:59.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.450+0000 7ff6d69cd640 1 -- 172.21.15.120:0/4289196983 wait complete. 2024-03-31T16:35:59.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:35:59.464 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:35:59.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.565+0000 7f5c6131c640 1 Processor -- start 2024-03-31T16:35:59.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.565+0000 7f5c6131c640 1 -- start start 2024-03-31T16:35:59.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c6131c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5c5c15e6d0 0x7f5c5c0d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c6131c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5c5c0d0cb0 0x7f5c5c0d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c6131c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c5c0ceef0 con 0x7f5c5c0d4590 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c6131c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5c5c15eab0 con 0x7f5c5c15e6d0 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c6131c640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5c5c0d1220 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c5affd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5c5c15e6d0 0x7f5c5c0d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c5b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5c5c0d4590 0x7f5c5c1621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53266/0 (socket says 172.21.15.120:53266) 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c5b7fe640 1 -- 172.21.15.120:0/291143928 learned_addr learned my addr 172.21.15.120:0/291143928 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c53fff640 1 --2- 172.21.15.120:0/291143928 >> v2:172.21.15.203:3300/0 conn(0x7f5c5c0d0cb0 0x7f5c5c0d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c5affd640 1 -- 172.21.15.120:0/291143928 >> v2:172.21.15.203:3300/0 conn(0x7f5c5c0d0cb0 msgr2=0x7f5c5c0d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c5affd640 1 --2- 172.21.15.120:0/291143928 >> v2:172.21.15.203:3300/0 conn(0x7f5c5c0d0cb0 0x7f5c5c0d4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c5affd640 1 -- 172.21.15.120:0/291143928 >> v1:172.21.15.120:6789/0 conn(0x7f5c5c0d4590 legacy=0x7f5c5c1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c5affd640 1 -- 172.21.15.120:0/291143928 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c0d1500 con 0x7f5c5c15e6d0 2024-03-31T16:35:59.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.566+0000 7f5c5a7fc640 1 -- 172.21.15.120:0/291143928 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724528874 0 0) 0x7f5c5c0ceef0 con 0x7f5c5c0d4590 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.567+0000 7f5c5affd640 1 --2- 172.21.15.120:0/291143928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c15e6d0 0x7f5c5c0d21e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c09de60 tx=0x7f5c4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c0b9cb8aca32ce server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.567+0000 7f5c5a7fc640 1 -- 172.21.15.120:0/291143928 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c035020 con 0x7f5c5c15e6d0 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.567+0000 7f5c5a7fc640 1 -- 172.21.15.120:0/291143928 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4c031830 con 0x7f5c5c15e6d0 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.567+0000 7f5c5a7fc640 1 -- 172.21.15.120:0/291143928 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c031c00 con 0x7f5c5c15e6d0 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.568+0000 7f5c6131c640 1 -- 172.21.15.120:0/291143928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c15e6d0 msgr2=0x7f5c5c0d21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.568+0000 7f5c6131c640 1 --2- 172.21.15.120:0/291143928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c15e6d0 0x7f5c5c0d21e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c09de60 tx=0x7f5c4c02b8d0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.568+0000 7f5c6131c640 1 -- 172.21.15.120:0/291143928 shutdown_connections 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.568+0000 7f5c6131c640 1 --2- 172.21.15.120:0/291143928 >> v2:172.21.15.203:3300/0 conn(0x7f5c5c0d0cb0 0x7f5c5c0d4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.568+0000 7f5c6131c640 1 --2- 172.21.15.120:0/291143928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c15e6d0 0x7f5c5c0d21e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.568+0000 7f5c6131c640 1 -- 172.21.15.120:0/291143928 >> 172.21.15.120:0/291143928 conn(0x7f5c5c09d7b0 msgr2=0x7f5c5c08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.568+0000 7f5c6131c640 1 -- 172.21.15.120:0/291143928 shutdown_connections 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.568+0000 7f5c6131c640 1 -- 172.21.15.120:0/291143928 wait complete. 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.569+0000 7f5c6131c640 1 Processor -- start 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.569+0000 7f5c6131c640 1 -- start start 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c6131c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c0d0cb0 0x7f5c5c0b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c6131c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c5c0d4590 0x7f5c5c0a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c6131c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c5c15e6d0 0x7f5c5c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c6131c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c0d4a20 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c6131c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c0d1ac0 con 0x7f5c5c0d4590 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c6131c640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5c0d2720 con 0x7f5c5c15e6d0 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c0d0cb0 0x7f5c5c0b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c0d0cb0 0x7f5c5c0b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37568/0 (socket says 172.21.15.120:37568) 2024-03-31T16:35:59.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 -- 172.21.15.120:0/2002606748 learned_addr learned my addr 172.21.15.120:0/2002606748 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c53fff640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c5c0d4590 0x7f5c5c0a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5b7fe640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c5c15e6d0 0x7f5c5c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 -- 172.21.15.120:0/2002606748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c5c15e6d0 msgr2=0x7f5c5c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c5c15e6d0 0x7f5c5c0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 -- 172.21.15.120:0/2002606748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c5c0d4590 msgr2=0x7f5c5c0a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c5c0d4590 0x7f5c5c0a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 -- 172.21.15.120:0/2002606748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c0a2210 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c5affd640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c0d0cb0 0x7f5c5c0b87a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009890 tx=0x7f5c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c537fe640 1 -- 172.21.15.120:0/2002606748 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c041070 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c537fe640 1 -- 172.21.15.120:0/2002606748 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4c03b920 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5c0b8df0 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c537fe640 1 -- 172.21.15.120:0/2002606748 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c035040 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.570+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5c1e7e10 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.571+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5c0685c0 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.572+0000 7f5c537fe640 1 -- 172.21.15.120:0/2002606748 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c4c038020 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.572+0000 7f5c537fe640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5c3c06c8f0 0x7f5c3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.572+0000 7f5c537fe640 1 -- 172.21.15.120:0/2002606748 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5c4c0ad420 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.572+0000 7f5c53fff640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5c3c06c8f0 0x7f5c3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.572+0000 7f5c53fff640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5c3c06c8f0 0x7f5c3c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0d09c0 tx=0x7f5c44009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.576+0000 7f5c537fe640 1 -- 172.21.15.120:0/2002606748 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5c5c0a2210 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.750+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5c5c06d7f0 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.750+0000 7f5c537fe640 1 -- 172.21.15.120:0/2002606748 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5c4c031800 con 0x7f5c5c0d0cb0 2024-03-31T16:35:59.754 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:35:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5c3c06c8f0 msgr2=0x7f5c3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5c3c06c8f0 0x7f5c3c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0d09c0 tx=0x7f5c44009110 comp rx=0 tx=0).stop 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c0d0cb0 msgr2=0x7f5c5c0b87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c0d0cb0 0x7f5c5c0b87a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009890 tx=0x7f5c4c0046c0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 shutdown_connections 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5c3c06c8f0 0x7f5c3c06edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c5c15e6d0 0x7f5c5c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c5c0d4590 0x7f5c5c0a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 --2- 172.21.15.120:0/2002606748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5c5c0d0cb0 0x7f5c5c0b87a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 >> 172.21.15.120:0/2002606748 conn(0x7f5c5c09d7b0 msgr2=0x7f5c5c0cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 shutdown_connections 2024-03-31T16:35:59.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.752+0000 7f5c6131c640 1 -- 172.21.15.120:0/2002606748 wait complete. 2024-03-31T16:35:59.766 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:35:59.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.866+0000 7f215ea7b640 1 Processor -- start 2024-03-31T16:35:59.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.866+0000 7f215ea7b640 1 -- start start 2024-03-31T16:35:59.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f215ea7b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2158155930 0x7f21580d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f215ea7b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f21580d07c0 0x7f21580aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f215ea7b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21580b40b0 con 0x7f2158155550 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f215ea7b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f21580d0c10 con 0x7f2158155930 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f215ea7b640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f21580b4390 con 0x7f21580d07c0 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f215c817640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2158155550 0x7f215815f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53274/0 (socket says 172.21.15.120:53274) 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f215c817640 1 -- 172.21.15.120:0/1811712006 learned_addr learned my addr 172.21.15.120:0/1811712006 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f2157fff640 1 --2- 172.21.15.120:0/1811712006 >> v2:172.21.15.120:3300/0 conn(0x7f2158155930 0x7f21580d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f215d018640 1 --2- 172.21.15.120:0/1811712006 >> v2:172.21.15.203:3300/0 conn(0x7f21580d07c0 0x7f21580aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f21577fe640 1 -- 172.21.15.120:0/1811712006 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2526631604 0 0) 0x7f21580b40b0 con 0x7f2158155550 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f21577fe640 1 -- 172.21.15.120:0/1811712006 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2140003520 con 0x7f2158155550 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f2157fff640 1 -- 172.21.15.120:0/1811712006 >> v2:172.21.15.203:3300/0 conn(0x7f21580d07c0 msgr2=0x7f21580aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:35:59.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f2157fff640 1 --2- 172.21.15.120:0/1811712006 >> v2:172.21.15.203:3300/0 conn(0x7f21580d07c0 0x7f21580aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f2157fff640 1 -- 172.21.15.120:0/1811712006 >> v1:172.21.15.120:6789/0 conn(0x7f2158155550 legacy=0x7f215815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.867+0000 7f2157fff640 1 -- 172.21.15.120:0/1811712006 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21580b4670 con 0x7f2158155930 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.868+0000 7f2157fff640 1 --2- 172.21.15.120:0/1811712006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155930 0x7f21580d0280 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21580b3610 tx=0x7f214c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f302de8eb6d4b0f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.868+0000 7f21577fe640 1 -- 172.21.15.120:0/1811712006 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c0315a0 con 0x7f2158155930 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.868+0000 7f21577fe640 1 -- 172.21.15.120:0/1811712006 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f214c037070 con 0x7f2158155930 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.868+0000 7f21577fe640 1 -- 172.21.15.120:0/1811712006 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c031960 con 0x7f2158155930 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.869+0000 7f215ea7b640 1 -- 172.21.15.120:0/1811712006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155930 msgr2=0x7f21580d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.869+0000 7f215ea7b640 1 --2- 172.21.15.120:0/1811712006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155930 0x7f21580d0280 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f21580b3610 tx=0x7f214c02b840 comp rx=0 tx=0).stop 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.869+0000 7f215ea7b640 1 -- 172.21.15.120:0/1811712006 shutdown_connections 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.869+0000 7f215ea7b640 1 --2- 172.21.15.120:0/1811712006 >> v2:172.21.15.203:3300/0 conn(0x7f21580d07c0 0x7f21580aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.869+0000 7f215ea7b640 1 --2- 172.21.15.120:0/1811712006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155930 0x7f21580d0280 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.869+0000 7f215ea7b640 1 -- 172.21.15.120:0/1811712006 >> 172.21.15.120:0/1811712006 conn(0x7f215806b750 msgr2=0x7f215806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:35:59.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.869+0000 7f215ea7b640 1 -- 172.21.15.120:0/1811712006 shutdown_connections 2024-03-31T16:35:59.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.869+0000 7f215ea7b640 1 -- 172.21.15.120:0/1811712006 wait complete. 2024-03-31T16:35:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.870+0000 7f215ea7b640 1 Processor -- start 2024-03-31T16:35:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.870+0000 7f215ea7b640 1 -- start start 2024-03-31T16:35:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f215ea7b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21580d07c0 0x7f215815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f215ea7b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155550 0x7f21580b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f215ea7b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2158155930 0x7f215809cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f215ea7b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f215815ba20 con 0x7f2158155550 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f215ea7b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21580b4c30 con 0x7f2158155930 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f215ea7b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f215815bba0 con 0x7f21580d07c0 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f2157fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155550 0x7f21580b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f2157fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155550 0x7f21580b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37584/0 (socket says 172.21.15.120:37584) 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f2157fff640 1 -- 172.21.15.120:0/3713005070 learned_addr learned my addr 172.21.15.120:0/3713005070 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f215c817640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21580d07c0 0x7f215815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f215d018640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2158155930 0x7f215809cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f2157fff640 1 -- 172.21.15.120:0/3713005070 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21580d07c0 msgr2=0x7f215815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f2157fff640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21580d07c0 0x7f215815a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f2157fff640 1 -- 172.21.15.120:0/3713005070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2158155930 msgr2=0x7f215809cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:35:59.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f2157fff640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2158155930 0x7f215809cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.871+0000 7f2157fff640 1 -- 172.21.15.120:0/3713005070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215809bf90 con 0x7f2158155550 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.872+0000 7f2157fff640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155550 0x7f21580b1620 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f214c009890 tx=0x7f214c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.872+0000 7f21557fa640 1 -- 172.21.15.120:0/3713005070 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c032630 con 0x7f2158155550 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.872+0000 7f21557fa640 1 -- 172.21.15.120:0/3713005070 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f214c0327f0 con 0x7f2158155550 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.872+0000 7f21557fa640 1 -- 172.21.15.120:0/3713005070 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c032be0 con 0x7f2158155550 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.872+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215809c270 con 0x7f2158155550 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.872+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215809c830 con 0x7f2158155550 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.873+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21580685c0 con 0x7f2158155550 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.873+0000 7f21557fa640 1 -- 172.21.15.120:0/3713005070 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f214c04c020 con 0x7f2158155550 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.874+0000 7f21557fa640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f214406c8f0 0x7f214406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.874+0000 7f215c817640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f214406c8f0 0x7f214406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:35:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.874+0000 7f21557fa640 1 -- 172.21.15.120:0/3713005070 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f214c02f020 con 0x7f2158155550 2024-03-31T16:35:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.874+0000 7f215c817640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f214406c8f0 0x7f214406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2148005880 tx=0x7f2148009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:35:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:35:59.878+0000 7f21557fa640 1 -- 172.21.15.120:0/3713005070 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f214c040070 con 0x7f2158155550 2024-03-31T16:36:00.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.051+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f21580b3ad0 con 0x7f2158155550 2024-03-31T16:36:00.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.052+0000 7f21557fa640 1 -- 172.21.15.120:0/3713005070 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f214c07b3f0 con 0x7f2158155550 2024-03-31T16:36:00.055 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:36:00.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f214406c8f0 msgr2=0x7f214406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f214406c8f0 0x7f214406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2148005880 tx=0x7f2148009040 comp rx=0 tx=0).stop 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155550 msgr2=0x7f21580b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155550 0x7f21580b1620 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f214c009890 tx=0x7f214c0046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 shutdown_connections 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f214406c8f0 0x7f214406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2158155930 0x7f215809cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158155550 0x7f21580b1620 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 --2- 172.21.15.120:0/3713005070 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21580d07c0 0x7f215815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 >> 172.21.15.120:0/3713005070 conn(0x7f215806b750 msgr2=0x7f21580b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 shutdown_connections 2024-03-31T16:36:00.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.054+0000 7f215ea7b640 1 -- 172.21.15.120:0/3713005070 wait complete. 2024-03-31T16:36:00.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:36:00.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.170+0000 7f27eeed6640 1 Processor -- start 2024-03-31T16:36:00.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.170+0000 7f27eeed6640 1 -- start start 2024-03-31T16:36:00.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.170+0000 7f27eeed6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e8155550 0x7f27e8155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.170+0000 7f27eeed6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f27e80d0990 0x7f27e80aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.170+0000 7f27eeed6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e80b40b0 con 0x7f27e815f800 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.170+0000 7f27eeed6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f27e80b4390 con 0x7f27e80d0990 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.170+0000 7f27eeed6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f27e80b4670 con 0x7f27e8155550 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.171+0000 7f27ed473640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f27e80d0990 0x7f27e80aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.171+0000 7f27ed473640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f27e80d0990 0x7f27e80aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37596/0 (socket says 172.21.15.120:37596) 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.171+0000 7f27ed473640 1 -- 172.21.15.120:0/2017964447 learned_addr learned my addr 172.21.15.120:0/2017964447 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.171+0000 7f27ecc72640 1 --2- 172.21.15.120:0/2017964447 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e8155550 0x7f27e8155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.171+0000 7f27ed473640 1 -- 172.21.15.120:0/2017964447 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e8155550 msgr2=0x7f27e8155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.171+0000 7f27ed473640 1 --2- 172.21.15.120:0/2017964447 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e8155550 0x7f27e8155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.171+0000 7f27ed473640 1 -- 172.21.15.120:0/2017964447 >> v1:172.21.15.203:6789/0 conn(0x7f27e815f800 legacy=0x7f27e80d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.171+0000 7f27ed473640 1 -- 172.21.15.120:0/2017964447 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e80b4950 con 0x7f27e80d0990 2024-03-31T16:36:00.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27ed473640 1 --2- 172.21.15.120:0/2017964447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e80d0990 0x7f27e80aede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009e50 tx=0x7f27e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e78a1fe49eb49c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27e77fe640 1 -- 172.21.15.120:0/2017964447 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e002ca70 con 0x7f27e80d0990 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27e77fe640 1 -- 172.21.15.120:0/2017964447 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e002cc10 con 0x7f27e80d0990 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27e77fe640 1 -- 172.21.15.120:0/2017964447 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e00343f0 con 0x7f27e80d0990 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27eeed6640 1 -- 172.21.15.120:0/2017964447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e80d0990 msgr2=0x7f27e80aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27eeed6640 1 --2- 172.21.15.120:0/2017964447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e80d0990 0x7f27e80aede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009e50 tx=0x7f27e002bed0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27eeed6640 1 -- 172.21.15.120:0/2017964447 shutdown_connections 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27eeed6640 1 --2- 172.21.15.120:0/2017964447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e80d0990 0x7f27e80aede0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27eeed6640 1 --2- 172.21.15.120:0/2017964447 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e8155550 0x7f27e8155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27eeed6640 1 -- 172.21.15.120:0/2017964447 >> 172.21.15.120:0/2017964447 conn(0x7f27e806b750 msgr2=0x7f27e806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27eeed6640 1 -- 172.21.15.120:0/2017964447 shutdown_connections 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.172+0000 7f27eeed6640 1 -- 172.21.15.120:0/2017964447 wait complete. 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.173+0000 7f27eeed6640 1 Processor -- start 2024-03-31T16:36:00.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.174+0000 7f27eeed6640 1 -- start start 2024-03-31T16:36:00.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.174+0000 7f27eeed6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e80d0990 0x7f27e8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.174+0000 7f27eeed6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e8155550 0x7f27e815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.174+0000 7f27eeed6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27e815f800 0x7f27e815d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.174+0000 7f27eeed6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f27e815ba20 con 0x7f27e8155550 2024-03-31T16:36:00.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.174+0000 7f27eeed6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f27e815fc80 con 0x7f27e815f800 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.174+0000 7f27eeed6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f27e815bba0 con 0x7f27e80d0990 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.174+0000 7f27e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e8155550 0x7f27e815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e8155550 0x7f27e815cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37604/0 (socket says 172.21.15.120:37604) 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e7fff640 1 -- 172.21.15.120:0/1904261984 learned_addr learned my addr 172.21.15.120:0/1904261984 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27ecc72640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e80d0990 0x7f27e8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27ed473640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27e815f800 0x7f27e815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e7fff640 1 -- 172.21.15.120:0/1904261984 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e80d0990 msgr2=0x7f27e8153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e7fff640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e80d0990 0x7f27e8153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e7fff640 1 -- 172.21.15.120:0/1904261984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27e815f800 msgr2=0x7f27e815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e7fff640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27e815f800 0x7f27e815d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e7fff640 1 -- 172.21.15.120:0/1904261984 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e80af5b0 con 0x7f27e8155550 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e7fff640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e8155550 0x7f27e815cb10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f27d4001e90 tx=0x7f27d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e57fa640 1 -- 172.21.15.120:0/1904261984 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d40052d0 con 0x7f27e8155550 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e57fa640 1 -- 172.21.15.120:0/1904261984 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d4005490 con 0x7f27e8155550 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e80af890 con 0x7f27e8155550 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27e57fa640 1 -- 172.21.15.120:0/1904261984 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d40108e0 con 0x7f27e8155550 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.175+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e80afe50 con 0x7f27e8155550 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.176+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e80685c0 con 0x7f27e8155550 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.176+0000 7f27e57fa640 1 -- 172.21.15.120:0/1904261984 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27d4010a80 con 0x7f27e8155550 2024-03-31T16:36:00.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.177+0000 7f27e57fa640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f27cc06c8f0 0x7f27cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.177+0000 7f27e57fa640 1 -- 172.21.15.120:0/1904261984 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f27d408d8d0 con 0x7f27e8155550 2024-03-31T16:36:00.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.177+0000 7f27ecc72640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f27cc06c8f0 0x7f27cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.177+0000 7f27ecc72640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f27cc06c8f0 0x7f27cc06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009b40 tx=0x7f27dc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.181+0000 7f27e57fa640 1 -- 172.21.15.120:0/1904261984 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f27d405b740 con 0x7f27e8155550 2024-03-31T16:36:00.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.354+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f27e80cf590 con 0x7f27e8155550 2024-03-31T16:36:00.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.355+0000 7f27e57fa640 1 -- 172.21.15.120:0/1904261984 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f27d405fa40 con 0x7f27e8155550 2024-03-31T16:36:00.358 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:36:00.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f27cc06c8f0 msgr2=0x7f27cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f27cc06c8f0 0x7f27cc06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009b40 tx=0x7f27dc009190 comp rx=0 tx=0).stop 2024-03-31T16:36:00.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e8155550 msgr2=0x7f27e815cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e8155550 0x7f27e815cb10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f27d4001e90 tx=0x7f27d400c8c0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 shutdown_connections 2024-03-31T16:36:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f27cc06c8f0 0x7f27cc06edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f27e815f800 0x7f27e815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27e8155550 0x7f27e815cb10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 --2- 172.21.15.120:0/1904261984 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f27e80d0990 0x7f27e8153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 >> 172.21.15.120:0/1904261984 conn(0x7f27e806b750 msgr2=0x7f27e80726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 shutdown_connections 2024-03-31T16:36:00.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.357+0000 7f27eeed6640 1 -- 172.21.15.120:0/1904261984 wait complete. 2024-03-31T16:36:00.414 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-31T16:36:00.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:00.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.511+0000 7f2e9b967640 1 Processor -- start 2024-03-31T16:36:00.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.512+0000 7f2e9b967640 1 -- start start 2024-03-31T16:36:00.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.512+0000 7f2e9b967640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e9406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.512+0000 7f2e9b967640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2e9406da30 0x7f2e940d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.512+0000 7f2e9b967640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2e940d4910 0x7f2e940d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.512+0000 7f2e9b967640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f2e940d4d60 con 0x7f2e940d4910 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e9b967640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2e940cf220 con 0x7f2e9406da30 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e9b967640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9406dfa0 con 0x7f2e9415e860 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99f04640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2e940d4910 0x7f2e940d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99703640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e9406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99f04640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2e940d4910 0x7f2e940d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37606/0 (socket says 172.21.15.120:37606) 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99f04640 1 -- 172.21.15.120:0/2430998731 learned_addr learned my addr 172.21.15.120:0/2430998731 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e98f02640 1 --2- 172.21.15.120:0/2430998731 >> v2:172.21.15.203:3300/0 conn(0x7f2e9406da30 0x7f2e940d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99703640 1 -- 172.21.15.120:0/2430998731 >> v2:172.21.15.203:3300/0 conn(0x7f2e9406da30 msgr2=0x7f2e940d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99703640 1 --2- 172.21.15.120:0/2430998731 >> v2:172.21.15.203:3300/0 conn(0x7f2e9406da30 0x7f2e940d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99703640 1 -- 172.21.15.120:0/2430998731 >> v2:172.21.15.120:3300/0 conn(0x7f2e940d4910 msgr2=0x7f2e940d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99703640 1 --2- 172.21.15.120:0/2430998731 >> v2:172.21.15.120:3300/0 conn(0x7f2e940d4910 0x7f2e940d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99703640 1 -- 172.21.15.120:0/2430998731 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9406e240 con 0x7f2e9415e860 2024-03-31T16:36:00.517 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.513+0000 7f2e99f04640 1 --2- 172.21.15.120:0/2430998731 >> v2:172.21.15.120:3300/0 conn(0x7f2e940d4910 0x7f2e940d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.514+0000 7f2e99703640 1 --2- 172.21.15.120:0/2430998731 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e9406d4f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e9408e770 tx=0x7f2e8c02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0687cd296172233 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.514+0000 7f2e8bfff640 1 -- 172.21.15.120:0/2430998731 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c039070 con 0x7f2e9415e860 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.514+0000 7f2e8bfff640 1 -- 172.21.15.120:0/2430998731 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c02cbd0 con 0x7f2e9415e860 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.514+0000 7f2e8bfff640 1 -- 172.21.15.120:0/2430998731 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c034440 con 0x7f2e9415e860 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.514+0000 7f2e9b967640 1 -- 172.21.15.120:0/2430998731 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 msgr2=0x7f2e9406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.514+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2430998731 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e9406d4f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e9408e770 tx=0x7f2e8c02be20 comp rx=0 tx=0).stop 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.515+0000 7f2e9b967640 1 -- 172.21.15.120:0/2430998731 shutdown_connections 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.515+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2430998731 >> v2:172.21.15.120:3300/0 conn(0x7f2e940d4910 0x7f2e940d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.515+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2430998731 >> v2:172.21.15.203:3300/0 conn(0x7f2e9406da30 0x7f2e940d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.515+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2430998731 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e9406d4f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.515+0000 7f2e9b967640 1 -- 172.21.15.120:0/2430998731 >> 172.21.15.120:0/2430998731 conn(0x7f2e9409d7d0 msgr2=0x7f2e9408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.515+0000 7f2e9b967640 1 -- 172.21.15.120:0/2430998731 shutdown_connections 2024-03-31T16:36:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.515+0000 7f2e9b967640 1 -- 172.21.15.120:0/2430998731 wait complete. 2024-03-31T16:36:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.516+0000 7f2e9b967640 1 Processor -- start 2024-03-31T16:36:00.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.516+0000 7f2e9b967640 1 -- start start 2024-03-31T16:36:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.516+0000 7f2e9b967640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9406da30 0x7f2e94152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.516+0000 7f2e9b967640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e940d4910 0x7f2e940cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.516+0000 7f2e9b967640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e940c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.516+0000 7f2e9b967640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940cedb0 con 0x7f2e9406da30 2024-03-31T16:36:00.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.516+0000 7f2e9b967640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940d2c50 con 0x7f2e940d4910 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.516+0000 7f2e9b967640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940cef30 con 0x7f2e9415e860 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9406da30 0x7f2e94152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9406da30 0x7f2e94152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37612/0 (socket says 172.21.15.120:37612) 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 -- 172.21.15.120:0/2943235050 learned_addr learned my addr 172.21.15.120:0/2943235050 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99f04640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e940c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e98f02640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e940d4910 0x7f2e940cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 -- 172.21.15.120:0/2943235050 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 msgr2=0x7f2e940c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e940c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 -- 172.21.15.120:0/2943235050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e940d4910 msgr2=0x7f2e940cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e940d4910 0x7f2e940cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 -- 172.21.15.120:0/2943235050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e941531a0 con 0x7f2e9406da30 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e99703640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9406da30 0x7f2e94152c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009e80 tx=0x7f2e8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e89ffb640 1 -- 172.21.15.120:0/2943235050 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c039050 con 0x7f2e9406da30 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e89ffb640 1 -- 172.21.15.120:0/2943235050 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c045070 con 0x7f2e9406da30 2024-03-31T16:36:00.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e89ffb640 1 -- 172.21.15.120:0/2943235050 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c009450 con 0x7f2e9406da30 2024-03-31T16:36:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e94160180 con 0x7f2e9406da30 2024-03-31T16:36:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.517+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e94160740 con 0x7f2e9406da30 2024-03-31T16:36:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.518+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e940685c0 con 0x7f2e9406da30 2024-03-31T16:36:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.519+0000 7f2e89ffb640 1 -- 172.21.15.120:0/2943235050 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e8c03e850 con 0x7f2e9406da30 2024-03-31T16:36:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.519+0000 7f2e89ffb640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2e7806c8f0 0x7f2e7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.519+0000 7f2e89ffb640 1 -- 172.21.15.120:0/2943235050 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2e8c0ae7f0 con 0x7f2e9406da30 2024-03-31T16:36:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.519+0000 7f2e98f02640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2e7806c8f0 0x7f2e7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.520+0000 7f2e98f02640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2e7806c8f0 0x7f2e7806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e940d1230 tx=0x7f2e84009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.523+0000 7f2e89ffb640 1 -- 172.21.15.120:0/2943235050 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2e8c07c7b0 con 0x7f2e9406da30 2024-03-31T16:36:00.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.697+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e940b4a70 con 0x7f2e9406da30 2024-03-31T16:36:00.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.698+0000 7f2e89ffb640 1 -- 172.21.15.120:0/2943235050 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f2e8c080ab0 con 0x7f2e9406da30 2024-03-31T16:36:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:00.702 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:00.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2e7806c8f0 msgr2=0x7f2e7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2e7806c8f0 0x7f2e7806edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e940d1230 tx=0x7f2e84009190 comp rx=0 tx=0).stop 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9406da30 msgr2=0x7f2e94152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9406da30 0x7f2e94152c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009e80 tx=0x7f2e8c004a40 comp rx=0 tx=0).stop 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 shutdown_connections 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2e7806c8f0 0x7f2e7806edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e9415e860 0x7f2e940c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e940d4910 0x7f2e940cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 --2- 172.21.15.120:0/2943235050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2e9406da30 0x7f2e94152c60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 >> 172.21.15.120:0/2943235050 conn(0x7f2e9409d7d0 msgr2=0x7f2e940b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 shutdown_connections 2024-03-31T16:36:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.700+0000 7f2e9b967640 1 -- 172.21.15.120:0/2943235050 wait complete. 2024-03-31T16:36:00.714 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:36:00.715 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:36:00.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.814+0000 7fa317382640 1 Processor -- start 2024-03-31T16:36:00.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.815+0000 7fa317382640 1 -- start start 2024-03-31T16:36:00.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.815+0000 7fa317382640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa310155550 0x7fa310155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.815+0000 7fa317382640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3100b40b0 con 0x7fa3100d0990 2024-03-31T16:36:00.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.815+0000 7fa317382640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3100b4390 con 0x7fa31015f800 2024-03-31T16:36:00.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.815+0000 7fa317382640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa3100b4670 con 0x7fa310155550 2024-03-31T16:36:00.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.815+0000 7fa31591f640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa3100d0990 0x7fa3100aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53282/0 (socket says 172.21.15.120:53282) 2024-03-31T16:36:00.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa31591f640 1 -- 172.21.15.120:0/2579358131 learned_addr learned my addr 172.21.15.120:0/2579358131 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:00.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa31511e640 1 --2- 172.21.15.120:0/2579358131 >> v2:172.21.15.203:3300/0 conn(0x7fa310155550 0x7fa310155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa307fff640 1 -- 172.21.15.120:0/2579358131 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969945865 0 0) 0x7fa3100b40b0 con 0x7fa3100d0990 2024-03-31T16:36:00.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa307fff640 1 -- 172.21.15.120:0/2579358131 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2fc003520 con 0x7fa3100d0990 2024-03-31T16:36:00.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa307fff640 1 -- 172.21.15.120:0/2579358131 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483655010 0 0) 0x7fa3100b4390 con 0x7fa31015f800 2024-03-31T16:36:00.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa307fff640 1 -- 172.21.15.120:0/2579358131 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3100b40b0 con 0x7fa31015f800 2024-03-31T16:36:00.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa31511e640 1 -- 172.21.15.120:0/2579358131 >> v1:172.21.15.203:6789/0 conn(0x7fa31015f800 legacy=0x7fa3100d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa31511e640 1 -- 172.21.15.120:0/2579358131 >> v1:172.21.15.120:6789/0 conn(0x7fa3100d0990 legacy=0x7fa3100aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.816+0000 7fa31511e640 1 -- 172.21.15.120:0/2579358131 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3100b4950 con 0x7fa310155550 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa31511e640 1 --2- 172.21.15.120:0/2579358131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 0x7fa310155930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009d90 tx=0x7fa30c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc3a98c7a521f434 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa307fff640 1 -- 172.21.15.120:0/2579358131 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c039070 con 0x7fa310155550 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa307fff640 1 -- 172.21.15.120:0/2579358131 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c02cc60 con 0x7fa310155550 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa307fff640 1 -- 172.21.15.120:0/2579358131 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c034640 con 0x7fa310155550 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa317382640 1 -- 172.21.15.120:0/2579358131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 msgr2=0x7fa310155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa317382640 1 --2- 172.21.15.120:0/2579358131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 0x7fa310155930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009d90 tx=0x7fa30c02beb0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa317382640 1 -- 172.21.15.120:0/2579358131 shutdown_connections 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa317382640 1 --2- 172.21.15.120:0/2579358131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 0x7fa310155930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa317382640 1 -- 172.21.15.120:0/2579358131 >> 172.21.15.120:0/2579358131 conn(0x7fa31006b750 msgr2=0x7fa31006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa317382640 1 -- 172.21.15.120:0/2579358131 shutdown_connections 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.817+0000 7fa317382640 1 -- 172.21.15.120:0/2579358131 wait complete. 2024-03-31T16:36:00.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa317382640 1 Processor -- start 2024-03-31T16:36:00.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa317382640 1 -- start start 2024-03-31T16:36:00.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa317382640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100d0990 0x7fa310099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa317382640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 0x7fa3100afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa317382640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa31015f800 0x7fa3101541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa317382640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa31015ba20 con 0x7fa3100d0990 2024-03-31T16:36:00.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa317382640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa31015fc80 con 0x7fa310155550 2024-03-31T16:36:00.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa317382640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa31015bba0 con 0x7fa31015f800 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa31511e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100d0990 0x7fa310099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa31511e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100d0990 0x7fa310099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37624/0 (socket says 172.21.15.120:37624) 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa31511e640 1 -- 172.21.15.120:0/781292695 learned_addr learned my addr 172.21.15.120:0/781292695 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa31591f640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa31015f800 0x7fa3101541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.819+0000 7fa31491d640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 0x7fa3100afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa31511e640 1 -- 172.21.15.120:0/781292695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa31015f800 msgr2=0x7fa3101541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa31511e640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa31015f800 0x7fa3101541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa31511e640 1 -- 172.21.15.120:0/781292695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 msgr2=0x7fa3100afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa31511e640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 0x7fa3100afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa31511e640 1 -- 172.21.15.120:0/781292695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31014f5a0 con 0x7fa3100d0990 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa31511e640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100d0990 0x7fa310099970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa30c000f80 tx=0x7fa30c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa305ffb640 1 -- 172.21.15.120:0/781292695 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c039050 con 0x7fa3100d0990 2024-03-31T16:36:00.826 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa305ffb640 1 -- 172.21.15.120:0/781292695 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa30c045070 con 0x7fa3100d0990 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa310099eb0 con 0x7fa3100d0990 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa305ffb640 1 -- 172.21.15.120:0/781292695 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c009450 con 0x7fa3100d0990 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.820+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3100b07e0 con 0x7fa3100d0990 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.821+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3100685c0 con 0x7fa3100d0990 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.822+0000 7fa305ffb640 1 -- 172.21.15.120:0/781292695 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa30c03e850 con 0x7fa3100d0990 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.822+0000 7fa305ffb640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa2f406c8f0 0x7fa2f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.822+0000 7fa31491d640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa2f406c8f0 0x7fa2f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.822+0000 7fa305ffb640 1 -- 172.21.15.120:0/781292695 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa30c0ae680 con 0x7fa3100d0990 2024-03-31T16:36:00.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.823+0000 7fa31491d640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa2f406c8f0 0x7fa2f406edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa300007fd0 tx=0x7fa300009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:00.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.827+0000 7fa305ffb640 1 -- 172.21.15.120:0/781292695 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa310099eb0 con 0x7fa3100d0990 2024-03-31T16:36:01.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:00.999+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa3100b3ad0 con 0x7fa3100d0990 2024-03-31T16:36:01.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.000+0000 7fa305ffb640 1 -- 172.21.15.120:0/781292695 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fa30c07c4f0 con 0x7fa3100d0990 2024-03-31T16:36:01.003 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:36:01.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa2f406c8f0 msgr2=0x7fa2f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa2f406c8f0 0x7fa2f406edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa300007fd0 tx=0x7fa300009040 comp rx=0 tx=0).stop 2024-03-31T16:36:01.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100d0990 msgr2=0x7fa310099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100d0990 0x7fa310099970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa30c000f80 tx=0x7fa30c004a40 comp rx=0 tx=0).stop 2024-03-31T16:36:01.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 shutdown_connections 2024-03-31T16:36:01.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa2f406c8f0 0x7fa2f406edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa31015f800 0x7fa3101541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa310155550 0x7fa3100afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 --2- 172.21.15.120:0/781292695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa3100d0990 0x7fa310099970 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 >> 172.21.15.120:0/781292695 conn(0x7fa31006b750 msgr2=0x7fa310071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:01.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 shutdown_connections 2024-03-31T16:36:01.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.002+0000 7fa317382640 1 -- 172.21.15.120:0/781292695 wait complete. 2024-03-31T16:36:01.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:36:01.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.116+0000 7f0b1380d640 1 Processor -- start 2024-03-31T16:36:01.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.116+0000 7f0b1380d640 1 -- start start 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b1380d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0b0c15e860 0x7f0b0c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b1380d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0c06dfa0 con 0x7f0b0c06da30 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b1380d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0c06e240 con 0x7f0b0c0d4ae0 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b1380d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0b0c0cf220 con 0x7f0b0c15e860 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b10da8640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0b0c06da30 0x7f0b0c0d43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53286/0 (socket says 172.21.15.120:53286) 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b10da8640 1 -- 172.21.15.120:0/1809803075 learned_addr learned my addr 172.21.15.120:0/1809803075 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b115a9640 1 --2- 172.21.15.120:0/1809803075 >> v2:172.21.15.203:3300/0 conn(0x7f0b0c15e860 0x7f0b0c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b03fff640 1 -- 172.21.15.120:0/1809803075 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797567224 0 0) 0x7f0b0c06dfa0 con 0x7f0b0c06da30 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.117+0000 7f0b03fff640 1 -- 172.21.15.120:0/1809803075 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0af8003520 con 0x7f0b0c06da30 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.118+0000 7f0b03fff640 1 -- 172.21.15.120:0/1809803075 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085776384 0 0) 0x7f0b0c06e240 con 0x7f0b0c0d4ae0 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.118+0000 7f0b03fff640 1 -- 172.21.15.120:0/1809803075 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b0c06dfa0 con 0x7f0b0c0d4ae0 2024-03-31T16:36:01.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.118+0000 7f0b115a9640 1 -- 172.21.15.120:0/1809803075 >> v1:172.21.15.203:6789/0 conn(0x7f0b0c0d4ae0 legacy=0x7f0b0c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.118+0000 7f0b115a9640 1 -- 172.21.15.120:0/1809803075 >> v1:172.21.15.120:6789/0 conn(0x7f0b0c06da30 legacy=0x7f0b0c0d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.118+0000 7f0b115a9640 1 -- 172.21.15.120:0/1809803075 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c06e520 con 0x7f0b0c15e860 2024-03-31T16:36:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.118+0000 7f0b115a9640 1 --2- 172.21.15.120:0/1809803075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c15e860 0x7f0b0c06d4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009d90 tx=0x7f0b0802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cceed15f7238c08 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b03fff640 1 -- 172.21.15.120:0/1809803075 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b08039070 con 0x7f0b0c15e860 2024-03-31T16:36:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b03fff640 1 -- 172.21.15.120:0/1809803075 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0802cd00 con 0x7f0b0c15e860 2024-03-31T16:36:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b03fff640 1 -- 172.21.15.120:0/1809803075 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b08034660 con 0x7f0b0c15e860 2024-03-31T16:36:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b1380d640 1 -- 172.21.15.120:0/1809803075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c15e860 msgr2=0x7f0b0c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b1380d640 1 --2- 172.21.15.120:0/1809803075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c15e860 0x7f0b0c06d4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009d90 tx=0x7f0b0802bf50 comp rx=0 tx=0).stop 2024-03-31T16:36:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b1380d640 1 -- 172.21.15.120:0/1809803075 shutdown_connections 2024-03-31T16:36:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b1380d640 1 --2- 172.21.15.120:0/1809803075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c15e860 0x7f0b0c06d4f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b1380d640 1 -- 172.21.15.120:0/1809803075 >> 172.21.15.120:0/1809803075 conn(0x7f0b0c09d7d0 msgr2=0x7f0b0c08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b1380d640 1 -- 172.21.15.120:0/1809803075 shutdown_connections 2024-03-31T16:36:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.119+0000 7f0b1380d640 1 -- 172.21.15.120:0/1809803075 wait complete. 2024-03-31T16:36:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.120+0000 7f0b1380d640 1 Processor -- start 2024-03-31T16:36:01.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.120+0000 7f0b1380d640 1 -- start start 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b1380d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c06da30 0x7f0b0c0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b1380d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b0c0d4ae0 0x7f0b0c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b1380d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b0c15e860 0x7f0b0c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b1380d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0cef30 con 0x7f0b0c15e860 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b1380d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0cedb0 con 0x7f0b0c06da30 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b1380d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0c0cfdc0 con 0x7f0b0c0d4ae0 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b11daa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b0c15e860 0x7f0b0c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b11daa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b0c15e860 0x7f0b0c15c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37636/0 (socket says 172.21.15.120:37636) 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b11daa640 1 -- 172.21.15.120:0/2707669905 learned_addr learned my addr 172.21.15.120:0/2707669905 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b115a9640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c06da30 0x7f0b0c0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b10da8640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b0c0d4ae0 0x7f0b0c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b11daa640 1 -- 172.21.15.120:0/2707669905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b0c0d4ae0 msgr2=0x7f0b0c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b11daa640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b0c0d4ae0 0x7f0b0c0b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b11daa640 1 -- 172.21.15.120:0/2707669905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c06da30 msgr2=0x7f0b0c0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b11daa640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c06da30 0x7f0b0c0cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.121+0000 7f0b11daa640 1 -- 172.21.15.120:0/2707669905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c0cdd70 con 0x7f0b0c15e860 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.122+0000 7f0b11daa640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b0c15e860 0x7f0b0c15c400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400c400 tx=0x7f0b0400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.122+0000 7f0b01ffb640 1 -- 172.21.15.120:0/2707669905 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04017070 con 0x7f0b0c15e860 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.122+0000 7f0b01ffb640 1 -- 172.21.15.120:0/2707669905 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b040052d0 con 0x7f0b0c15e860 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.122+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0c0ce050 con 0x7f0b0c15e860 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.122+0000 7f0b01ffb640 1 -- 172.21.15.120:0/2707669905 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b040037f0 con 0x7f0b0c15e860 2024-03-31T16:36:01.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.122+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0c15ec40 con 0x7f0b0c15e860 2024-03-31T16:36:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.123+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0c0685c0 con 0x7f0b0c15e860 2024-03-31T16:36:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.123+0000 7f0b01ffb640 1 -- 172.21.15.120:0/2707669905 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b0401a070 con 0x7f0b0c15e860 2024-03-31T16:36:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.124+0000 7f0b01ffb640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0af006c920 0x7f0af006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.124+0000 7f0b01ffb640 1 -- 172.21.15.120:0/2707669905 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0b0408ad70 con 0x7f0b0c15e860 2024-03-31T16:36:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.124+0000 7f0b115a9640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0af006c920 0x7f0af006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.124+0000 7f0b115a9640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0af006c920 0x7f0af006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b08036000 tx=0x7f0b08030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.128+0000 7f0b01ffb640 1 -- 172.21.15.120:0/2707669905 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0b04058b50 con 0x7f0b0c15e860 2024-03-31T16:36:01.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.302+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0b0c0b5910 con 0x7f0b0c15e860 2024-03-31T16:36:01.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.302+0000 7f0b01ffb640 1 -- 172.21.15.120:0/2707669905 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f0b0405ce50 con 0x7f0b0c15e860 2024-03-31T16:36:01.306 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0af006c920 msgr2=0x7f0af006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0af006c920 0x7f0af006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b08036000 tx=0x7f0b08030000 comp rx=0 tx=0).stop 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b0c15e860 msgr2=0x7f0b0c15c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b0c15e860 0x7f0b0c15c400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400c400 tx=0x7f0b0400c8c0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 shutdown_connections 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0af006c920 0x7f0af006ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b0c15e860 0x7f0b0c15c400 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b0c0d4ae0 0x7f0b0c0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 --2- 172.21.15.120:0/2707669905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b0c06da30 0x7f0b0c0cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 >> 172.21.15.120:0/2707669905 conn(0x7f0b0c09d7d0 msgr2=0x7f0b0c0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:01.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 shutdown_connections 2024-03-31T16:36:01.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.304+0000 7f0b1380d640 1 -- 172.21.15.120:0/2707669905 wait complete. 2024-03-31T16:36:01.318 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:36:01.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.418+0000 7f258660d640 1 Processor -- start 2024-03-31T16:36:01.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.418+0000 7f258660d640 1 -- start start 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f258660d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25800d1bf0 0x7f258015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f258660d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2580070170 0x7f258006b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f258660d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25800705f0 0x7f258006bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f258660d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f25800d1fd0 con 0x7f25800705f0 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f258660d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f258015eb80 con 0x7f2580070170 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f258660d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f258015edc0 con 0x7f25800d1bf0 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f2584baa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25800705f0 0x7f258006bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f2584baa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f25800705f0 0x7f258006bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37638/0 (socket says 172.21.15.120:37638) 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f2584baa640 1 -- 172.21.15.120:0/1298473681 learned_addr learned my addr 172.21.15.120:0/1298473681 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:01.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f257f7fe640 1 --2- 172.21.15.120:0/1298473681 >> v2:172.21.15.203:3300/0 conn(0x7f2580070170 0x7f258006b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.419+0000 7f257ffff640 1 --2- 172.21.15.120:0/1298473681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25800d1bf0 0x7f258015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f2584baa640 1 -- 172.21.15.120:0/1298473681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25800d1bf0 msgr2=0x7f258015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f2584baa640 1 --2- 172.21.15.120:0/1298473681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25800d1bf0 0x7f258015f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f2584baa640 1 -- 172.21.15.120:0/1298473681 >> v2:172.21.15.203:3300/0 conn(0x7f2580070170 msgr2=0x7f258006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f2584baa640 1 --2- 172.21.15.120:0/1298473681 >> v2:172.21.15.203:3300/0 conn(0x7f2580070170 0x7f258006b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f2584baa640 1 -- 172.21.15.120:0/1298473681 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25800b5e60 con 0x7f25800705f0 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f2584baa640 1 --2- 172.21.15.120:0/1298473681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f258006bab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f258006d660 tx=0x7f257802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da12e77cb609fcc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f257effd640 1 -- 172.21.15.120:0/1298473681 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257802ca70 con 0x7f25800705f0 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f257effd640 1 -- 172.21.15.120:0/1298473681 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257802cc10 con 0x7f25800705f0 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.420+0000 7f257effd640 1 -- 172.21.15.120:0/1298473681 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25780343f0 con 0x7f25800705f0 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 -- 172.21.15.120:0/1298473681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 msgr2=0x7f258006bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 --2- 172.21.15.120:0/1298473681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f258006bab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f258006d660 tx=0x7f257802bed0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 -- 172.21.15.120:0/1298473681 shutdown_connections 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 --2- 172.21.15.120:0/1298473681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f258006bab0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 --2- 172.21.15.120:0/1298473681 >> v2:172.21.15.203:3300/0 conn(0x7f2580070170 0x7f258006b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 --2- 172.21.15.120:0/1298473681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25800d1bf0 0x7f258015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 -- 172.21.15.120:0/1298473681 >> 172.21.15.120:0/1298473681 conn(0x7f25800b6560 msgr2=0x7f25800b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:01.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 -- 172.21.15.120:0/1298473681 shutdown_connections 2024-03-31T16:36:01.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.421+0000 7f258660d640 1 -- 172.21.15.120:0/1298473681 wait complete. 2024-03-31T16:36:01.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.422+0000 7f258660d640 1 Processor -- start 2024-03-31T16:36:01.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.422+0000 7f258660d640 1 -- start start 2024-03-31T16:36:01.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f258660d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2580070170 0x7f2580145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f258660d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f25800b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f258660d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25800d1bf0 0x7f25800b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f258660d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f258015fae0 con 0x7f25800705f0 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f258660d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f258015f080 con 0x7f25800d1bf0 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f258660d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f25800b5b10 con 0x7f2580070170 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f257f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f25800b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f257f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f25800b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37654/0 (socket says 172.21.15.120:37654) 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f257f7fe640 1 -- 172.21.15.120:0/3049510448 learned_addr learned my addr 172.21.15.120:0/3049510448 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f2584baa640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25800d1bf0 0x7f25800b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.423+0000 7f257ffff640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2580070170 0x7f2580145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257f7fe640 1 -- 172.21.15.120:0/3049510448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2580070170 msgr2=0x7f2580145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257f7fe640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2580070170 0x7f2580145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257f7fe640 1 -- 172.21.15.120:0/3049510448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25800d1bf0 msgr2=0x7f25800b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257f7fe640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25800d1bf0 0x7f25800b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257f7fe640 1 -- 172.21.15.120:0/3049510448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2580153830 con 0x7f25800705f0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257f7fe640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f25800b1fa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f257400e870 tx=0x7f257400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257cff9640 1 -- 172.21.15.120:0/3049510448 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2574017070 con 0x7f25800705f0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257cff9640 1 -- 172.21.15.120:0/3049510448 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257400ee60 con 0x7f25800705f0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25801f7bf0 con 0x7f25800705f0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f257cff9640 1 -- 172.21.15.120:0/3049510448 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257400cb80 con 0x7f25800705f0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.424+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25801f81b0 con 0x7f25800705f0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.425+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25800685c0 con 0x7f25800705f0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.425+0000 7f257cff9640 1 -- 172.21.15.120:0/3049510448 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f257401a070 con 0x7f25800705f0 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.426+0000 7f257cff9640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f256c06c8f0 0x7f256c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.426+0000 7f257ffff640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f256c06c8f0 0x7f256c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.426+0000 7f257cff9640 1 -- 172.21.15.120:0/3049510448 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f257408b910 con 0x7f25800705f0 2024-03-31T16:36:01.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.426+0000 7f257ffff640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f256c06c8f0 0x7f256c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2570009b40 tx=0x7f2570009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.430+0000 7f257cff9640 1 -- 172.21.15.120:0/3049510448 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f25740596f0 con 0x7f25800705f0 2024-03-31T16:36:01.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:36:01.525 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:36:01.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.610+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25800afad0 con 0x7f25800705f0 2024-03-31T16:36:01.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.611+0000 7f257cff9640 1 -- 172.21.15.120:0/3049510448 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f257405d9f0 con 0x7f25800705f0 2024-03-31T16:36:01.614 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.612+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f256c06c8f0 msgr2=0x7f256c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.612+0000 7f258660d640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f256c06c8f0 0x7f256c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2570009b40 tx=0x7f2570009190 comp rx=0 tx=0).stop 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.612+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 msgr2=0x7f25800b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.612+0000 7f258660d640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f25800b1fa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f257400e870 tx=0x7f257400ed30 comp rx=0 tx=0).stop 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.612+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 shutdown_connections 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.613+0000 7f258660d640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f256c06c8f0 0x7f256c06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.613+0000 7f258660d640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25800d1bf0 0x7f25800b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.613+0000 7f258660d640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f25800705f0 0x7f25800b1fa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.613+0000 7f258660d640 1 --2- 172.21.15.120:0/3049510448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2580070170 0x7f2580145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.613+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 >> 172.21.15.120:0/3049510448 conn(0x7f25800b6560 msgr2=0x7f25800afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:01.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.613+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 shutdown_connections 2024-03-31T16:36:01.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.613+0000 7f258660d640 1 -- 172.21.15.120:0/3049510448 wait complete. 2024-03-31T16:36:01.627 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-31T16:36:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.764+0000 7fafba940640 1 Processor -- start 2024-03-31T16:36:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.764+0000 7fafba940640 1 -- start start 2024-03-31T16:36:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafba940640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fafb415e860 0x7fafb406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafba940640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 0x7fafb40d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafba940640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fafb40d4910 0x7fafb40d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafba940640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fafb40d4d60 con 0x7fafb415e860 2024-03-31T16:36:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafba940640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fafb40cf220 con 0x7fafb40d4910 2024-03-31T16:36:01.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafba940640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fafb406dfa0 con 0x7fafb406da30 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafb3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fafb415e860 0x7fafb406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafb3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fafb415e860 0x7fafb406d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37660/0 (socket says 172.21.15.120:37660) 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafb3fff640 1 -- 172.21.15.120:0/2469728327 learned_addr learned my addr 172.21.15.120:0/2469728327 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafb8edd640 1 --2- 172.21.15.120:0/2469728327 >> v2:172.21.15.203:3300/0 conn(0x7fafb40d4910 0x7fafb40d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.765+0000 7fafb37fe640 1 --2- 172.21.15.120:0/2469728327 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 0x7fafb40d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.766+0000 7fafb3fff640 1 -- 172.21.15.120:0/2469728327 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 msgr2=0x7fafb40d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.766+0000 7fafb3fff640 1 --2- 172.21.15.120:0/2469728327 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 0x7fafb40d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.766+0000 7fafb3fff640 1 -- 172.21.15.120:0/2469728327 >> v2:172.21.15.203:3300/0 conn(0x7fafb40d4910 msgr2=0x7fafb40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.766+0000 7fafb3fff640 1 --2- 172.21.15.120:0/2469728327 >> v2:172.21.15.203:3300/0 conn(0x7fafb40d4910 0x7fafb40d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.766+0000 7fafb3fff640 1 -- 172.21.15.120:0/2469728327 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb406e240 con 0x7fafb415e860 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.766+0000 7fafb3fff640 1 --2- 172.21.15.120:0/2469728327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb415e860 0x7fafb406d4f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafb40d5520 tx=0x7fafa402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31369a732b0cabe server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.766+0000 7fafb2ffd640 1 -- 172.21.15.120:0/2469728327 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4035020 con 0x7fafb415e860 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafb2ffd640 1 -- 172.21.15.120:0/2469728327 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa4031870 con 0x7fafb415e860 2024-03-31T16:36:01.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafb2ffd640 1 -- 172.21.15.120:0/2469728327 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4031c40 con 0x7fafb415e860 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 -- 172.21.15.120:0/2469728327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb415e860 msgr2=0x7fafb406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 --2- 172.21.15.120:0/2469728327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb415e860 0x7fafb406d4f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafb40d5520 tx=0x7fafa402b910 comp rx=0 tx=0).stop 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 -- 172.21.15.120:0/2469728327 shutdown_connections 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 --2- 172.21.15.120:0/2469728327 >> v2:172.21.15.203:3300/0 conn(0x7fafb40d4910 0x7fafb40d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 --2- 172.21.15.120:0/2469728327 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 0x7fafb40d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 --2- 172.21.15.120:0/2469728327 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb415e860 0x7fafb406d4f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 -- 172.21.15.120:0/2469728327 >> 172.21.15.120:0/2469728327 conn(0x7fafb409d7d0 msgr2=0x7fafb408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 -- 172.21.15.120:0/2469728327 shutdown_connections 2024-03-31T16:36:01.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.767+0000 7fafba940640 1 -- 172.21.15.120:0/2469728327 wait complete. 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.768+0000 7fafba940640 1 Processor -- start 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.768+0000 7fafba940640 1 -- start start 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafba940640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 0x7fafb41549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafba940640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb40d4910 0x7fafb40cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafba940640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb415e860 0x7fafb40cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafba940640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fafb40cedb0 con 0x7fafb40d4910 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafba940640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fafb40d2c50 con 0x7fafb415e860 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafba940640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fafb40cef30 con 0x7fafb406da30 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafb37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb40d4910 0x7fafb40cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafb37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb40d4910 0x7fafb40cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37664/0 (socket says 172.21.15.120:37664) 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafb37fe640 1 -- 172.21.15.120:0/2024776299 learned_addr learned my addr 172.21.15.120:0/2024776299 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:01.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafb8edd640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb415e860 0x7fafb40cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.769+0000 7fafb3fff640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 0x7fafb41549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb37fe640 1 -- 172.21.15.120:0/2024776299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 msgr2=0x7fafb41549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb37fe640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 0x7fafb41549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb37fe640 1 -- 172.21.15.120:0/2024776299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb415e860 msgr2=0x7fafb40cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb37fe640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb415e860 0x7fafb40cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb37fe640 1 -- 172.21.15.120:0/2024776299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb40cc3c0 con 0x7fafb40d4910 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb37fe640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb40d4910 0x7fafb40cb940 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fafa800e8c0 tx=0x7fafa800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb0ff9640 1 -- 172.21.15.120:0/2024776299 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8017070 con 0x7fafb40d4910 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb0ff9640 1 -- 172.21.15.120:0/2024776299 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa800c940 con 0x7fafb40d4910 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb40cc670 con 0x7fafb40d4910 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafb0ff9640 1 -- 172.21.15.120:0/2024776299 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa800cd10 con 0x7fafb40d4910 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.770+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb40ccc30 con 0x7fafb40d4910 2024-03-31T16:36:01.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.771+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb40685c0 con 0x7fafb40d4910 2024-03-31T16:36:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.771+0000 7fafb0ff9640 1 -- 172.21.15.120:0/2024776299 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafa801a070 con 0x7fafb40d4910 2024-03-31T16:36:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.772+0000 7fafb0ff9640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fafa006c8f0 0x7fafa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.772+0000 7fafb0ff9640 1 -- 172.21.15.120:0/2024776299 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fafa808bda0 con 0x7fafb40d4910 2024-03-31T16:36:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.772+0000 7fafb3fff640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fafa006c8f0 0x7fafa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:01.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.772+0000 7fafb3fff640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fafa006c8f0 0x7fafa006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafa4036000 tx=0x7fafa403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:01.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:01.776+0000 7fafb0ff9640 1 -- 172.21.15.120:0/2024776299 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fafa8059c10 con 0x7fafb40d4910 2024-03-31T16:36:02.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.019+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fafb40ba040 con 0x7fafb40d4910 2024-03-31T16:36:02.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.142+0000 7fafb0ff9640 1 -- 172.21.15.120:0/2024776299 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v50) ==== 147+0+0 (secure 0 0 0) 0x7fafa805df10 con 0x7fafb40d4910 2024-03-31T16:36:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fafa006c8f0 msgr2=0x7fafa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fafa006c8f0 0x7fafa006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafa4036000 tx=0x7fafa403c040 comp rx=0 tx=0).stop 2024-03-31T16:36:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb40d4910 msgr2=0x7fafb40cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb40d4910 0x7fafb40cb940 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fafa800e8c0 tx=0x7fafa800ed80 comp rx=0 tx=0).stop 2024-03-31T16:36:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 shutdown_connections 2024-03-31T16:36:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fafa006c8f0 0x7fafa006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb415e860 0x7fafb40cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafb40d4910 0x7fafb40cb940 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 --2- 172.21.15.120:0/2024776299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb406da30 0x7fafb41549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 >> 172.21.15.120:0/2024776299 conn(0x7fafb409d7d0 msgr2=0x7fafb40b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 shutdown_connections 2024-03-31T16:36:02.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.144+0000 7fafba940640 1 -- 172.21.15.120:0/2024776299 wait complete. 2024-03-31T16:36:02.159 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-31T16:36:02.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.259+0000 7f8b0d36d640 1 Processor -- start 2024-03-31T16:36:02.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.259+0000 7f8b0d36d640 1 -- start start 2024-03-31T16:36:02.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b0d36d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b08153580 0x7f8b080d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b0d36d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8b080d07c0 0x7f8b080aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b0d36d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b080afab0 con 0x7f8b080af2e0 2024-03-31T16:36:02.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b0d36d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f8b080d0c00 con 0x7f8b080d07c0 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b0d36d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0815cc80 con 0x7f8b08153580 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b067fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8b080d07c0 0x7f8b080aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b067fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8b080d07c0 0x7f8b080aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37676/0 (socket says 172.21.15.120:37676) 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b067fc640 1 -- 172.21.15.120:0/2979924193 learned_addr learned my addr 172.21.15.120:0/2979924193 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b06ffd640 1 --2- 172.21.15.120:0/2979924193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b08153580 0x7f8b080d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b067fc640 1 -- 172.21.15.120:0/2979924193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b08153580 msgr2=0x7f8b080d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b067fc640 1 --2- 172.21.15.120:0/2979924193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b08153580 0x7f8b080d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b067fc640 1 -- 172.21.15.120:0/2979924193 >> v1:172.21.15.203:6789/0 conn(0x7f8b080af2e0 legacy=0x7f8b0806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b067fc640 1 -- 172.21.15.120:0/2979924193 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0815da00 con 0x7f8b080d07c0 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.260+0000 7f8b06ffd640 1 --2- 172.21.15.120:0/2979924193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b08153580 0x7f8b080d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:02.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.261+0000 7f8b067fc640 1 --2- 172.21.15.120:0/2979924193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080d07c0 0x7f8b080aeda0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009870 tx=0x7f8afc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c632f9f360a6f508 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:02.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.261+0000 7f8b05ffb640 1 -- 172.21.15.120:0/2979924193 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc035020 con 0x7f8b080d07c0 2024-03-31T16:36:02.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.261+0000 7f8b05ffb640 1 -- 172.21.15.120:0/2979924193 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc031640 con 0x7f8b080d07c0 2024-03-31T16:36:02.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.261+0000 7f8b05ffb640 1 -- 172.21.15.120:0/2979924193 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc02d040 con 0x7f8b080d07c0 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.262+0000 7f8b0d36d640 1 -- 172.21.15.120:0/2979924193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080d07c0 msgr2=0x7f8b080aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.262+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/2979924193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080d07c0 0x7f8b080aeda0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009870 tx=0x7f8afc02b8f0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.262+0000 7f8b0d36d640 1 -- 172.21.15.120:0/2979924193 shutdown_connections 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.262+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/2979924193 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080d07c0 0x7f8b080aeda0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.262+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/2979924193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b08153580 0x7f8b080d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.262+0000 7f8b0d36d640 1 -- 172.21.15.120:0/2979924193 >> 172.21.15.120:0/2979924193 conn(0x7f8b0806b750 msgr2=0x7f8b0806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.262+0000 7f8b0d36d640 1 -- 172.21.15.120:0/2979924193 shutdown_connections 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.262+0000 7f8b0d36d640 1 -- 172.21.15.120:0/2979924193 wait complete. 2024-03-31T16:36:02.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.263+0000 7f8b0d36d640 1 Processor -- start 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.263+0000 7f8b0d36d640 1 -- start start 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b0d36d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080af2e0 0x7f8b08156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b0d36d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b080d07c0 0x7f8b08072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b0d36d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b08153580 0x7f8b0814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b0d36d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0815d4e0 con 0x7f8b080af2e0 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b0d36d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0815d200 con 0x7f8b08153580 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b0d36d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b08153960 con 0x7f8b080d07c0 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080af2e0 0x7f8b08156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080af2e0 0x7f8b08156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37686/0 (socket says 172.21.15.120:37686) 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 -- 172.21.15.120:0/3015058595 learned_addr learned my addr 172.21.15.120:0/3015058595 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b067fc640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b080d07c0 0x7f8b08072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b077fe640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b08153580 0x7f8b0814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 -- 172.21.15.120:0/3015058595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b080d07c0 msgr2=0x7f8b08072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b080d07c0 0x7f8b08072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 -- 172.21.15.120:0/3015058595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b08153580 msgr2=0x7f8b0814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b08153580 0x7f8b0814d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 -- 172.21.15.120:0/3015058595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b08072790 con 0x7f8b080af2e0 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.264+0000 7f8b06ffd640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080af2e0 0x7f8b08156610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8af800e7e0 tx=0x7f8af800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.265+0000 7f8aef7fe640 1 -- 172.21.15.120:0/3015058595 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af800f040 con 0x7f8b080af2e0 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.265+0000 7f8aef7fe640 1 -- 172.21.15.120:0/3015058595 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8004030 con 0x7f8b080af2e0 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.265+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b08072a70 con 0x7f8b080af2e0 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.265+0000 7f8aef7fe640 1 -- 172.21.15.120:0/3015058595 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8004400 con 0x7f8b080af2e0 2024-03-31T16:36:02.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.265+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b08073030 con 0x7f8b080af2e0 2024-03-31T16:36:02.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.266+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0806e600 con 0x7f8b080af2e0 2024-03-31T16:36:02.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.266+0000 7f8aef7fe640 1 -- 172.21.15.120:0/3015058595 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8af800c6d0 con 0x7f8b080af2e0 2024-03-31T16:36:02.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.266+0000 7f8aef7fe640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8af406c8f0 0x7f8af406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.267+0000 7f8b067fc640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8af406c8f0 0x7f8af406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.267+0000 7f8aef7fe640 1 -- 172.21.15.120:0/3015058595 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8af808b880 con 0x7f8b080af2e0 2024-03-31T16:36:02.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.267+0000 7f8b067fc640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8af406c8f0 0x7f8af406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8afc036000 tx=0x7f8afc03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:02.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.271+0000 7f8aef7fe640 1 -- 172.21.15.120:0/3015058595 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8b0806e600 con 0x7f8b080af2e0 2024-03-31T16:36:02.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.446+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8b080685c0 con 0x7f8b080af2e0 2024-03-31T16:36:02.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.449+0000 7f8aef7fe640 1 -- 172.21.15.120:0/3015058595 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f8af8017020 con 0x7f8b080af2e0 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8af406c8f0 msgr2=0x7f8af406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8af406c8f0 0x7f8af406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8afc036000 tx=0x7f8afc03c040 comp rx=0 tx=0).stop 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080af2e0 msgr2=0x7f8b08156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080af2e0 0x7f8b08156610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8af800e7e0 tx=0x7f8af800eca0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 shutdown_connections 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8af406c8f0 0x7f8af406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b08153580 0x7f8b0814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b080d07c0 0x7f8b08072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 --2- 172.21.15.120:0/3015058595 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b080af2e0 0x7f8b08156610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 >> 172.21.15.120:0/3015058595 conn(0x7f8b0806b750 msgr2=0x7f8b0806bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:02.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 shutdown_connections 2024-03-31T16:36:02.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.451+0000 7f8b0d36d640 1 -- 172.21.15.120:0/3015058595 wait complete. 2024-03-31T16:36:02.465 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-31T16:36:02.466 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-31T16:36:02.504 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-31T16:36:02.551 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-31T16:36:02.551 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:36:02.551 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:02.567 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:36:02.567 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:02.624 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:36:02.624 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:02.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:02.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.817+0000 7fb60d255640 1 Processor -- start 2024-03-31T16:36:02.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.817+0000 7fb60d255640 1 -- start start 2024-03-31T16:36:02.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb60d255640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb608155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb60d255640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb60815f800 0x7fb6080d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb60d255640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6080b40b0 con 0x7fb6080d07c0 2024-03-31T16:36:02.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb60d255640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb6080d0c30 con 0x7fb60815f800 2024-03-31T16:36:02.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb60d255640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb6080b4390 con 0x7fb608155550 2024-03-31T16:36:02.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb60759e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb6080d07c0 0x7fb6080aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53302/0 (socket says 172.21.15.120:53302) 2024-03-31T16:36:02.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb60759e640 1 -- 172.21.15.120:0/924589366 learned_addr learned my addr 172.21.15.120:0/924589366 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:02.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb606d9d640 1 --2- 172.21.15.120:0/924589366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb608155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb60659c640 1 --2- 172.21.15.120:0/924589366 >> v2:172.21.15.203:3300/0 conn(0x7fb60815f800 0x7fb6080d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb605d9b640 1 -- 172.21.15.120:0/924589366 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381515154 0 0) 0x7fb6080b40b0 con 0x7fb6080d07c0 2024-03-31T16:36:02.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb605d9b640 1 -- 172.21.15.120:0/924589366 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5f0003520 con 0x7fb6080d07c0 2024-03-31T16:36:02.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb606d9d640 1 -- 172.21.15.120:0/924589366 >> v2:172.21.15.203:3300/0 conn(0x7fb60815f800 msgr2=0x7fb6080d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:02.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb606d9d640 1 --2- 172.21.15.120:0/924589366 >> v2:172.21.15.203:3300/0 conn(0x7fb60815f800 0x7fb6080d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb606d9d640 1 -- 172.21.15.120:0/924589366 >> v1:172.21.15.120:6789/0 conn(0x7fb6080d07c0 legacy=0x7fb6080aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.818+0000 7fb606d9d640 1 -- 172.21.15.120:0/924589366 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6080b4670 con 0x7fb608155550 2024-03-31T16:36:02.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.819+0000 7fb606d9d640 1 --2- 172.21.15.120:0/924589366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb608155930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80097a0 tx=0x7fb5f802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf3ec151a53bcb1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:02.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.819+0000 7fb605d9b640 1 -- 172.21.15.120:0/924589366 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8035020 con 0x7fb608155550 2024-03-31T16:36:02.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.819+0000 7fb605d9b640 1 -- 172.21.15.120:0/924589366 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8031830 con 0x7fb608155550 2024-03-31T16:36:02.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.819+0000 7fb605d9b640 1 -- 172.21.15.120:0/924589366 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8031be0 con 0x7fb608155550 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.820+0000 7fb60d255640 1 -- 172.21.15.120:0/924589366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 msgr2=0x7fb608155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.820+0000 7fb60d255640 1 --2- 172.21.15.120:0/924589366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb608155930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80097a0 tx=0x7fb5f802b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.820+0000 7fb60d255640 1 -- 172.21.15.120:0/924589366 shutdown_connections 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.820+0000 7fb60d255640 1 --2- 172.21.15.120:0/924589366 >> v2:172.21.15.203:3300/0 conn(0x7fb60815f800 0x7fb6080d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.820+0000 7fb60d255640 1 --2- 172.21.15.120:0/924589366 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb608155930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.820+0000 7fb60d255640 1 -- 172.21.15.120:0/924589366 >> 172.21.15.120:0/924589366 conn(0x7fb60806b750 msgr2=0x7fb60806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.820+0000 7fb60d255640 1 -- 172.21.15.120:0/924589366 shutdown_connections 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.820+0000 7fb60d255640 1 -- 172.21.15.120:0/924589366 wait complete. 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.821+0000 7fb60d255640 1 Processor -- start 2024-03-31T16:36:02.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.821+0000 7fb60d255640 1 -- start start 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb60d255640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6080d07c0 0x7fb60814a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb60d255640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb6080af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb60d255640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60815f800 0x7fb60809d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb60d255640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb60815fc80 con 0x7fb6080d07c0 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb60d255640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6080b4c30 con 0x7fb60815f800 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb60d255640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb60815ba20 con 0x7fb608155550 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb606d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6080d07c0 0x7fb60814a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb606d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6080d07c0 0x7fb60814a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37700/0 (socket says 172.21.15.120:37700) 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb606d9d640 1 -- 172.21.15.120:0/560277567 learned_addr learned my addr 172.21.15.120:0/560277567 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb60759e640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60815f800 0x7fb60809d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.828 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.822+0000 7fb60659c640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb6080af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb606d9d640 1 -- 172.21.15.120:0/560277567 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 msgr2=0x7fb6080af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb606d9d640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb6080af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb606d9d640 1 -- 172.21.15.120:0/560277567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60815f800 msgr2=0x7fb60809d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb606d9d640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60815f800 0x7fb60809d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb606d9d640 1 -- 172.21.15.120:0/560277567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb608156310 con 0x7fb6080d07c0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb606d9d640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6080d07c0 0x7fb60814a8e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb5f802b910 tx=0x7fb5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb5ef7fe640 1 -- 172.21.15.120:0/560277567 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8035040 con 0x7fb6080d07c0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb5ef7fe640 1 -- 172.21.15.120:0/560277567 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8004450 con 0x7fb6080d07c0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6080afec0 con 0x7fb6080d07c0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb5ef7fe640 1 -- 172.21.15.120:0/560277567 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8003810 con 0x7fb6080d07c0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.823+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6080b0480 con 0x7fb6080d07c0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.824+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6080685c0 con 0x7fb6080d07c0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.824+0000 7fb5ef7fe640 1 -- 172.21.15.120:0/560277567 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5f8038020 con 0x7fb6080d07c0 2024-03-31T16:36:02.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.825+0000 7fb5ef7fe640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb5f406c8f0 0x7fb5f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:02.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.825+0000 7fb5ef7fe640 1 -- 172.21.15.120:0/560277567 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb5f80adb10 con 0x7fb6080d07c0 2024-03-31T16:36:02.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.825+0000 7fb60659c640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb5f406c8f0 0x7fb5f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:02.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.825+0000 7fb60659c640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb5f406c8f0 0x7fb5f406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb60809e330 tx=0x7fb5fc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:02.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:02.829+0000 7fb5ef7fe640 1 -- 172.21.15.120:0/560277567 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb5f807b8f0 con 0x7fb6080d07c0 2024-03-31T16:36:03.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.006+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6080b3ad0 con 0x7fb6080d07c0 2024-03-31T16:36:03.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.007+0000 7fb5ef7fe640 1 -- 172.21.15.120:0/560277567 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7fb5f807fbf0 con 0x7fb6080d07c0 2024-03-31T16:36:03.011 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:03.011 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:03.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.009+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb5f406c8f0 msgr2=0x7fb5f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.009+0000 7fb60d255640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb5f406c8f0 0x7fb5f406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb60809e330 tx=0x7fb5fc009190 comp rx=0 tx=0).stop 2024-03-31T16:36:03.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.009+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6080d07c0 msgr2=0x7fb60814a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.009+0000 7fb60d255640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6080d07c0 0x7fb60814a8e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb5f802b910 tx=0x7fb5f80046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.010+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 shutdown_connections 2024-03-31T16:36:03.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.010+0000 7fb60d255640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb5f406c8f0 0x7fb5f406edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.010+0000 7fb60d255640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb60815f800 0x7fb60809d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.010+0000 7fb60d255640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb608155550 0x7fb6080af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.010+0000 7fb60d255640 1 --2- 172.21.15.120:0/560277567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb6080d07c0 0x7fb60814a8e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.010+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 >> 172.21.15.120:0/560277567 conn(0x7fb60806b750 msgr2=0x7fb60806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:03.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.010+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 shutdown_connections 2024-03-31T16:36:03.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.010+0000 7fb60d255640 1 -- 172.21.15.120:0/560277567 wait complete. 2024-03-31T16:36:03.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:36:03.024 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:36:03.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.126+0000 7fe1e7552640 1 Processor -- start 2024-03-31T16:36:03.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.126+0000 7fe1e7552640 1 -- start start 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e7552640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe1e00b0670 0x7fe1e015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e7552640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1e006bc80 0x7fe1e0168450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e7552640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e00b5b10 con 0x7fe1e0070120 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e7552640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e00b63e0 con 0x7fe1e006bc80 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e7552640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e006c3f0 con 0x7fe1e00b0670 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e5aef640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1e006bc80 0x7fe1e0168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e5aef640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1e006bc80 0x7fe1e0168450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37702/0 (socket says 172.21.15.120:37702) 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e5aef640 1 -- 172.21.15.120:0/1328161268 learned_addr learned my addr 172.21.15.120:0/1328161268 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.127+0000 7fe1e52ee640 1 --2- 172.21.15.120:0/1328161268 >> v2:172.21.15.203:3300/0 conn(0x7fe1e00b0670 0x7fe1e015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.128+0000 7fe1e5aef640 1 -- 172.21.15.120:0/1328161268 >> v2:172.21.15.203:3300/0 conn(0x7fe1e00b0670 msgr2=0x7fe1e015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:03.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.128+0000 7fe1e5aef640 1 --2- 172.21.15.120:0/1328161268 >> v2:172.21.15.203:3300/0 conn(0x7fe1e00b0670 0x7fe1e015f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.128+0000 7fe1e5aef640 1 -- 172.21.15.120:0/1328161268 >> v1:172.21.15.203:6789/0 conn(0x7fe1e0070120 legacy=0x7fe1e006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.128+0000 7fe1e5aef640 1 -- 172.21.15.120:0/1328161268 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e015fdf0 con 0x7fe1e006bc80 2024-03-31T16:36:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.128+0000 7fe1e5aef640 1 --2- 172.21.15.120:0/1328161268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e006bc80 0x7fe1e0168450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00d2240 tx=0x7fe1d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33adecd6f0dec1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1d7fff640 1 -- 172.21.15.120:0/1328161268 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8034070 con 0x7fe1e006bc80 2024-03-31T16:36:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1d7fff640 1 -- 172.21.15.120:0/1328161268 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d8030860 con 0x7fe1e006bc80 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1d7fff640 1 -- 172.21.15.120:0/1328161268 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8030c30 con 0x7fe1e006bc80 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1e7552640 1 -- 172.21.15.120:0/1328161268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e006bc80 msgr2=0x7fe1e0168450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1e7552640 1 --2- 172.21.15.120:0/1328161268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e006bc80 0x7fe1e0168450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00d2240 tx=0x7fe1d802b9a0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1e7552640 1 -- 172.21.15.120:0/1328161268 shutdown_connections 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1e7552640 1 --2- 172.21.15.120:0/1328161268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e006bc80 0x7fe1e0168450 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1e7552640 1 --2- 172.21.15.120:0/1328161268 >> v2:172.21.15.203:3300/0 conn(0x7fe1e00b0670 0x7fe1e015f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1e7552640 1 -- 172.21.15.120:0/1328161268 >> 172.21.15.120:0/1328161268 conn(0x7fe1e00b65a0 msgr2=0x7fe1e00b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1e7552640 1 -- 172.21.15.120:0/1328161268 shutdown_connections 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.129+0000 7fe1e7552640 1 -- 172.21.15.120:0/1328161268 wait complete. 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.130+0000 7fe1e7552640 1 Processor -- start 2024-03-31T16:36:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e7552640 1 -- start start 2024-03-31T16:36:03.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e7552640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1e006bc80 0x7fe1e013fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e7552640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e0070120 0x7fe1e00b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e7552640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1e00b0670 0x7fe1e00b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e7552640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e00b6070 con 0x7fe1e0070120 2024-03-31T16:36:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e7552640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e00b5d90 con 0x7fe1e00b0670 2024-03-31T16:36:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e7552640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e00b0a50 con 0x7fe1e006bc80 2024-03-31T16:36:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e4aed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e0070120 0x7fe1e00b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e4aed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e0070120 0x7fe1e00b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37708/0 (socket says 172.21.15.120:37708) 2024-03-31T16:36:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e4aed640 1 -- 172.21.15.120:0/120425016 learned_addr learned my addr 172.21.15.120:0/120425016 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e5aef640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1e00b0670 0x7fe1e00b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.131+0000 7fe1e52ee640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1e006bc80 0x7fe1e013fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1e4aed640 1 -- 172.21.15.120:0/120425016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1e006bc80 msgr2=0x7fe1e013fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1e4aed640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1e006bc80 0x7fe1e013fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1e4aed640 1 -- 172.21.15.120:0/120425016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1e00b0670 msgr2=0x7fe1e00b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1e4aed640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1e00b0670 0x7fe1e00b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1e4aed640 1 -- 172.21.15.120:0/120425016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e00cdbe0 con 0x7fe1e0070120 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1e4aed640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e0070120 0x7fe1e00b3960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c430 tx=0x7fe1d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1d5ffb640 1 -- 172.21.15.120:0/120425016 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00052d0 con 0x7fe1e0070120 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1d5ffb640 1 -- 172.21.15.120:0/120425016 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d0005490 con 0x7fe1e0070120 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e00cdec0 con 0x7fe1e0070120 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1d5ffb640 1 -- 172.21.15.120:0/120425016 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0007260 con 0x7fe1e0070120 2024-03-31T16:36:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.132+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e00ce480 con 0x7fe1e0070120 2024-03-31T16:36:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.133+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e0068cd0 con 0x7fe1e0070120 2024-03-31T16:36:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.134+0000 7fe1d5ffb640 1 -- 172.21.15.120:0/120425016 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1d0007400 con 0x7fe1e0070120 2024-03-31T16:36:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.134+0000 7fe1d5ffb640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe1c406c920 0x7fe1c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.134+0000 7fe1d5ffb640 1 -- 172.21.15.120:0/120425016 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d008b000 con 0x7fe1e0070120 2024-03-31T16:36:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.134+0000 7fe1e52ee640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe1c406c920 0x7fe1c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.134+0000 7fe1e52ee640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe1c406c920 0x7fe1c406ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc011340 tx=0x7fe1dc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.138+0000 7fe1d5ffb640 1 -- 172.21.15.120:0/120425016 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe1e00b5b10 con 0x7fe1e0070120 2024-03-31T16:36:03.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.313+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe1e00afe90 con 0x7fe1e0070120 2024-03-31T16:36:03.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.314+0000 7fe1d5ffb640 1 -- 172.21.15.120:0/120425016 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fe1d0058de0 con 0x7fe1e0070120 2024-03-31T16:36:03.317 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:36:03.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe1c406c920 msgr2=0x7fe1c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe1c406c920 0x7fe1c406ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc011340 tx=0x7fe1dc00b040 comp rx=0 tx=0).stop 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e0070120 msgr2=0x7fe1e00b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e0070120 0x7fe1e00b3960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000c430 tx=0x7fe1d000c8f0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 shutdown_connections 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe1c406c920 0x7fe1c406ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe1e00b0670 0x7fe1e00b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1e0070120 0x7fe1e00b3960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 --2- 172.21.15.120:0/120425016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1e006bc80 0x7fe1e013fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 >> 172.21.15.120:0/120425016 conn(0x7fe1e00b65a0 msgr2=0x7fe1e00ae390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 shutdown_connections 2024-03-31T16:36:03.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.316+0000 7fe1e7552640 1 -- 172.21.15.120:0/120425016 wait complete. 2024-03-31T16:36:03.330 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:36:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.430+0000 7fe328c63640 1 Processor -- start 2024-03-31T16:36:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.430+0000 7fe328c63640 1 -- start start 2024-03-31T16:36:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe328c63640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe3241412a0 0x7fe3240b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe328c63640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe324141680 0x7fe3240b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe328c63640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32415d7c0 con 0x7fe32415ca50 2024-03-31T16:36:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe328c63640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe324141be0 con 0x7fe324141680 2024-03-31T16:36:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe328c63640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe324141ec0 con 0x7fe3241412a0 2024-03-31T16:36:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe31bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe324141680 0x7fe3240b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe31bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe324141680 0x7fe3240b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37712/0 (socket says 172.21.15.120:37712) 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe31bfff640 1 -- 172.21.15.120:0/2929465 learned_addr learned my addr 172.21.15.120:0/2929465 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe32259c640 1 --2- 172.21.15.120:0/2929465 >> v2:172.21.15.203:3300/0 conn(0x7fe3241412a0 0x7fe3240b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe31bfff640 1 -- 172.21.15.120:0/2929465 >> v2:172.21.15.203:3300/0 conn(0x7fe3241412a0 msgr2=0x7fe3240b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe31bfff640 1 --2- 172.21.15.120:0/2929465 >> v2:172.21.15.203:3300/0 conn(0x7fe3241412a0 0x7fe3240b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe31bfff640 1 -- 172.21.15.120:0/2929465 >> v1:172.21.15.203:6789/0 conn(0x7fe32415ca50 legacy=0x7fe32415cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.431+0000 7fe31bfff640 1 -- 172.21.15.120:0/2929465 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3241421a0 con 0x7fe324141680 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.432+0000 7fe31bfff640 1 --2- 172.21.15.120:0/2929465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe324141680 0x7fe3240b4920 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe3240710c0 tx=0x7fe30c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1347e3195dfcdb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.432+0000 7fe321d9b640 1 -- 172.21.15.120:0/2929465 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c034070 con 0x7fe324141680 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.432+0000 7fe321d9b640 1 -- 172.21.15.120:0/2929465 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c030860 con 0x7fe324141680 2024-03-31T16:36:03.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.432+0000 7fe321d9b640 1 -- 172.21.15.120:0/2929465 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c030c30 con 0x7fe324141680 2024-03-31T16:36:03.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.433+0000 7fe328c63640 1 -- 172.21.15.120:0/2929465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe324141680 msgr2=0x7fe3240b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.433+0000 7fe328c63640 1 --2- 172.21.15.120:0/2929465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe324141680 0x7fe3240b4920 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe3240710c0 tx=0x7fe30c02b9a0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.433+0000 7fe328c63640 1 -- 172.21.15.120:0/2929465 shutdown_connections 2024-03-31T16:36:03.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.433+0000 7fe328c63640 1 --2- 172.21.15.120:0/2929465 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe324141680 0x7fe3240b4920 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.433+0000 7fe328c63640 1 --2- 172.21.15.120:0/2929465 >> v2:172.21.15.203:3300/0 conn(0x7fe3241412a0 0x7fe3240b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.433+0000 7fe328c63640 1 -- 172.21.15.120:0/2929465 >> 172.21.15.120:0/2929465 conn(0x7fe324067670 msgr2=0x7fe324067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:03.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.433+0000 7fe328c63640 1 -- 172.21.15.120:0/2929465 shutdown_connections 2024-03-31T16:36:03.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.433+0000 7fe328c63640 1 -- 172.21.15.120:0/2929465 wait complete. 2024-03-31T16:36:03.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.434+0000 7fe328c63640 1 Processor -- start 2024-03-31T16:36:03.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.434+0000 7fe328c63640 1 -- start start 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe328c63640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3241412a0 0x7fe32415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe328c63640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe324141680 0x7fe3240b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe328c63640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415ca50 0x7fe32413a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe328c63640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240cec40 con 0x7fe3241412a0 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe328c63640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3241429a0 con 0x7fe32415ca50 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe328c63640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240cedc0 con 0x7fe324141680 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3241412a0 0x7fe32415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3241412a0 0x7fe32415c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37714/0 (socket says 172.21.15.120:37714) 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 -- 172.21.15.120:0/3317295679 learned_addr learned my addr 172.21.15.120:0/3317295679 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:03.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe322d9d640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415ca50 0x7fe32413a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe31bfff640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe324141680 0x7fe3240b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 -- 172.21.15.120:0/3317295679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe324141680 msgr2=0x7fe3240b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe324141680 0x7fe3240b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 -- 172.21.15.120:0/3317295679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415ca50 msgr2=0x7fe32413a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415ca50 0x7fe32413a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 -- 172.21.15.120:0/3317295679 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32413ce00 con 0x7fe3241412a0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe32259c640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3241412a0 0x7fe32415c030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe31400e8a0 tx=0x7fe31400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe31affd640 1 -- 172.21.15.120:0/3317295679 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314017070 con 0x7fe3241412a0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe31affd640 1 -- 172.21.15.120:0/3317295679 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31400c940 con 0x7fe3241412a0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe31affd640 1 -- 172.21.15.120:0/3317295679 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31400cd30 con 0x7fe3241412a0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.435+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32413d0e0 con 0x7fe3241412a0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.436+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3240b58a0 con 0x7fe3241412a0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.436+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe324074f30 con 0x7fe3241412a0 2024-03-31T16:36:03.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.437+0000 7fe31affd640 1 -- 172.21.15.120:0/3317295679 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe31401a070 con 0x7fe3241412a0 2024-03-31T16:36:03.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.437+0000 7fe31affd640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe30406c8f0 0x7fe30406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.437+0000 7fe31affd640 1 -- 172.21.15.120:0/3317295679 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe31408bce0 con 0x7fe3241412a0 2024-03-31T16:36:03.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.437+0000 7fe31bfff640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe30406c8f0 0x7fe30406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.438+0000 7fe31bfff640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe30406c8f0 0x7fe30406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe30c036000 tx=0x7fe30c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.442+0000 7fe31affd640 1 -- 172.21.15.120:0/3317295679 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe314059ac0 con 0x7fe3241412a0 2024-03-31T16:36:03.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.616+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe3240685c0 con 0x7fe3241412a0 2024-03-31T16:36:03.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.616+0000 7fe31affd640 1 -- 172.21.15.120:0/3317295679 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe31405ddc0 con 0x7fe3241412a0 2024-03-31T16:36:03.619 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:36:03.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe30406c8f0 msgr2=0x7fe30406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe30406c8f0 0x7fe30406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe30c036000 tx=0x7fe30c008030 comp rx=0 tx=0).stop 2024-03-31T16:36:03.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3241412a0 msgr2=0x7fe32415c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3241412a0 0x7fe32415c030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe31400e8a0 tx=0x7fe31400ed60 comp rx=0 tx=0).stop 2024-03-31T16:36:03.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 shutdown_connections 2024-03-31T16:36:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe30406c8f0 0x7fe30406edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe32415ca50 0x7fe32413a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe324141680 0x7fe3240b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 --2- 172.21.15.120:0/3317295679 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3241412a0 0x7fe32415c030 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 >> 172.21.15.120:0/3317295679 conn(0x7fe324067670 msgr2=0x7fe32415ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 shutdown_connections 2024-03-31T16:36:03.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.618+0000 7fe328c63640 1 -- 172.21.15.120:0/3317295679 wait complete. 2024-03-31T16:36:03.632 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:36:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.732+0000 7f382716d640 1 Processor -- start 2024-03-31T16:36:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.732+0000 7f382716d640 1 -- start start 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f382716d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200d1bf0 0x7f382015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f382716d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f382015edc0 con 0x7f3820070170 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f382716d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38200b5e60 con 0x7f38200705f0 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f382716d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f38200d1fd0 con 0x7f38200d1bf0 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f381ffff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3820070170 0x7f382006b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53316/0 (socket says 172.21.15.120:53316) 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f381ffff640 1 -- 172.21.15.120:0/342721299 learned_addr learned my addr 172.21.15.120:0/342721299 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f3824f09640 1 --2- 172.21.15.120:0/342721299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200d1bf0 0x7f382015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f381f7fe640 1 -- 172.21.15.120:0/342721299 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229516447 0 0) 0x7f382015edc0 con 0x7f3820070170 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f381f7fe640 1 -- 172.21.15.120:0/342721299 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3808003520 con 0x7f3820070170 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f381f7fe640 1 -- 172.21.15.120:0/342721299 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491191551 0 0) 0x7f38200b5e60 con 0x7f38200705f0 2024-03-31T16:36:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f3824f09640 1 -- 172.21.15.120:0/342721299 >> v1:172.21.15.203:6789/0 conn(0x7f38200705f0 legacy=0x7f382006e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.733+0000 7f3824f09640 1 -- 172.21.15.120:0/342721299 >> v1:172.21.15.120:6789/0 conn(0x7f3820070170 legacy=0x7f382006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.734+0000 7f3824f09640 1 -- 172.21.15.120:0/342721299 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38200b6140 con 0x7f38200d1bf0 2024-03-31T16:36:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.734+0000 7f3824f09640 1 --2- 172.21.15.120:0/342721299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200d1bf0 0x7f382015f5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38100097d0 tx=0x7f381002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ae02747d91052f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.734+0000 7f381f7fe640 1 -- 172.21.15.120:0/342721299 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810035020 con 0x7f38200d1bf0 2024-03-31T16:36:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.734+0000 7f381f7fe640 1 -- 172.21.15.120:0/342721299 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3810031890 con 0x7f38200d1bf0 2024-03-31T16:36:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.734+0000 7f381f7fe640 1 -- 172.21.15.120:0/342721299 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810031c40 con 0x7f38200d1bf0 2024-03-31T16:36:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.735+0000 7f382716d640 1 -- 172.21.15.120:0/342721299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200d1bf0 msgr2=0x7f382015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.735+0000 7f382716d640 1 --2- 172.21.15.120:0/342721299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200d1bf0 0x7f382015f5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f38100097d0 tx=0x7f381002b930 comp rx=0 tx=0).stop 2024-03-31T16:36:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.735+0000 7f382716d640 1 -- 172.21.15.120:0/342721299 shutdown_connections 2024-03-31T16:36:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.735+0000 7f382716d640 1 --2- 172.21.15.120:0/342721299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200d1bf0 0x7f382015f5a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.735+0000 7f382716d640 1 -- 172.21.15.120:0/342721299 >> 172.21.15.120:0/342721299 conn(0x7f38200b6560 msgr2=0x7f38200b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.735+0000 7f382716d640 1 -- 172.21.15.120:0/342721299 shutdown_connections 2024-03-31T16:36:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.735+0000 7f382716d640 1 -- 172.21.15.120:0/342721299 wait complete. 2024-03-31T16:36:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.736+0000 7f382716d640 1 Processor -- start 2024-03-31T16:36:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.736+0000 7f382716d640 1 -- start start 2024-03-31T16:36:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382716d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3820070170 0x7f38200b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382716d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200705f0 0x7f38200b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382716d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38200d1bf0 0x7f3820159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382716d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f382015fae0 con 0x7f38200d1bf0 2024-03-31T16:36:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382716d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f382015eb80 con 0x7f3820070170 2024-03-31T16:36:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382716d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f38200b5b10 con 0x7f38200705f0 2024-03-31T16:36:03.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382570a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38200d1bf0 0x7f3820159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382570a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38200d1bf0 0x7f3820159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37716/0 (socket says 172.21.15.120:37716) 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382570a640 1 -- 172.21.15.120:0/1598943197 learned_addr learned my addr 172.21.15.120:0/1598943197 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f3824f09640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3820070170 0x7f38200b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f381ffff640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200705f0 0x7f38200b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382570a640 1 -- 172.21.15.120:0/1598943197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200705f0 msgr2=0x7f38200b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382570a640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200705f0 0x7f38200b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382570a640 1 -- 172.21.15.120:0/1598943197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3820070170 msgr2=0x7f38200b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382570a640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3820070170 0x7f38200b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.737+0000 7f382570a640 1 -- 172.21.15.120:0/1598943197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38200b1340 con 0x7f38200d1bf0 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.738+0000 7f382570a640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38200d1bf0 0x7f3820159680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f381800c700 tx=0x7f381800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.738+0000 7f381d7fa640 1 -- 172.21.15.120:0/1598943197 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818003da0 con 0x7f38200d1bf0 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.738+0000 7f381d7fa640 1 -- 172.21.15.120:0/1598943197 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381800ce10 con 0x7f38200d1bf0 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.738+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38200b1620 con 0x7f38200d1bf0 2024-03-31T16:36:03.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.738+0000 7f381d7fa640 1 -- 172.21.15.120:0/1598943197 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3818005270 con 0x7f38200d1bf0 2024-03-31T16:36:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.738+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38200b1be0 con 0x7f38200d1bf0 2024-03-31T16:36:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.739+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38200685c0 con 0x7f38200d1bf0 2024-03-31T16:36:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.739+0000 7f381d7fa640 1 -- 172.21.15.120:0/1598943197 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3818005410 con 0x7f38200d1bf0 2024-03-31T16:36:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.739+0000 7f381d7fa640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f380c06c8f0 0x7f380c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:03.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.740+0000 7f381d7fa640 1 -- 172.21.15.120:0/1598943197 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f381808b990 con 0x7f38200d1bf0 2024-03-31T16:36:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.740+0000 7f3824f09640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f380c06c8f0 0x7f380c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.740+0000 7f3824f09640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f380c06c8f0 0x7f380c06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3810036000 tx=0x7f381003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:03.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.744+0000 7f381d7fa640 1 -- 172.21.15.120:0/1598943197 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f38180596f0 con 0x7f38200d1bf0 2024-03-31T16:36:03.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.920+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f38200afad0 con 0x7f38200d1bf0 2024-03-31T16:36:03.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.920+0000 7f381d7fa640 1 -- 172.21.15.120:0/1598943197 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f381805d9f0 con 0x7f38200d1bf0 2024-03-31T16:36:03.923 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:36:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f380c06c8f0 msgr2=0x7f380c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f380c06c8f0 0x7f380c06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3810036000 tx=0x7f381003c040 comp rx=0 tx=0).stop 2024-03-31T16:36:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38200d1bf0 msgr2=0x7f3820159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:03.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38200d1bf0 0x7f3820159680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f381800c700 tx=0x7f381800cbc0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 shutdown_connections 2024-03-31T16:36:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f380c06c8f0 0x7f380c06edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f38200d1bf0 0x7f3820159680 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38200705f0 0x7f38200b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 --2- 172.21.15.120:0/1598943197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3820070170 0x7f38200b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 >> 172.21.15.120:0/1598943197 conn(0x7f38200b6560 msgr2=0x7f38200b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 shutdown_connections 2024-03-31T16:36:03.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:03.922+0000 7f382716d640 1 -- 172.21.15.120:0/1598943197 wait complete. 2024-03-31T16:36:03.936 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-31T16:36:04.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.033+0000 7f9951732640 1 Processor -- start 2024-03-31T16:36:04.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.033+0000 7f9951732640 1 -- start start 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.034+0000 7f9951732640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f994c15f900 0x7f994c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.034+0000 7f9951732640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994c15cd90 con 0x7f994c0d0540 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.034+0000 7f9951732640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994c15d060 con 0x7f994c15da60 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.034+0000 7f9951732640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f994c15d340 con 0x7f994c15f900 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.034+0000 7f994affd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f994c15f900 0x7f994c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.034+0000 7f994b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f994c0d0540 0x7f994c0ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:53318/0 (socket says 172.21.15.120:53318) 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.034+0000 7f994b7fe640 1 -- 172.21.15.120:0/2635747558 learned_addr learned my addr 172.21.15.120:0/2635747558 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.035+0000 7f994affd640 1 -- 172.21.15.120:0/2635747558 >> v1:172.21.15.203:6789/0 conn(0x7f994c15da60 legacy=0x7f994c0cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.035+0000 7f994affd640 1 -- 172.21.15.120:0/2635747558 >> v1:172.21.15.120:6789/0 conn(0x7f994c0d0540 legacy=0x7f994c0ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.035+0000 7f994affd640 1 -- 172.21.15.120:0/2635747558 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c15d620 con 0x7f994c15f900 2024-03-31T16:36:04.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.035+0000 7f994affd640 1 --2- 172.21.15.120:0/2635747558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15f900 0x7f994c15c850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f993c009d90 tx=0x7f993c02bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee2dd83a4f00c7f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.035+0000 7f9949ffb640 1 -- 172.21.15.120:0/2635747558 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c039070 con 0x7f994c15f900 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9949ffb640 1 -- 172.21.15.120:0/2635747558 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c02cab0 con 0x7f994c15f900 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9949ffb640 1 -- 172.21.15.120:0/2635747558 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c034440 con 0x7f994c15f900 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9951732640 1 -- 172.21.15.120:0/2635747558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15f900 msgr2=0x7f994c15c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9951732640 1 --2- 172.21.15.120:0/2635747558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15f900 0x7f994c15c850 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f993c009d90 tx=0x7f993c02bd80 comp rx=0 tx=0).stop 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9951732640 1 -- 172.21.15.120:0/2635747558 shutdown_connections 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9951732640 1 --2- 172.21.15.120:0/2635747558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15f900 0x7f994c15c850 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9951732640 1 -- 172.21.15.120:0/2635747558 >> 172.21.15.120:0/2635747558 conn(0x7f994c0b3e90 msgr2=0x7f994c0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9951732640 1 -- 172.21.15.120:0/2635747558 shutdown_connections 2024-03-31T16:36:04.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.036+0000 7f9951732640 1 -- 172.21.15.120:0/2635747558 wait complete. 2024-03-31T16:36:04.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.037+0000 7f9951732640 1 Processor -- start 2024-03-31T16:36:04.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.037+0000 7f9951732640 1 -- start start 2024-03-31T16:36:04.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f9951732640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f994c0d0540 0x7f994c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f9951732640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15da60 0x7f994c0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f9951732640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f994c15f900 0x7f994c0d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f9951732640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f994c160010 con 0x7f994c15da60 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f9951732640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f994c15fe90 con 0x7f994c15f900 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f9951732640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f994c160190 con 0x7f994c0d0540 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15da60 0x7f994c0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15da60 0x7f994c0b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37720/0 (socket says 172.21.15.120:37720) 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994a7fc640 1 -- 172.21.15.120:0/448582534 learned_addr learned my addr 172.21.15.120:0/448582534 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994affd640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f994c0d0540 0x7f994c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994b7fe640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f994c15f900 0x7f994c0d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994a7fc640 1 -- 172.21.15.120:0/448582534 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f994c0d0540 msgr2=0x7f994c0b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994a7fc640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f994c0d0540 0x7f994c0b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994a7fc640 1 -- 172.21.15.120:0/448582534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f994c15f900 msgr2=0x7f994c0d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.038+0000 7f994a7fc640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f994c15f900 0x7f994c0d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.039+0000 7f994a7fc640 1 -- 172.21.15.120:0/448582534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c14c710 con 0x7f994c15da60 2024-03-31T16:36:04.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.039+0000 7f994a7fc640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15da60 0x7f994c0b5820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f993400c400 tx=0x7f993400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.039+0000 7f99437fe640 1 -- 172.21.15.120:0/448582534 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99340052d0 con 0x7f994c15da60 2024-03-31T16:36:04.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.039+0000 7f99437fe640 1 -- 172.21.15.120:0/448582534 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9934005490 con 0x7f994c15da60 2024-03-31T16:36:04.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.039+0000 7f99437fe640 1 -- 172.21.15.120:0/448582534 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934007260 con 0x7f994c15da60 2024-03-31T16:36:04.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.039+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c0b7e90 con 0x7f994c15da60 2024-03-31T16:36:04.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.039+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c0cc980 con 0x7f994c15da60 2024-03-31T16:36:04.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.040+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994c068cd0 con 0x7f994c15da60 2024-03-31T16:36:04.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.040+0000 7f99437fe640 1 -- 172.21.15.120:0/448582534 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9934007400 con 0x7f994c15da60 2024-03-31T16:36:04.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.041+0000 7f99437fe640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f992c06c8f0 0x7f992c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.041+0000 7f99437fe640 1 -- 172.21.15.120:0/448582534 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f993408afa0 con 0x7f994c15da60 2024-03-31T16:36:04.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.041+0000 7f994affd640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f992c06c8f0 0x7f992c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.041+0000 7f994affd640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f992c06c8f0 0x7f992c06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f993c036000 tx=0x7f993c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.045+0000 7f99437fe640 1 -- 172.21.15.120:0/448582534 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9934058e10 con 0x7f994c15da60 2024-03-31T16:36:04.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.235+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f994c15ec50 con 0x7f994c15da60 2024-03-31T16:36:04.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.236+0000 7f99437fe640 1 -- 172.21.15.120:0/448582534 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f993405d110 con 0x7f994c15da60 2024-03-31T16:36:04.243 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-03-31T16:36:04.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f992c06c8f0 msgr2=0x7f992c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f992c06c8f0 0x7f992c06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f993c036000 tx=0x7f993c030000 comp rx=0 tx=0).stop 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15da60 msgr2=0x7f994c0b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15da60 0x7f994c0b5820 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f993400c400 tx=0x7f993400c8c0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 shutdown_connections 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f992c06c8f0 0x7f992c06edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f994c15f900 0x7f994c0d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f994c15da60 0x7f994c0b5820 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 --2- 172.21.15.120:0/448582534 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f994c0d0540 0x7f994c0b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 >> 172.21.15.120:0/448582534 conn(0x7f994c0b3e90 msgr2=0x7f994c0d2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 shutdown_connections 2024-03-31T16:36:04.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.238+0000 7f9951732640 1 -- 172.21.15.120:0/448582534 wait complete. 2024-03-31T16:36:04.251 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-31T16:36:04.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:04.252 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-31T16:36:04.280 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-03-31T16:36:04.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:04.280 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-31T16:36:04.338 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:36:04.338 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:04.353 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:36:04.353 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:04.408 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:36:04.409 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:04.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:04.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.562+0000 7f8b7f23c640 1 Processor -- start 2024-03-31T16:36:04.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.562+0000 7f8b7f23c640 1 -- start start 2024-03-31T16:36:04.568 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.563+0000 7f8b7f23c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8b780d43d0 0x7f8b780d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.563+0000 7f8b7f23c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b780d4d20 con 0x7f8b7815e860 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.563+0000 7f8b7f23c640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b7806dfa0 con 0x7f8b780cf6b0 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.563+0000 7f8b7f23c640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8b780cf220 con 0x7f8b780d43d0 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.563+0000 7f8b7cfd8640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8b7815e860 0x7f8b7806d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54350/0 (socket says 172.21.15.120:54350) 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.563+0000 7f8b7cfd8640 1 -- 172.21.15.120:0/2107749527 learned_addr learned my addr 172.21.15.120:0/2107749527 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.563+0000 7f8b77fff640 1 --2- 172.21.15.120:0/2107749527 >> v2:172.21.15.203:3300/0 conn(0x7f8b780d43d0 0x7f8b780d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.564+0000 7f8b777fe640 1 -- 172.21.15.120:0/2107749527 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775872797 0 0) 0x7f8b68001110 con 0x7f8b7815e860 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.564+0000 7f8b777fe640 1 -- 172.21.15.120:0/2107749527 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b60003520 con 0x7f8b7815e860 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.564+0000 7f8b777fe640 1 -- 172.21.15.120:0/2107749527 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680742677 0 0) 0x7f8b7806dfa0 con 0x7f8b780cf6b0 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.564+0000 7f8b777fe640 1 -- 172.21.15.120:0/2107749527 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b68001110 con 0x7f8b780cf6b0 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.564+0000 7f8b77fff640 1 -- 172.21.15.120:0/2107749527 >> v1:172.21.15.203:6789/0 conn(0x7f8b780cf6b0 legacy=0x7f8b780cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.564+0000 7f8b77fff640 1 -- 172.21.15.120:0/2107749527 >> v1:172.21.15.120:6789/0 conn(0x7f8b7815e860 legacy=0x7f8b7806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.564+0000 7f8b77fff640 1 -- 172.21.15.120:0/2107749527 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7806e240 con 0x7f8b780d43d0 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b77fff640 1 --2- 172.21.15.120:0/2107749527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 0x7f8b780d47e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b7806e170 tx=0x7f8b6c02b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e7e1809d6c1786a server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b777fe640 1 -- 172.21.15.120:0/2107749527 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c034070 con 0x7f8b780d43d0 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b777fe640 1 -- 172.21.15.120:0/2107749527 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6c030800 con 0x7f8b780d43d0 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b777fe640 1 -- 172.21.15.120:0/2107749527 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c030bb0 con 0x7f8b780d43d0 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2107749527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 msgr2=0x7f8b780d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b7f23c640 1 --2- 172.21.15.120:0/2107749527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 0x7f8b780d47e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b7806e170 tx=0x7f8b6c02b940 comp rx=0 tx=0).stop 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2107749527 shutdown_connections 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b7f23c640 1 --2- 172.21.15.120:0/2107749527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 0x7f8b780d47e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2107749527 >> 172.21.15.120:0/2107749527 conn(0x7f8b7809d7d0 msgr2=0x7f8b7808bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:04.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2107749527 shutdown_connections 2024-03-31T16:36:04.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.565+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2107749527 wait complete. 2024-03-31T16:36:04.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.566+0000 7f8b7f23c640 1 Processor -- start 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7f23c640 1 -- start start 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7f23c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b780cf6b0 0x7f8b781f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7f23c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 0x7f8b780cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7f23c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b7815e860 0x7f8b78153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7f23c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7806dc00 con 0x7f8b7815e860 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7f23c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8b780d2c50 con 0x7f8b780d43d0 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7f23c640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7806dd80 con 0x7f8b780cf6b0 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7d7d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b7815e860 0x7f8b78153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 0x7f8b780cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7d7d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b7815e860 0x7f8b78153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38492/0 (socket says 172.21.15.120:38492) 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.567+0000 7f8b7d7d9640 1 -- 172.21.15.120:0/2027338902 learned_addr learned my addr 172.21.15.120:0/2027338902 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7cfd8640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b780cf6b0 0x7f8b781f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7d7d9640 1 -- 172.21.15.120:0/2027338902 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b780cf6b0 msgr2=0x7f8b781f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7d7d9640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b780cf6b0 0x7f8b781f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7d7d9640 1 -- 172.21.15.120:0/2027338902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 msgr2=0x7f8b780cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7d7d9640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 0x7f8b780cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7d7d9640 1 -- 172.21.15.120:0/2027338902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b780caa50 con 0x7f8b7815e860 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7d7d9640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b7815e860 0x7f8b78153b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000c6e0 tx=0x7f8b7000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b757fa640 1 -- 172.21.15.120:0/2027338902 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70003b70 con 0x7f8b7815e860 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b757fa640 1 -- 172.21.15.120:0/2027338902 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b70003d10 con 0x7f8b7815e860 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b780c9c90 con 0x7f8b7815e860 2024-03-31T16:36:04.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b757fa640 1 -- 172.21.15.120:0/2027338902 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b700052d0 con 0x7f8b7815e860 2024-03-31T16:36:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.568+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b780ca250 con 0x7f8b7815e860 2024-03-31T16:36:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.569+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b780685c0 con 0x7f8b7815e860 2024-03-31T16:36:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.570+0000 7f8b757fa640 1 -- 172.21.15.120:0/2027338902 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b70005470 con 0x7f8b7815e860 2024-03-31T16:36:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.570+0000 7f8b757fa640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b6406c8f0 0x7f8b6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.570+0000 7f8b757fa640 1 -- 172.21.15.120:0/2027338902 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8b7008b850 con 0x7f8b7815e860 2024-03-31T16:36:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.570+0000 7f8b7cfd8640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b6406c8f0 0x7f8b6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.570+0000 7f8b7cfd8640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b6406c8f0 0x7f8b6406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b680013b0 tx=0x7f8b68007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.574+0000 7f8b757fa640 1 -- 172.21.15.120:0/2027338902 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8b700596c0 con 0x7f8b7815e860 2024-03-31T16:36:04.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.753+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b780d1390 con 0x7f8b7815e860 2024-03-31T16:36:04.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.754+0000 7f8b757fa640 1 -- 172.21.15.120:0/2027338902 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f8b7005d9c0 con 0x7f8b7815e860 2024-03-31T16:36:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:04.757 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:04.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b6406c8f0 msgr2=0x7f8b6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b6406c8f0 0x7f8b6406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b680013b0 tx=0x7f8b68007d30 comp rx=0 tx=0).stop 2024-03-31T16:36:04.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b7815e860 msgr2=0x7f8b78153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b7815e860 0x7f8b78153b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000c6e0 tx=0x7f8b7000cba0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 shutdown_connections 2024-03-31T16:36:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f8b6406c8f0 0x7f8b6406edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b7815e860 0x7f8b78153b50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b780d43d0 0x7f8b780cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 --2- 172.21.15.120:0/2027338902 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b780cf6b0 0x7f8b781f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 >> 172.21.15.120:0/2027338902 conn(0x7f8b7809d7d0 msgr2=0x7f8b780b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 shutdown_connections 2024-03-31T16:36:04.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.756+0000 7f8b7f23c640 1 -- 172.21.15.120:0/2027338902 wait complete. 2024-03-31T16:36:04.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:36:04.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:36:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.870+0000 7f5d75760640 1 Processor -- start 2024-03-31T16:36:04.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.870+0000 7f5d75760640 1 -- start start 2024-03-31T16:36:04.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d75760640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d7015d630 0x7f5d700c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d75760640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5d7015ca70 0x7f5d700cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d75760640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5d700d0370 0x7f5d700ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d75760640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f5d700d07c0 con 0x7f5d700d0370 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d75760640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5d700c7dd0 con 0x7f5d7015ca70 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d75760640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700c80b0 con 0x7f5d7015d630 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6f7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5d700d0370 0x7f5d700ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6f7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f5d700d0370 0x7f5d700ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38502/0 (socket says 172.21.15.120:38502) 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6f7fe640 1 -- 172.21.15.120:0/2271729235 learned_addr learned my addr 172.21.15.120:0/2271729235 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6effd640 1 --2- 172.21.15.120:0/2271729235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d7015d630 0x7f5d700c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6e7fc640 1 --2- 172.21.15.120:0/2271729235 >> v2:172.21.15.203:3300/0 conn(0x7f5d7015ca70 0x7f5d700cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6f7fe640 1 -- 172.21.15.120:0/2271729235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d7015d630 msgr2=0x7f5d700c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6f7fe640 1 --2- 172.21.15.120:0/2271729235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d7015d630 0x7f5d700c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6f7fe640 1 -- 172.21.15.120:0/2271729235 >> v2:172.21.15.203:3300/0 conn(0x7f5d7015ca70 msgr2=0x7f5d700cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6f7fe640 1 --2- 172.21.15.120:0/2271729235 >> v2:172.21.15.203:3300/0 conn(0x7f5d7015ca70 0x7f5d700cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.871+0000 7f5d6f7fe640 1 -- 172.21.15.120:0/2271729235 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d700c8390 con 0x7f5d700d0370 2024-03-31T16:36:04.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.872+0000 7f5d6f7fe640 1 --2- 172.21.15.120:0/2271729235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d700d0370 0x7f5d700ce8d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d70068260 tx=0x7f5d6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694b853b9503a9f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.872+0000 7f5d6dffb640 1 -- 172.21.15.120:0/2271729235 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68035020 con 0x7f5d700d0370 2024-03-31T16:36:04.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.872+0000 7f5d6dffb640 1 -- 172.21.15.120:0/2271729235 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d68031870 con 0x7f5d700d0370 2024-03-31T16:36:04.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.872+0000 7f5d6dffb640 1 -- 172.21.15.120:0/2271729235 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68031c40 con 0x7f5d700d0370 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 -- 172.21.15.120:0/2271729235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d700d0370 msgr2=0x7f5d700ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 --2- 172.21.15.120:0/2271729235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d700d0370 0x7f5d700ce8d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5d70068260 tx=0x7f5d6802b910 comp rx=0 tx=0).stop 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 -- 172.21.15.120:0/2271729235 shutdown_connections 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 --2- 172.21.15.120:0/2271729235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d700d0370 0x7f5d700ce8d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 --2- 172.21.15.120:0/2271729235 >> v2:172.21.15.203:3300/0 conn(0x7f5d7015ca70 0x7f5d700cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 --2- 172.21.15.120:0/2271729235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d7015d630 0x7f5d700c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 -- 172.21.15.120:0/2271729235 >> 172.21.15.120:0/2271729235 conn(0x7f5d700b3e90 msgr2=0x7f5d700b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 -- 172.21.15.120:0/2271729235 shutdown_connections 2024-03-31T16:36:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.873+0000 7f5d75760640 1 -- 172.21.15.120:0/2271729235 wait complete. 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.874+0000 7f5d75760640 1 Processor -- start 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.874+0000 7f5d75760640 1 -- start start 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d75760640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d700d0370 0x7f5d700b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d75760640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7015ca70 0x7f5d70148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d75760640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d7015d630 0x7f5d700cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d75760640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700c7af0 con 0x7f5d7015d630 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d75760640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700c7970 con 0x7f5d7015ca70 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d75760640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700cee10 con 0x7f5d700d0370 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d7015d630 0x7f5d700cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d7015d630 0x7f5d700cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38506/0 (socket says 172.21.15.120:38506) 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6f7fe640 1 -- 172.21.15.120:0/4238224012 learned_addr learned my addr 172.21.15.120:0/4238224012 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6effd640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d700d0370 0x7f5d700b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6e7fc640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7015ca70 0x7f5d70148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6f7fe640 1 -- 172.21.15.120:0/4238224012 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d700d0370 msgr2=0x7f5d700b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.881 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6f7fe640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d700d0370 0x7f5d700b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6f7fe640 1 -- 172.21.15.120:0/4238224012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7015ca70 msgr2=0x7f5d70148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6f7fe640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7015ca70 0x7f5d70148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.875+0000 7f5d6f7fe640 1 -- 172.21.15.120:0/4238224012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d700ca980 con 0x7f5d7015d630 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.876+0000 7f5d6f7fe640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d7015d630 0x7f5d700cba20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5d6802b950 tx=0x7f5d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.876+0000 7f5d577fe640 1 -- 172.21.15.120:0/4238224012 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68040070 con 0x7f5d7015d630 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.876+0000 7f5d577fe640 1 -- 172.21.15.120:0/4238224012 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d68030c20 con 0x7f5d7015d630 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.876+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d700cac60 con 0x7f5d7015d630 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.876+0000 7f5d577fe640 1 -- 172.21.15.120:0/4238224012 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68035040 con 0x7f5d7015d630 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.876+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d700cb220 con 0x7f5d7015d630 2024-03-31T16:36:04.882 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.877+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d70068cd0 con 0x7f5d7015d630 2024-03-31T16:36:04.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.877+0000 7f5d577fe640 1 -- 172.21.15.120:0/4238224012 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d68038020 con 0x7f5d7015d630 2024-03-31T16:36:04.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.878+0000 7f5d577fe640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5d5c06c8f0 0x7f5d5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:04.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.878+0000 7f5d577fe640 1 -- 172.21.15.120:0/4238224012 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5d680ad730 con 0x7f5d7015d630 2024-03-31T16:36:04.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.878+0000 7f5d6effd640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5d5c06c8f0 0x7f5d5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:04.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.878+0000 7f5d6effd640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5d5c06c8f0 0x7f5d5c06edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5d60011340 tx=0x7f5d6000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:04.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:04.882+0000 7f5d577fe640 1 -- 172.21.15.120:0/4238224012 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5d6807b510 con 0x7f5d7015d630 2024-03-31T16:36:05.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.054+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5d700b4d60 con 0x7f5d7015d630 2024-03-31T16:36:05.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.055+0000 7f5d577fe640 1 -- 172.21.15.120:0/4238224012 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5d6807f810 con 0x7f5d7015d630 2024-03-31T16:36:05.059 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:36:05.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5d5c06c8f0 msgr2=0x7f5d5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5d5c06c8f0 0x7f5d5c06edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5d60011340 tx=0x7f5d6000b040 comp rx=0 tx=0).stop 2024-03-31T16:36:05.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d7015d630 msgr2=0x7f5d700cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d7015d630 0x7f5d700cba20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5d6802b950 tx=0x7f5d680046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 shutdown_connections 2024-03-31T16:36:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5d5c06c8f0 0x7f5d5c06edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d7015d630 0x7f5d700cba20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d7015ca70 0x7f5d70148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 --2- 172.21.15.120:0/4238224012 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d700d0370 0x7f5d700b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.056+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 >> 172.21.15.120:0/4238224012 conn(0x7f5d700b3e90 msgr2=0x7f5d700b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.057+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 shutdown_connections 2024-03-31T16:36:05.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.057+0000 7f5d75760640 1 -- 172.21.15.120:0/4238224012 wait complete. 2024-03-31T16:36:05.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:36:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.171+0000 7fe26bc22640 1 Processor -- start 2024-03-31T16:36:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.171+0000 7fe26bc22640 1 -- start start 2024-03-31T16:36:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.172+0000 7fe26bc22640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe264070120 0x7fe26406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.172+0000 7fe26bc22640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe26406e770 0x7fe26406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.172+0000 7fe26bc22640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2640b5b10 con 0x7fe2640b0670 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.172+0000 7fe26bc22640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe2640b63e0 con 0x7fe26406e770 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.172+0000 7fe26bc22640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe26406c3f0 con 0x7fe264070120 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.172+0000 7fe26a1bf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe26406e770 0x7fe26406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe26a1bf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe26406e770 0x7fe26406bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38510/0 (socket says 172.21.15.120:38510) 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe26a1bf640 1 -- 172.21.15.120:0/1678870623 learned_addr learned my addr 172.21.15.120:0/1678870623 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe2691bd640 1 --2- 172.21.15.120:0/1678870623 >> v2:172.21.15.203:3300/0 conn(0x7fe264070120 0x7fe26406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe26a1bf640 1 -- 172.21.15.120:0/1678870623 >> v2:172.21.15.203:3300/0 conn(0x7fe264070120 msgr2=0x7fe26406b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe26a1bf640 1 --2- 172.21.15.120:0/1678870623 >> v2:172.21.15.203:3300/0 conn(0x7fe264070120 0x7fe26406b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe26a1bf640 1 -- 172.21.15.120:0/1678870623 >> v1:172.21.15.203:6789/0 conn(0x7fe2640b0670 legacy=0x7fe26415f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe2689bc640 1 -- 172.21.15.120:0/1678870623 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449806442 0 0) 0x7fe260001490 con 0x7fe2640b0670 2024-03-31T16:36:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe26a1bf640 1 -- 172.21.15.120:0/1678870623 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2640705e0 con 0x7fe26406e770 2024-03-31T16:36:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.173+0000 7fe26a1bf640 1 --2- 172.21.15.120:0/1678870623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe26406e770 0x7fe26406bab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe2640cdaa0 tx=0x7fe25c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8369a7830d44c735 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe2689bc640 1 -- 172.21.15.120:0/1678870623 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c034070 con 0x7fe26406e770 2024-03-31T16:36:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe2689bc640 1 -- 172.21.15.120:0/1678870623 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c030860 con 0x7fe26406e770 2024-03-31T16:36:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe2689bc640 1 -- 172.21.15.120:0/1678870623 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c030c30 con 0x7fe26406e770 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe26bc22640 1 -- 172.21.15.120:0/1678870623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe26406e770 msgr2=0x7fe26406bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe26bc22640 1 --2- 172.21.15.120:0/1678870623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe26406e770 0x7fe26406bab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe2640cdaa0 tx=0x7fe25c02b9a0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe26bc22640 1 -- 172.21.15.120:0/1678870623 shutdown_connections 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe26bc22640 1 --2- 172.21.15.120:0/1678870623 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe26406e770 0x7fe26406bab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe26bc22640 1 --2- 172.21.15.120:0/1678870623 >> v2:172.21.15.203:3300/0 conn(0x7fe264070120 0x7fe26406b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe26bc22640 1 -- 172.21.15.120:0/1678870623 >> 172.21.15.120:0/1678870623 conn(0x7fe2640b65a0 msgr2=0x7fe2640b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe26bc22640 1 -- 172.21.15.120:0/1678870623 shutdown_connections 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.174+0000 7fe26bc22640 1 -- 172.21.15.120:0/1678870623 wait complete. 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.175+0000 7fe26bc22640 1 Processor -- start 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.175+0000 7fe26bc22640 1 -- start start 2024-03-31T16:36:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26bc22640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe26406e770 0x7fe26413ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26bc22640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe264070120 0x7fe264160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26bc22640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2640b0670 0x7fe264161490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26bc22640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe2640b0a50 con 0x7fe2640b0670 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26bc22640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2640b6070 con 0x7fe26406e770 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26bc22640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe264168450 con 0x7fe264070120 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26a1bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2640b0670 0x7fe264161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26a1bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2640b0670 0x7fe264161490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38526/0 (socket says 172.21.15.120:38526) 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26a1bf640 1 -- 172.21.15.120:0/3086399261 learned_addr learned my addr 172.21.15.120:0/3086399261 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe2699be640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe26406e770 0x7fe26413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe2691bd640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe264070120 0x7fe264160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26a1bf640 1 -- 172.21.15.120:0/3086399261 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe264070120 msgr2=0x7fe264160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26a1bf640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe264070120 0x7fe264160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26a1bf640 1 -- 172.21.15.120:0/3086399261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe26406e770 msgr2=0x7fe26413ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26a1bf640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe26406e770 0x7fe26413ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.176+0000 7fe26a1bf640 1 -- 172.21.15.120:0/3086399261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe264160270 con 0x7fe2640b0670 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.177+0000 7fe26a1bf640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2640b0670 0x7fe264161490 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0090b0 tx=0x7fe25c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.177+0000 7fe25a7fc640 1 -- 172.21.15.120:0/3086399261 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c034040 con 0x7fe2640b0670 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.177+0000 7fe25a7fc640 1 -- 172.21.15.120:0/3086399261 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c030660 con 0x7fe2640b0670 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.177+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe264147890 con 0x7fe2640b0670 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.177+0000 7fe25a7fc640 1 -- 172.21.15.120:0/3086399261 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c039d20 con 0x7fe2640b0670 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.177+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2641607f0 con 0x7fe2640b0670 2024-03-31T16:36:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.178+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe264068cd0 con 0x7fe2640b0670 2024-03-31T16:36:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.178+0000 7fe25a7fc640 1 -- 172.21.15.120:0/3086399261 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe25c037070 con 0x7fe2640b0670 2024-03-31T16:36:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.179+0000 7fe25a7fc640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe24806c8f0 0x7fe24806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.179+0000 7fe25a7fc640 1 -- 172.21.15.120:0/3086399261 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe25c0ad790 con 0x7fe2640b0670 2024-03-31T16:36:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.179+0000 7fe2699be640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe24806c8f0 0x7fe24806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.179+0000 7fe2699be640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe24806c8f0 0x7fe24806edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe2600012e0 tx=0x7fe260009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.183+0000 7fe25a7fc640 1 -- 172.21.15.120:0/3086399261 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe25c07b570 con 0x7fe2640b0670 2024-03-31T16:36:05.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.356+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe2640d0a60 con 0x7fe2640b0670 2024-03-31T16:36:05.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.357+0000 7fe25a7fc640 1 -- 172.21.15.120:0/3086399261 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe25c07f870 con 0x7fe2640b0670 2024-03-31T16:36:05.360 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe24806c8f0 msgr2=0x7fe24806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe24806c8f0 0x7fe24806edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe2600012e0 tx=0x7fe260009040 comp rx=0 tx=0).stop 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2640b0670 msgr2=0x7fe264161490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2640b0670 0x7fe264161490 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0090b0 tx=0x7fe25c0046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 shutdown_connections 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe24806c8f0 0x7fe24806edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2640b0670 0x7fe264161490 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe264070120 0x7fe264160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.358+0000 7fe26bc22640 1 --2- 172.21.15.120:0/3086399261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe26406e770 0x7fe26413ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.359+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 >> 172.21.15.120:0/3086399261 conn(0x7fe2640b65a0 msgr2=0x7fe264141370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:05.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.359+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 shutdown_connections 2024-03-31T16:36:05.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.359+0000 7fe26bc22640 1 -- 172.21.15.120:0/3086399261 wait complete. 2024-03-31T16:36:05.372 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:36:05.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.472+0000 7f659710e640 1 Processor -- start 2024-03-31T16:36:05.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.473+0000 7f659710e640 1 -- start start 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.473+0000 7f659710e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6590155550 0x7f6590155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.473+0000 7f659710e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 0x7f65900d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.473+0000 7f659710e640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f65900d07c0 0x7f65900aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.473+0000 7f659710e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f65900d0c30 con 0x7f6590155550 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.473+0000 7f659710e640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f65900b40b0 con 0x7f65900d07c0 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.473+0000 7f659710e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f65900b4390 con 0x7f659015f800 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.473+0000 7f6594eaa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6590155550 0x7f6590155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f65956ab640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f65900d07c0 0x7f65900aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f6594eaa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6590155550 0x7f6590155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38536/0 (socket says 172.21.15.120:38536) 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f6594eaa640 1 -- 172.21.15.120:0/1228691712 learned_addr learned my addr 172.21.15.120:0/1228691712 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f658ffff640 1 --2- 172.21.15.120:0/1228691712 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 0x7f65900d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f6594eaa640 1 -- 172.21.15.120:0/1228691712 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 msgr2=0x7f65900d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f6594eaa640 1 --2- 172.21.15.120:0/1228691712 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 0x7f65900d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f6594eaa640 1 -- 172.21.15.120:0/1228691712 >> v2:172.21.15.203:3300/0 conn(0x7f65900d07c0 msgr2=0x7f65900aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:05.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f6594eaa640 1 --2- 172.21.15.120:0/1228691712 >> v2:172.21.15.203:3300/0 conn(0x7f65900d07c0 0x7f65900aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f6594eaa640 1 -- 172.21.15.120:0/1228691712 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65900b4670 con 0x7f6590155550 2024-03-31T16:36:05.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.474+0000 7f6594eaa640 1 --2- 172.21.15.120:0/1228691712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6590155550 0x7f6590155930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f65900713d0 tx=0x7f658002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dd6c341e60903f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f658f7fe640 1 -- 172.21.15.120:0/1228691712 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580035020 con 0x7f6590155550 2024-03-31T16:36:05.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f658f7fe640 1 -- 172.21.15.120:0/1228691712 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6580031870 con 0x7f6590155550 2024-03-31T16:36:05.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f658f7fe640 1 -- 172.21.15.120:0/1228691712 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580031c40 con 0x7f6590155550 2024-03-31T16:36:05.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 -- 172.21.15.120:0/1228691712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6590155550 msgr2=0x7f6590155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 --2- 172.21.15.120:0/1228691712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6590155550 0x7f6590155930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f65900713d0 tx=0x7f658002b910 comp rx=0 tx=0).stop 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 -- 172.21.15.120:0/1228691712 shutdown_connections 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 --2- 172.21.15.120:0/1228691712 >> v2:172.21.15.203:3300/0 conn(0x7f65900d07c0 0x7f65900aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 --2- 172.21.15.120:0/1228691712 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 0x7f65900d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 --2- 172.21.15.120:0/1228691712 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6590155550 0x7f6590155930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 -- 172.21.15.120:0/1228691712 >> 172.21.15.120:0/1228691712 conn(0x7f659006b750 msgr2=0x7f659006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 -- 172.21.15.120:0/1228691712 shutdown_connections 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.475+0000 7f659710e640 1 -- 172.21.15.120:0/1228691712 wait complete. 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.476+0000 7f659710e640 1 Processor -- start 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.476+0000 7f659710e640 1 -- start start 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f659710e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65900d07c0 0x7f65900b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f659710e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6590155550 0x7f659006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f659710e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 0x7f6590153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f659710e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f659015fc80 con 0x7f65900d07c0 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f659710e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f65900b4c30 con 0x7f6590155550 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f659710e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f659015ba20 con 0x7f659015f800 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f6594eaa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65900d07c0 0x7f65900b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f6594eaa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65900d07c0 0x7f65900b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38542/0 (socket says 172.21.15.120:38542) 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f6594eaa640 1 -- 172.21.15.120:0/790432364 learned_addr learned my addr 172.21.15.120:0/790432364 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f658ffff640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6590155550 0x7f659006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.477+0000 7f65956ab640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 0x7f6590153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f6594eaa640 1 -- 172.21.15.120:0/790432364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 msgr2=0x7f6590153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f6594eaa640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 0x7f6590153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f6594eaa640 1 -- 172.21.15.120:0/790432364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6590155550 msgr2=0x7f659006dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f6594eaa640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6590155550 0x7f659006dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f6594eaa640 1 -- 172.21.15.120:0/790432364 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6590159b30 con 0x7f65900d07c0 2024-03-31T16:36:05.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f6594eaa640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65900d07c0 0x7f65900b0a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6580000c00 tx=0x7f65800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f658d7fa640 1 -- 172.21.15.120:0/790432364 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580035040 con 0x7f65900d07c0 2024-03-31T16:36:05.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f658d7fa640 1 -- 172.21.15.120:0/790432364 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6580030d00 con 0x7f65900d07c0 2024-03-31T16:36:05.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6590159e10 con 0x7f65900d07c0 2024-03-31T16:36:05.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f658d7fa640 1 -- 172.21.15.120:0/790432364 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65800456a0 con 0x7f65900d07c0 2024-03-31T16:36:05.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.478+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659015a3d0 con 0x7f65900d07c0 2024-03-31T16:36:05.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.479+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f659006bb30 con 0x7f65900d07c0 2024-03-31T16:36:05.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.479+0000 7f658d7fa640 1 -- 172.21.15.120:0/790432364 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6580038020 con 0x7f65900d07c0 2024-03-31T16:36:05.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.480+0000 7f658d7fa640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f657c06c8f0 0x7f657c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.480+0000 7f658ffff640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f657c06c8f0 0x7f657c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.480+0000 7f658d7fa640 1 -- 172.21.15.120:0/790432364 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f65800adc10 con 0x7f65900d07c0 2024-03-31T16:36:05.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.480+0000 7f658ffff640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f657c06c8f0 0x7f657c06edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f65900b0f40 tx=0x7f658400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.484+0000 7f658d7fa640 1 -- 172.21.15.120:0/790432364 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f659006bb30 con 0x7f65900d07c0 2024-03-31T16:36:05.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.657+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f65900685c0 con 0x7f65900d07c0 2024-03-31T16:36:05.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.658+0000 7f658d7fa640 1 -- 172.21.15.120:0/790432364 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f658007ba80 con 0x7f65900d07c0 2024-03-31T16:36:05.661 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f657c06c8f0 msgr2=0x7f657c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f657c06c8f0 0x7f657c06edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f65900b0f40 tx=0x7f658400d040 comp rx=0 tx=0).stop 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65900d07c0 msgr2=0x7f65900b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65900d07c0 0x7f65900b0a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6580000c00 tx=0x7f65800046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 shutdown_connections 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f657c06c8f0 0x7f657c06edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f659015f800 0x7f6590153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6590155550 0x7f659006dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 --2- 172.21.15.120:0/790432364 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65900d07c0 0x7f65900b0a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.659+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 >> 172.21.15.120:0/790432364 conn(0x7f659006b750 msgr2=0x7f659006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.660+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 shutdown_connections 2024-03-31T16:36:05.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.660+0000 7f659710e640 1 -- 172.21.15.120:0/790432364 wait complete. 2024-03-31T16:36:05.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-31T16:36:05.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.772+0000 7f1cff8e4640 1 Processor -- start 2024-03-31T16:36:05.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.773+0000 7f1cff8e4640 1 -- start start 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.773+0000 7f1cff8e4640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1cf815e860 0x7f1cf806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.773+0000 7f1cff8e4640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf806da30 0x7f1cf80d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.773+0000 7f1cff8e4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf806dfa0 con 0x7f1cf80d4910 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.773+0000 7f1cff8e4640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1cf80d4d60 con 0x7f1cf815e860 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.773+0000 7f1cff8e4640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf80cf220 con 0x7f1cf806da30 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.773+0000 7f1cfde81640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1cf80d4910 0x7f1cf80d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54354/0 (socket says 172.21.15.120:54354) 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1cfde81640 1 -- 172.21.15.120:0/3737996086 learned_addr learned my addr 172.21.15.120:0/3737996086 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1cfd680640 1 --2- 172.21.15.120:0/3737996086 >> v2:172.21.15.203:3300/0 conn(0x7f1cf815e860 0x7f1cf806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1cfce7f640 1 --2- 172.21.15.120:0/3737996086 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf806da30 0x7f1cf80d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1ceffff640 1 -- 172.21.15.120:0/3737996086 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229324014 0 0) 0x7f1cf806dfa0 con 0x7f1cf80d4910 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1ceffff640 1 -- 172.21.15.120:0/3737996086 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ce4003520 con 0x7f1cf80d4910 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1cfce7f640 1 -- 172.21.15.120:0/3737996086 >> v2:172.21.15.203:3300/0 conn(0x7f1cf815e860 msgr2=0x7f1cf806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1cfce7f640 1 --2- 172.21.15.120:0/3737996086 >> v2:172.21.15.203:3300/0 conn(0x7f1cf815e860 0x7f1cf806d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1cfce7f640 1 -- 172.21.15.120:0/3737996086 >> v1:172.21.15.120:6789/0 conn(0x7f1cf80d4910 legacy=0x7f1cf80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1cfce7f640 1 -- 172.21.15.120:0/3737996086 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf806e240 con 0x7f1cf806da30 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.774+0000 7f1cfd680640 1 --2- 172.21.15.120:0/3737996086 >> v2:172.21.15.203:3300/0 conn(0x7f1cf815e860 0x7f1cf806d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cfce7f640 1 --2- 172.21.15.120:0/3737996086 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf806da30 0x7f1cf80d43d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80097a0 tx=0x7f1ce802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78546949fa491110 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1ceffff640 1 -- 172.21.15.120:0/3737996086 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8035020 con 0x7f1cf806da30 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1ceffff640 1 -- 172.21.15.120:0/3737996086 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce8031830 con 0x7f1cf806da30 2024-03-31T16:36:05.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1ceffff640 1 -- 172.21.15.120:0/3737996086 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8031c00 con 0x7f1cf806da30 2024-03-31T16:36:05.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cff8e4640 1 -- 172.21.15.120:0/3737996086 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf806da30 msgr2=0x7f1cf80d43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/3737996086 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf806da30 0x7f1cf80d43d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80097a0 tx=0x7f1ce802b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cff8e4640 1 -- 172.21.15.120:0/3737996086 shutdown_connections 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/3737996086 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf806da30 0x7f1cf80d43d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/3737996086 >> v2:172.21.15.203:3300/0 conn(0x7f1cf815e860 0x7f1cf806d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cff8e4640 1 -- 172.21.15.120:0/3737996086 >> 172.21.15.120:0/3737996086 conn(0x7f1cf809d7d0 msgr2=0x7f1cf808bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cff8e4640 1 -- 172.21.15.120:0/3737996086 shutdown_connections 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.775+0000 7f1cff8e4640 1 -- 172.21.15.120:0/3737996086 wait complete. 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cff8e4640 1 Processor -- start 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cff8e4640 1 -- start start 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cff8e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cf806da30 0x7f1cf80b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cff8e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf80d4910 0x7f1cf80b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cff8e4640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf815e860 0x7f1cf80c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cff8e4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf80cedb0 con 0x7f1cf80d4910 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cff8e4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf80d2c50 con 0x7f1cf806da30 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cff8e4640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf80cef30 con 0x7f1cf815e860 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cfce7f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf80d4910 0x7f1cf80b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cfce7f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf80d4910 0x7f1cf80b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38552/0 (socket says 172.21.15.120:38552) 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cfce7f640 1 -- 172.21.15.120:0/2893366197 learned_addr learned my addr 172.21.15.120:0/2893366197 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cfde81640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf815e860 0x7f1cf80c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.777+0000 7f1cfd680640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cf806da30 0x7f1cf80b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cfce7f640 1 -- 172.21.15.120:0/2893366197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf815e860 msgr2=0x7f1cf80c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cfce7f640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf815e860 0x7f1cf80c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cfce7f640 1 -- 172.21.15.120:0/2893366197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cf806da30 msgr2=0x7f1cf80b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cfce7f640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cf806da30 0x7f1cf80b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cfce7f640 1 -- 172.21.15.120:0/2893366197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf80cb510 con 0x7f1cf80d4910 2024-03-31T16:36:05.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cfce7f640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf80d4910 0x7f1cf80b6450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ce802bee0 tx=0x7f1ce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cedffb640 1 -- 172.21.15.120:0/2893366197 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8035040 con 0x7f1cf80d4910 2024-03-31T16:36:05.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cedffb640 1 -- 172.21.15.120:0/2893366197 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce803b920 con 0x7f1cf80d4910 2024-03-31T16:36:05.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cedffb640 1 -- 172.21.15.120:0/2893366197 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce803bd10 con 0x7f1cf80d4910 2024-03-31T16:36:05.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf80b9c60 con 0x7f1cf80d4910 2024-03-31T16:36:05.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.778+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf80cbab0 con 0x7f1cf80d4910 2024-03-31T16:36:05.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.779+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf80685c0 con 0x7f1cf80d4910 2024-03-31T16:36:05.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.780+0000 7f1cedffb640 1 -- 172.21.15.120:0/2893366197 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ce8038020 con 0x7f1cf80d4910 2024-03-31T16:36:05.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.780+0000 7f1cedffb640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cdc06c8f0 0x7f1cdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:05.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.780+0000 7f1cedffb640 1 -- 172.21.15.120:0/2893366197 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1ce80ada40 con 0x7f1cf80d4910 2024-03-31T16:36:05.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.780+0000 7f1cfd680640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cdc06c8f0 0x7f1cdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:05.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.780+0000 7f1cfd680640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cdc06c8f0 0x7f1cdc06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009560 tx=0x7f1cf4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:05.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.784+0000 7f1cedffb640 1 -- 172.21.15.120:0/2893366197 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1ce807b820 con 0x7f1cf80d4910 2024-03-31T16:36:05.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.969+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1cf80d0680 con 0x7f1cf80d4910 2024-03-31T16:36:05.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.970+0000 7f1cedffb640 1 -- 172.21.15.120:0/2893366197 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f1ce807fb20 con 0x7f1cf80d4910 2024-03-31T16:36:05.973 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-03-31T16:36:05.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.971+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cdc06c8f0 msgr2=0x7f1cdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cdc06c8f0 0x7f1cdc06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009560 tx=0x7f1cf4009190 comp rx=0 tx=0).stop 2024-03-31T16:36:05.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf80d4910 msgr2=0x7f1cf80b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf80d4910 0x7f1cf80b6450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ce802bee0 tx=0x7f1ce80046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 shutdown_connections 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cdc06c8f0 0x7f1cdc06edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cf815e860 0x7f1cf80c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cf80d4910 0x7f1cf80b6450 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 --2- 172.21.15.120:0/2893366197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cf806da30 0x7f1cf80b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 >> 172.21.15.120:0/2893366197 conn(0x7f1cf809d7d0 msgr2=0x7f1cf80b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 shutdown_connections 2024-03-31T16:36:05.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:05.972+0000 7f1cff8e4640 1 -- 172.21.15.120:0/2893366197 wait complete. 2024-03-31T16:36:05.985 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-31T16:36:05.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:05.986 DEBUG:teuthology.orchestra.run.smithi203:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-31T16:36:06.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-03-31T16:36:06.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:06.018 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-31T16:36:06.082 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:36:06.083 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:06.098 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:36:06.098 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:06.153 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:36:06.153 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:06.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:06.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.347+0000 7f3e4e086640 1 Processor -- start 2024-03-31T16:36:06.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.347+0000 7f3e4e086640 1 -- start start 2024-03-31T16:36:06.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.347+0000 7f3e4e086640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d0e70 0x7f3e480cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.347+0000 7f3e4e086640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3e480d2110 0x7f3e480d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.347+0000 7f3e4e086640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e480cf6c0 con 0x7f3e4815f6e0 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.347+0000 7f3e4e086640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3e480cf9a0 con 0x7f3e480d2110 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.347+0000 7f3e4e086640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e480cfc80 con 0x7f3e480d0e70 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d0e70 0x7f3e480cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e47fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3e480d2110 0x7f3e480d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e47fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3e480d2110 0x7f3e480d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:41636/0 (socket says 172.21.15.120:41636) 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e47fff640 1 -- 172.21.15.120:0/3533336930 learned_addr learned my addr 172.21.15.120:0/3533336930 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d0e70 0x7f3e480cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:44294/0 (socket says 172.21.15.120:44294) 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e47fff640 1 -- 172.21.15.120:0/3533336930 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d0e70 msgr2=0x7f3e480cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e47fff640 1 --2- 172.21.15.120:0/3533336930 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d0e70 0x7f3e480cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e47fff640 1 -- 172.21.15.120:0/3533336930 >> v1:172.21.15.203:6789/0 conn(0x7f3e4815f6e0 legacy=0x7f3e480d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e47fff640 1 -- 172.21.15.120:0/3533336930 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e480cff60 con 0x7f3e480d2110 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e46ffd640 1 -- 172.21.15.120:0/3533336930 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278094819 0 0) 0x7f3e480cf6c0 con 0x7f3e4815f6e0 2024-03-31T16:36:06.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.348+0000 7f3e477fe640 1 --2- 172.21.15.120:0/3533336930 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d0e70 0x7f3e480cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:06.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.349+0000 7f3e47fff640 1 --2- 172.21.15.120:0/3533336930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e480d2110 0x7f3e480d25a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009e50 tx=0x7f3e4002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dca0e5021bccbfc server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:06.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.349+0000 7f3e46ffd640 1 -- 172.21.15.120:0/3533336930 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4002ca70 con 0x7f3e480d2110 2024-03-31T16:36:06.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.349+0000 7f3e46ffd640 1 -- 172.21.15.120:0/3533336930 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4002cc10 con 0x7f3e480d2110 2024-03-31T16:36:06.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.349+0000 7f3e46ffd640 1 -- 172.21.15.120:0/3533336930 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e400343f0 con 0x7f3e480d2110 2024-03-31T16:36:06.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.350+0000 7f3e4e086640 1 -- 172.21.15.120:0/3533336930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e480d2110 msgr2=0x7f3e480d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.350+0000 7f3e4e086640 1 --2- 172.21.15.120:0/3533336930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e480d2110 0x7f3e480d25a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009e50 tx=0x7f3e4002bed0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.350+0000 7f3e4e086640 1 -- 172.21.15.120:0/3533336930 shutdown_connections 2024-03-31T16:36:06.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.350+0000 7f3e4e086640 1 --2- 172.21.15.120:0/3533336930 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e480d2110 0x7f3e480d25a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.350+0000 7f3e4e086640 1 --2- 172.21.15.120:0/3533336930 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d0e70 0x7f3e480cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.350+0000 7f3e4e086640 1 -- 172.21.15.120:0/3533336930 >> 172.21.15.120:0/3533336930 conn(0x7f3e4808bfb0 msgr2=0x7f3e480d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:06.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.350+0000 7f3e4e086640 1 -- 172.21.15.120:0/3533336930 shutdown_connections 2024-03-31T16:36:06.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.350+0000 7f3e4e086640 1 -- 172.21.15.120:0/3533336930 wait complete. 2024-03-31T16:36:06.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.351+0000 7f3e4e086640 1 Processor -- start 2024-03-31T16:36:06.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.351+0000 7f3e4e086640 1 -- start start 2024-03-31T16:36:06.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.351+0000 7f3e4e086640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e480d0e70 0x7f3e480ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.351+0000 7f3e4e086640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d2110 0x7f3e480cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.351+0000 7f3e4e086640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e4815f6e0 0x7f3e4815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.351+0000 7f3e4e086640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4815e910 con 0x7f3e480d0e70 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.351+0000 7f3e4e086640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4815fb40 con 0x7f3e4815f6e0 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.351+0000 7f3e4e086640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4815ea90 con 0x7f3e480d2110 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e480d0e70 0x7f3e480ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e480d0e70 0x7f3e480ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38556/0 (socket says 172.21.15.120:38556) 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 -- 172.21.15.120:0/224628986 learned_addr learned my addr 172.21.15.120:0/224628986 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e47fff640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e4815f6e0 0x7f3e4815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e3ffff640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d2110 0x7f3e480cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 -- 172.21.15.120:0/224628986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d2110 msgr2=0x7f3e480cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d2110 0x7f3e480cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 -- 172.21.15.120:0/224628986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e4815f6e0 msgr2=0x7f3e4815a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e4815f6e0 0x7f3e4815a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 -- 172.21.15.120:0/224628986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e480cbca0 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e477fe640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e480d0e70 0x7f3e480ca9d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800e960 tx=0x7f3e3800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e44ff9640 1 -- 172.21.15.120:0/224628986 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38017070 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e44ff9640 1 -- 172.21.15.120:0/224628986 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3800ca00 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e44ff9640 1 -- 172.21.15.120:0/224628986 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3800cdd0 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e480cbf80 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.352+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e480cc540 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.353+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e48068cd0 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.354+0000 7f3e44ff9640 1 -- 172.21.15.120:0/224628986 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e3801a070 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.354+0000 7f3e44ff9640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3e2806c8f0 0x7f3e2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.354+0000 7f3e44ff9640 1 -- 172.21.15.120:0/224628986 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e3808bce0 con 0x7f3e480d0e70 2024-03-31T16:36:06.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.354+0000 7f3e3ffff640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3e2806c8f0 0x7f3e2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.355+0000 7f3e3ffff640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3e2806c8f0 0x7f3e2806edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e480a2350 tx=0x7f3e30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:06.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.358+0000 7f3e44ff9640 1 -- 172.21.15.120:0/224628986 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3e38059ad0 con 0x7f3e480d0e70 2024-03-31T16:36:06.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.534+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e480d1710 con 0x7f3e480d0e70 2024-03-31T16:36:06.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.535+0000 7f3e44ff9640 1 -- 172.21.15.120:0/224628986 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f3e3805ddd0 con 0x7f3e480d0e70 2024-03-31T16:36:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:06.538 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:06.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3e2806c8f0 msgr2=0x7f3e2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3e2806c8f0 0x7f3e2806edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e480a2350 tx=0x7f3e30009040 comp rx=0 tx=0).stop 2024-03-31T16:36:06.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e480d0e70 msgr2=0x7f3e480ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e480d0e70 0x7f3e480ca9d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800e960 tx=0x7f3e3800ee20 comp rx=0 tx=0).stop 2024-03-31T16:36:06.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 shutdown_connections 2024-03-31T16:36:06.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3e2806c8f0 0x7f3e2806edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e4815f6e0 0x7f3e4815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e480d2110 0x7f3e480cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 --2- 172.21.15.120:0/224628986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e480d0e70 0x7f3e480ca9d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 >> 172.21.15.120:0/224628986 conn(0x7f3e4808bfb0 msgr2=0x7f3e4815ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:06.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 shutdown_connections 2024-03-31T16:36:06.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.537+0000 7f3e4e086640 1 -- 172.21.15.120:0/224628986 wait complete. 2024-03-31T16:36:06.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:36:06.552 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:36:06.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.652+0000 7f267b311640 1 Processor -- start 2024-03-31T16:36:06.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.652+0000 7f267b311640 1 -- start start 2024-03-31T16:36:06.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f267b311640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2674153580 0x7f26740d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f267b311640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26740d07c0 0x7f26740aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f267b311640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26740afab0 con 0x7f26740af2e0 2024-03-31T16:36:06.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f267b311640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f26740d0c00 con 0x7f2674153580 2024-03-31T16:36:06.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f267b311640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f267415cc80 con 0x7f26740d07c0 2024-03-31T16:36:06.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f26790ad640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2674153580 0x7f26740d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f26798ae640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f26740af2e0 0x7f267406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54360/0 (socket says 172.21.15.120:54360) 2024-03-31T16:36:06.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f26798ae640 1 -- 172.21.15.120:0/2522959496 learned_addr learned my addr 172.21.15.120:0/2522959496 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f26788ac640 1 --2- 172.21.15.120:0/2522959496 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26740d07c0 0x7f26740aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f266bfff640 1 -- 172.21.15.120:0/2522959496 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3881811646 0 0) 0x7f26740afab0 con 0x7f26740af2e0 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f266bfff640 1 -- 172.21.15.120:0/2522959496 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2660003520 con 0x7f26740af2e0 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f26790ad640 1 -- 172.21.15.120:0/2522959496 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26740d07c0 msgr2=0x7f26740aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f26790ad640 1 --2- 172.21.15.120:0/2522959496 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26740d07c0 0x7f26740aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f26790ad640 1 -- 172.21.15.120:0/2522959496 >> v1:172.21.15.120:6789/0 conn(0x7f26740af2e0 legacy=0x7f267406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.653+0000 7f26790ad640 1 -- 172.21.15.120:0/2522959496 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267415da00 con 0x7f2674153580 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f26790ad640 1 --2- 172.21.15.120:0/2522959496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674153580 0x7f26740d0280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26700097a0 tx=0x7f267002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79380f74ba1f1b68 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f266bfff640 1 -- 172.21.15.120:0/2522959496 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26700315a0 con 0x7f2674153580 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f266bfff640 1 -- 172.21.15.120:0/2522959496 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2670037070 con 0x7f2674153580 2024-03-31T16:36:06.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f266bfff640 1 -- 172.21.15.120:0/2522959496 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2670031960 con 0x7f2674153580 2024-03-31T16:36:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f267b311640 1 -- 172.21.15.120:0/2522959496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674153580 msgr2=0x7f26740d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f267b311640 1 --2- 172.21.15.120:0/2522959496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674153580 0x7f26740d0280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26700097a0 tx=0x7f267002b840 comp rx=0 tx=0).stop 2024-03-31T16:36:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f267b311640 1 -- 172.21.15.120:0/2522959496 shutdown_connections 2024-03-31T16:36:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f267b311640 1 --2- 172.21.15.120:0/2522959496 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f26740d07c0 0x7f26740aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f267b311640 1 --2- 172.21.15.120:0/2522959496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2674153580 0x7f26740d0280 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.654+0000 7f267b311640 1 -- 172.21.15.120:0/2522959496 >> 172.21.15.120:0/2522959496 conn(0x7f267406b750 msgr2=0x7f267406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.655+0000 7f267b311640 1 -- 172.21.15.120:0/2522959496 shutdown_connections 2024-03-31T16:36:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.655+0000 7f267b311640 1 -- 172.21.15.120:0/2522959496 wait complete. 2024-03-31T16:36:06.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f267b311640 1 Processor -- start 2024-03-31T16:36:06.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f267b311640 1 -- start start 2024-03-31T16:36:06.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f267b311640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26740af2e0 0x7f26741f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f267b311640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26740d07c0 0x7f267414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f267b311640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2674153580 0x7f267414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f267b311640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f267415d4e0 con 0x7f26740d07c0 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f267b311640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f267415d200 con 0x7f26740af2e0 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f267b311640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2674153960 con 0x7f2674153580 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.656+0000 7f26788ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26740d07c0 0x7f267414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26788ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26740d07c0 0x7f267414d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38572/0 (socket says 172.21.15.120:38572) 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26788ac640 1 -- 172.21.15.120:0/3325249797 learned_addr learned my addr 172.21.15.120:0/3325249797 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26790ad640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26740af2e0 0x7f26741f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26798ae640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2674153580 0x7f267414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26788ac640 1 -- 172.21.15.120:0/3325249797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2674153580 msgr2=0x7f267414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26788ac640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2674153580 0x7f267414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26788ac640 1 -- 172.21.15.120:0/3325249797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26740af2e0 msgr2=0x7f26741f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26788ac640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26740af2e0 0x7f26741f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26788ac640 1 -- 172.21.15.120:0/3325249797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26740ccbf0 con 0x7f26740d07c0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f26788ac640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26740d07c0 0x7f267414d380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f266400e870 tx=0x7f266400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f2669ffb640 1 -- 172.21.15.120:0/3325249797 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664017070 con 0x7f26740d07c0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f2669ffb640 1 -- 172.21.15.120:0/3325249797 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266400c940 con 0x7f26740d07c0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f2669ffb640 1 -- 172.21.15.120:0/3325249797 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266400cd30 con 0x7f26740d07c0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2674150670 con 0x7f26740d07c0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.657+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26740cd170 con 0x7f26740d07c0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.658+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26740685c0 con 0x7f26740d07c0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.659+0000 7f2669ffb640 1 -- 172.21.15.120:0/3325249797 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f266401a070 con 0x7f26740d07c0 2024-03-31T16:36:06.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.659+0000 7f2669ffb640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f265806c8f0 0x7f265806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.659+0000 7f2669ffb640 1 -- 172.21.15.120:0/3325249797 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f266408b8e0 con 0x7f26740d07c0 2024-03-31T16:36:06.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.659+0000 7f26790ad640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f265806c8f0 0x7f265806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.660+0000 7f26790ad640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f265806c8f0 0x7f265806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2670036000 tx=0x7f267003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:06.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.664+0000 7f2669ffb640 1 -- 172.21.15.120:0/3325249797 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2664059750 con 0x7f26740d07c0 2024-03-31T16:36:06.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.836+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f267406eca0 con 0x7f26740d07c0 2024-03-31T16:36:06.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.837+0000 7f2669ffb640 1 -- 172.21.15.120:0/3325249797 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f266405da50 con 0x7f26740d07c0 2024-03-31T16:36:06.885 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:36:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f265806c8f0 msgr2=0x7f265806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f265806c8f0 0x7f265806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2670036000 tx=0x7f267003d040 comp rx=0 tx=0).stop 2024-03-31T16:36:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26740d07c0 msgr2=0x7f267414d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26740d07c0 0x7f267414d380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f266400e870 tx=0x7f266400ed30 comp rx=0 tx=0).stop 2024-03-31T16:36:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 shutdown_connections 2024-03-31T16:36:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f265806c8f0 0x7f265806edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2674153580 0x7f267414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26740d07c0 0x7f267414d380 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 --2- 172.21.15.120:0/3325249797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26740af2e0 0x7f26741f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 >> 172.21.15.120:0/3325249797 conn(0x7f267406b750 msgr2=0x7f26740ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:06.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 shutdown_connections 2024-03-31T16:36:06.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.839+0000 7f267b311640 1 -- 172.21.15.120:0/3325249797 wait complete. 2024-03-31T16:36:06.887 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:36:06.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.986+0000 7f6cb0042640 1 Processor -- start 2024-03-31T16:36:06.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cb0042640 1 -- start start 2024-03-31T16:36:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cb0042640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ca8155550 0x7f6ca8155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cb0042640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6ca815f800 0x7f6ca80d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cb0042640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca80b40b0 con 0x7f6ca80d07c0 2024-03-31T16:36:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cb0042640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca80d0bf0 con 0x7f6ca8155550 2024-03-31T16:36:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cb0042640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca80b4390 con 0x7f6ca815f800 2024-03-31T16:36:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6caddde640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6ca8155550 0x7f6ca8155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cae5df640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6ca80d07c0 0x7f6ca80aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54372/0 (socket says 172.21.15.120:54372) 2024-03-31T16:36:06.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cae5df640 1 -- 172.21.15.120:0/3368352367 learned_addr learned my addr 172.21.15.120:0/3368352367 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6caddde640 1 --2- 172.21.15.120:0/3368352367 >> v2:172.21.15.120:3300/0 conn(0x7f6ca8155550 0x7f6ca8155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38576/0 (socket says 172.21.15.120:38576) 2024-03-31T16:36:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.987+0000 7f6cad5dd640 1 --2- 172.21.15.120:0/3368352367 >> v2:172.21.15.203:3300/0 conn(0x7f6ca815f800 0x7f6ca80d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.988+0000 7f6caddde640 1 -- 172.21.15.120:0/3368352367 >> v2:172.21.15.203:3300/0 conn(0x7f6ca815f800 msgr2=0x7f6ca80d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.988+0000 7f6caddde640 1 --2- 172.21.15.120:0/3368352367 >> v2:172.21.15.203:3300/0 conn(0x7f6ca815f800 0x7f6ca80d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.988+0000 7f6caddde640 1 -- 172.21.15.120:0/3368352367 >> v1:172.21.15.120:6789/0 conn(0x7f6ca80d07c0 legacy=0x7f6ca80aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.988+0000 7f6caddde640 1 -- 172.21.15.120:0/3368352367 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca80b4670 con 0x7f6ca8155550 2024-03-31T16:36:06.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.988+0000 7f6cacddc640 1 -- 172.21.15.120:0/3368352367 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306013672 0 0) 0x7f6ca80b40b0 con 0x7f6ca80d07c0 2024-03-31T16:36:06.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.988+0000 7f6caddde640 1 --2- 172.21.15.120:0/3368352367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca8155930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80d0dd0 tx=0x7f6ca402e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534873dfa63e3921 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:06.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cacddc640 1 -- 172.21.15.120:0/3368352367 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca402e9d0 con 0x7f6ca8155550 2024-03-31T16:36:06.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cacddc640 1 -- 172.21.15.120:0/3368352367 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca402eb70 con 0x7f6ca8155550 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cacddc640 1 -- 172.21.15.120:0/3368352367 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4009540 con 0x7f6ca8155550 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cb0042640 1 -- 172.21.15.120:0/3368352367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 msgr2=0x7f6ca8155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cb0042640 1 --2- 172.21.15.120:0/3368352367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca8155930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80d0dd0 tx=0x7f6ca402e030 comp rx=0 tx=0).stop 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cb0042640 1 -- 172.21.15.120:0/3368352367 shutdown_connections 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cb0042640 1 --2- 172.21.15.120:0/3368352367 >> v2:172.21.15.203:3300/0 conn(0x7f6ca815f800 0x7f6ca80d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cb0042640 1 --2- 172.21.15.120:0/3368352367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca8155930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cb0042640 1 -- 172.21.15.120:0/3368352367 >> 172.21.15.120:0/3368352367 conn(0x7f6ca806b750 msgr2=0x7f6ca806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cb0042640 1 -- 172.21.15.120:0/3368352367 shutdown_connections 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.989+0000 7f6cb0042640 1 -- 172.21.15.120:0/3368352367 wait complete. 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.990+0000 7f6cb0042640 1 Processor -- start 2024-03-31T16:36:06.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.990+0000 7f6cb0042640 1 -- start start 2024-03-31T16:36:06.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cb0042640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ca80d07c0 0x7f6ca8153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cb0042640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca80aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cb0042640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ca815f800 0x7f6ca81efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cb0042640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca815fc80 con 0x7f6ca8155550 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cb0042640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca80b4c30 con 0x7f6ca80d07c0 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cb0042640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca815ba20 con 0x7f6ca815f800 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cad5dd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca80aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cad5dd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca80aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38588/0 (socket says 172.21.15.120:38588) 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cad5dd640 1 -- 172.21.15.120:0/572566044 learned_addr learned my addr 172.21.15.120:0/572566044 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6caddde640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ca80d07c0 0x7f6ca8153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.991+0000 7f6cae5df640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ca815f800 0x7f6ca81efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6cad5dd640 1 -- 172.21.15.120:0/572566044 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ca815f800 msgr2=0x7f6ca81efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6cad5dd640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ca815f800 0x7f6ca81efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6cad5dd640 1 -- 172.21.15.120:0/572566044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ca80d07c0 msgr2=0x7f6ca8153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6cad5dd640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ca80d07c0 0x7f6ca8153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6cad5dd640 1 -- 172.21.15.120:0/572566044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca809cfe0 con 0x7f6ca8155550 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6cad5dd640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca80aff90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800e9e0 tx=0x7f6c9800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6c9e7fc640 1 -- 172.21.15.120:0/572566044 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98017070 con 0x7f6ca8155550 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6c9e7fc640 1 -- 172.21.15.120:0/572566044 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9800c970 con 0x7f6ca8155550 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca80b0c60 con 0x7f6ca8155550 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6c9e7fc640 1 -- 172.21.15.120:0/572566044 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800cd60 con 0x7f6ca8155550 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.992+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca80af790 con 0x7f6ca8155550 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.993+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca80685c0 con 0x7f6ca8155550 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.994+0000 7f6c9e7fc640 1 -- 172.21.15.120:0/572566044 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c9801a070 con 0x7f6ca8155550 2024-03-31T16:36:06.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.994+0000 7f6c9e7fc640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6c8c06c8f0 0x7f6c8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:06.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.994+0000 7f6c9e7fc640 1 -- 172.21.15.120:0/572566044 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c9808bdf0 con 0x7f6ca8155550 2024-03-31T16:36:06.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.994+0000 7f6caddde640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6c8c06c8f0 0x7f6c8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:06.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.995+0000 7f6caddde640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6c8c06c8f0 0x7f6c8c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4037000 tx=0x7f6ca4032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:07.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:06.998+0000 7f6c9e7fc640 1 -- 172.21.15.120:0/572566044 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6c98059bd0 con 0x7f6ca8155550 2024-03-31T16:36:07.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.173+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6ca80b3ad0 con 0x7f6ca8155550 2024-03-31T16:36:07.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.173+0000 7f6c9e7fc640 1 -- 172.21.15.120:0/572566044 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6c9805ded0 con 0x7f6ca8155550 2024-03-31T16:36:07.177 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6c8c06c8f0 msgr2=0x7f6c8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6c8c06c8f0 0x7f6c8c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4037000 tx=0x7f6ca4032000 comp rx=0 tx=0).stop 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 msgr2=0x7f6ca80aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca80aff90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800e9e0 tx=0x7f6c9800eea0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 shutdown_connections 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6c8c06c8f0 0x7f6c8c06edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ca815f800 0x7f6ca81efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ca8155550 0x7f6ca80aff90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 --2- 172.21.15.120:0/572566044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ca80d07c0 0x7f6ca8153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 >> 172.21.15.120:0/572566044 conn(0x7f6ca806b750 msgr2=0x7f6ca815ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 shutdown_connections 2024-03-31T16:36:07.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.175+0000 7f6cb0042640 1 -- 172.21.15.120:0/572566044 wait complete. 2024-03-31T16:36:07.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:36:07.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.289+0000 7f84c15eb640 1 Processor -- start 2024-03-31T16:36:07.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.289+0000 7f84c15eb640 1 -- start start 2024-03-31T16:36:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84c15eb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc0d43d0 0x7f84bc0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84c15eb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f84bc0cf6b0 0x7f84bc0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84c15eb640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84bc06dfa0 con 0x7f84bc15e860 2024-03-31T16:36:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84c15eb640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc0cf220 con 0x7f84bc0cf6b0 2024-03-31T16:36:07.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84c15eb640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc0d4cf0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84bb7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f84bc0cf6b0 0x7f84bc0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84baffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f84bc15e860 0x7f84bc06d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54374/0 (socket says 172.21.15.120:54374) 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84baffd640 1 -- 172.21.15.120:0/2573968791 learned_addr learned my addr 172.21.15.120:0/2573968791 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84ba7fc640 1 --2- 172.21.15.120:0/2573968791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc0d43d0 0x7f84bc0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84bb7fe640 1 -- 172.21.15.120:0/2573968791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc0d43d0 msgr2=0x7f84bc0d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84bb7fe640 1 --2- 172.21.15.120:0/2573968791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc0d43d0 0x7f84bc0d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84bb7fe640 1 -- 172.21.15.120:0/2573968791 >> v1:172.21.15.120:6789/0 conn(0x7f84bc15e860 legacy=0x7f84bc06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84bb7fe640 1 -- 172.21.15.120:0/2573968791 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc06e240 con 0x7f84bc0cf6b0 2024-03-31T16:36:07.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.290+0000 7f84b9ffb640 1 -- 172.21.15.120:0/2573968791 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622375955 0 0) 0x7f84bc06dfa0 con 0x7f84bc15e860 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.291+0000 7f84bb7fe640 1 --2- 172.21.15.120:0/2573968791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0cf6b0 0x7f84bc0cfb00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f84bc06e170 tx=0x7f84b402be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568873f356c87e3f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.291+0000 7f84b9ffb640 1 -- 172.21.15.120:0/2573968791 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4039070 con 0x7f84bc0cf6b0 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.291+0000 7f84b9ffb640 1 -- 172.21.15.120:0/2573968791 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b402cc40 con 0x7f84bc0cf6b0 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.291+0000 7f84b9ffb640 1 -- 172.21.15.120:0/2573968791 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4034440 con 0x7f84bc0cf6b0 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.291+0000 7f84c15eb640 1 -- 172.21.15.120:0/2573968791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0cf6b0 msgr2=0x7f84bc0cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.291+0000 7f84c15eb640 1 --2- 172.21.15.120:0/2573968791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0cf6b0 0x7f84bc0cfb00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f84bc06e170 tx=0x7f84b402be90 comp rx=0 tx=0).stop 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.291+0000 7f84c15eb640 1 -- 172.21.15.120:0/2573968791 shutdown_connections 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.291+0000 7f84c15eb640 1 --2- 172.21.15.120:0/2573968791 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0cf6b0 0x7f84bc0cfb00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.292+0000 7f84c15eb640 1 --2- 172.21.15.120:0/2573968791 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc0d43d0 0x7f84bc0d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.292+0000 7f84c15eb640 1 -- 172.21.15.120:0/2573968791 >> 172.21.15.120:0/2573968791 conn(0x7f84bc09d7d0 msgr2=0x7f84bc08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.292+0000 7f84c15eb640 1 -- 172.21.15.120:0/2573968791 shutdown_connections 2024-03-31T16:36:07.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.292+0000 7f84c15eb640 1 -- 172.21.15.120:0/2573968791 wait complete. 2024-03-31T16:36:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.293+0000 7f84c15eb640 1 Processor -- start 2024-03-31T16:36:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.293+0000 7f84c15eb640 1 -- start start 2024-03-31T16:36:07.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84c15eb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84bc0cf6b0 0x7f84bc1f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84c15eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0d43d0 0x7f84bc0b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84c15eb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc15e860 0x7f84bc15fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84c15eb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc06dc00 con 0x7f84bc0d43d0 2024-03-31T16:36:07.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84c15eb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0d2c50 con 0x7f84bc0cf6b0 2024-03-31T16:36:07.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84c15eb640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc06dd80 con 0x7f84bc15e860 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0d43d0 0x7f84bc0b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0d43d0 0x7f84bc0b7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38600/0 (socket says 172.21.15.120:38600) 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 -- 172.21.15.120:0/187823044 learned_addr learned my addr 172.21.15.120:0/187823044 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84baffd640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84bc0cf6b0 0x7f84bc1f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84bb7fe640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc15e860 0x7f84bc15fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 -- 172.21.15.120:0/187823044 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc15e860 msgr2=0x7f84bc15fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc15e860 0x7f84bc15fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 -- 172.21.15.120:0/187823044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84bc0cf6b0 msgr2=0x7f84bc1f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84bc0cf6b0 0x7f84bc1f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 -- 172.21.15.120:0/187823044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc1f44a0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84ba7fc640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0d43d0 0x7f84bc0b7060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f84b000e9b0 tx=0x7f84b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84a37fe640 1 -- 172.21.15.120:0/187823044 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0017070 con 0x7f84bc0d43d0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84a37fe640 1 -- 172.21.15.120:0/187823044 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b000c9a0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc0b9c10 con 0x7f84bc0d43d0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84a37fe640 1 -- 172.21.15.120:0/187823044 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b000cd90 con 0x7f84bc0d43d0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.294+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc0ba1d0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.295+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84bc0cbdd0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.296+0000 7f84a37fe640 1 -- 172.21.15.120:0/187823044 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84b001a070 con 0x7f84bc0d43d0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.296+0000 7f84a37fe640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f84a806c8f0 0x7f84a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.296+0000 7f84baffd640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f84a806c8f0 0x7f84a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.296+0000 7f84a37fe640 1 -- 172.21.15.120:0/187823044 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f84b008bea0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.297+0000 7f84baffd640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f84a806c8f0 0x7f84a806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f84ac007fd0 tx=0x7f84ac007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.301+0000 7f84a37fe640 1 -- 172.21.15.120:0/187823044 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f84b0059bf0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.475+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f84bc0685c0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.475+0000 7f84a37fe640 1 -- 172.21.15.120:0/187823044 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f84b005def0 con 0x7f84bc0d43d0 2024-03-31T16:36:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f84a806c8f0 msgr2=0x7f84a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f84a806c8f0 0x7f84a806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f84ac007fd0 tx=0x7f84ac007de0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0d43d0 msgr2=0x7f84bc0b7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0d43d0 0x7f84bc0b7060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f84b000e9b0 tx=0x7f84b000ee70 comp rx=0 tx=0).stop 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 shutdown_connections 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f84a806c8f0 0x7f84a806edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84bc15e860 0x7f84bc15fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84bc0d43d0 0x7f84bc0b7060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 --2- 172.21.15.120:0/187823044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84bc0cf6b0 0x7f84bc1f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 >> 172.21.15.120:0/187823044 conn(0x7f84bc09d7d0 msgr2=0x7f84bc0b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 shutdown_connections 2024-03-31T16:36:07.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.477+0000 7f84c15eb640 1 -- 172.21.15.120:0/187823044 wait complete. 2024-03-31T16:36:07.491 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-31T16:36:07.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.589+0000 7fc666c55640 1 Processor -- start 2024-03-31T16:36:07.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.589+0000 7fc666c55640 1 -- start start 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.589+0000 7fc666c55640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc660155550 0x7fc660155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc666c55640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc66015f800 0x7fc6600d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc666c55640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6600b40b0 con 0x7fc6600d07c0 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc666c55640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fc6600d0c30 con 0x7fc660155550 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc666c55640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc6600b4390 con 0x7fc66015f800 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc6649f1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc660155550 0x7fc660155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc6651f2640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc6600d07c0 0x7fc6600aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54388/0 (socket says 172.21.15.120:54388) 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc6651f2640 1 -- 172.21.15.120:0/993213413 learned_addr learned my addr 172.21.15.120:0/993213413 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc65ffff640 1 --2- 172.21.15.120:0/993213413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc66015f800 0x7fc6600d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc65f7fe640 1 -- 172.21.15.120:0/993213413 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133696476 0 0) 0x7fc6600b40b0 con 0x7fc6600d07c0 2024-03-31T16:36:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc65f7fe640 1 -- 172.21.15.120:0/993213413 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc64c003520 con 0x7fc6600d07c0 2024-03-31T16:36:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc6649f1640 1 -- 172.21.15.120:0/993213413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc66015f800 msgr2=0x7fc6600d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc6649f1640 1 --2- 172.21.15.120:0/993213413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc66015f800 0x7fc6600d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc6649f1640 1 -- 172.21.15.120:0/993213413 >> v1:172.21.15.120:6789/0 conn(0x7fc6600d07c0 legacy=0x7fc6600aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.590+0000 7fc6649f1640 1 -- 172.21.15.120:0/993213413 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6600b4670 con 0x7fc660155550 2024-03-31T16:36:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc6649f1640 1 --2- 172.21.15.120:0/993213413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660155930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc658009d90 tx=0x7fc65802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f32c9a161dd4505 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc65f7fe640 1 -- 172.21.15.120:0/993213413 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658039070 con 0x7fc660155550 2024-03-31T16:36:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc65f7fe640 1 -- 172.21.15.120:0/993213413 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65802cc50 con 0x7fc660155550 2024-03-31T16:36:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc65f7fe640 1 -- 172.21.15.120:0/993213413 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658034440 con 0x7fc660155550 2024-03-31T16:36:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc666c55640 1 -- 172.21.15.120:0/993213413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 msgr2=0x7fc660155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc666c55640 1 --2- 172.21.15.120:0/993213413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660155930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc658009d90 tx=0x7fc65802bea0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc666c55640 1 -- 172.21.15.120:0/993213413 shutdown_connections 2024-03-31T16:36:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc666c55640 1 --2- 172.21.15.120:0/993213413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc66015f800 0x7fc6600d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc666c55640 1 --2- 172.21.15.120:0/993213413 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660155930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.591+0000 7fc666c55640 1 -- 172.21.15.120:0/993213413 >> 172.21.15.120:0/993213413 conn(0x7fc66006b750 msgr2=0x7fc66006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.592+0000 7fc666c55640 1 -- 172.21.15.120:0/993213413 shutdown_connections 2024-03-31T16:36:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.592+0000 7fc666c55640 1 -- 172.21.15.120:0/993213413 wait complete. 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.593+0000 7fc666c55640 1 Processor -- start 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.593+0000 7fc666c55640 1 -- start start 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.593+0000 7fc666c55640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6600d07c0 0x7fc6601e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.593+0000 7fc666c55640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.593+0000 7fc666c55640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc66015f800 0x7fc6601f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.593+0000 7fc666c55640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc66015fc80 con 0x7fc660155550 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.593+0000 7fc666c55640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc6600b4c30 con 0x7fc66015f800 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.593+0000 7fc666c55640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc66015ba20 con 0x7fc6600d07c0 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660099900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38608/0 (socket says 172.21.15.120:38608) 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 -- 172.21.15.120:0/3016487969 learned_addr learned my addr 172.21.15.120:0/3016487969 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc6649f1640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6600d07c0 0x7fc6601e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc6651f2640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc66015f800 0x7fc6601f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 -- 172.21.15.120:0/3016487969 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6600d07c0 msgr2=0x7fc6601e4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6600d07c0 0x7fc6601e4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 -- 172.21.15.120:0/3016487969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc66015f800 msgr2=0x7fc6601f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc66015f800 0x7fc6601f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 -- 172.21.15.120:0/3016487969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6601f2b70 con 0x7fc660155550 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65ffff640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660099900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc64800e9b0 tx=0x7fc64800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65d7fa640 1 -- 172.21.15.120:0/3016487969 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648017070 con 0x7fc660155550 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65d7fa640 1 -- 172.21.15.120:0/3016487969 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64800c9a0 con 0x7fc660155550 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6601f2e50 con 0x7fc660155550 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc65d7fa640 1 -- 172.21.15.120:0/3016487969 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64800cd90 con 0x7fc660155550 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.594+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66009ccf0 con 0x7fc660155550 2024-03-31T16:36:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.595+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6600685c0 con 0x7fc660155550 2024-03-31T16:36:07.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.596+0000 7fc65d7fa640 1 -- 172.21.15.120:0/3016487969 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc64801a070 con 0x7fc660155550 2024-03-31T16:36:07.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.596+0000 7fc65d7fa640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc64006c8f0 0x7fc64006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:07.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.596+0000 7fc65d7fa640 1 -- 172.21.15.120:0/3016487969 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc64808bab0 con 0x7fc660155550 2024-03-31T16:36:07.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.596+0000 7fc6649f1640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc64006c8f0 0x7fc64006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:07.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.597+0000 7fc6649f1640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc64006c8f0 0x7fc64006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc658036000 tx=0x7fc658030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:07.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.600+0000 7fc65d7fa640 1 -- 172.21.15.120:0/3016487969 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc648059890 con 0x7fc660155550 2024-03-31T16:36:07.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.786+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc6600b3ad0 con 0x7fc660155550 2024-03-31T16:36:07.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.786+0000 7fc65d7fa640 1 -- 172.21.15.120:0/3016487969 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fc64805db90 con 0x7fc660155550 2024-03-31T16:36:07.790 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc64006c8f0 msgr2=0x7fc64006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc64006c8f0 0x7fc64006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc658036000 tx=0x7fc658030000 comp rx=0 tx=0).stop 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 msgr2=0x7fc660099900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660099900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc64800e9b0 tx=0x7fc64800ee70 comp rx=0 tx=0).stop 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 shutdown_connections 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc64006c8f0 0x7fc64006edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc66015f800 0x7fc6601f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc660155550 0x7fc660099900 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 --2- 172.21.15.120:0/3016487969 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6600d07c0 0x7fc6601e4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:07.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 >> 172.21.15.120:0/3016487969 conn(0x7fc66006b750 msgr2=0x7fc6600725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:07.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 shutdown_connections 2024-03-31T16:36:07.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:07.789+0000 7fc666c55640 1 -- 172.21.15.120:0/3016487969 wait complete. 2024-03-31T16:36:07.802 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-31T16:36:07.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:07.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-31T16:36:07.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-03-31T16:36:07.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:07.831 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-31T16:36:07.886 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:36:07.886 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:07.901 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:36:07.901 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:07.957 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-03-31T16:36:07.957 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:08.011 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:08.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.109+0000 7f78df700640 1 Processor -- start 2024-03-31T16:36:08.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.109+0000 7f78df700640 1 -- start start 2024-03-31T16:36:08.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78df700640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f78d8155930 0x7f78d80d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78df700640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f78d80d07c0 0x7f78d80aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78df700640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d80b40b0 con 0x7f78d8155550 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78df700640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f78d80d0c10 con 0x7f78d80d07c0 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78df700640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f78d80b4390 con 0x7f78d8155930 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78ddc9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f78d80d07c0 0x7f78d80aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78dd49c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f78d8155550 0x7f78d815f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54392/0 (socket says 172.21.15.120:54392) 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78dd49c640 1 -- 172.21.15.120:0/1987605904 learned_addr learned my addr 172.21.15.120:0/1987605904 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78dcc9b640 1 --2- 172.21.15.120:0/1987605904 >> v2:172.21.15.203:3300/0 conn(0x7f78d8155930 0x7f78d80d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78ddc9d640 1 -- 172.21.15.120:0/1987605904 >> v2:172.21.15.203:3300/0 conn(0x7f78d8155930 msgr2=0x7f78d80d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78ddc9d640 1 --2- 172.21.15.120:0/1987605904 >> v2:172.21.15.203:3300/0 conn(0x7f78d8155930 0x7f78d80d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78ddc9d640 1 -- 172.21.15.120:0/1987605904 >> v1:172.21.15.120:6789/0 conn(0x7f78d8155550 legacy=0x7f78d815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78ddc9d640 1 -- 172.21.15.120:0/1987605904 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d80b4670 con 0x7f78d80d07c0 2024-03-31T16:36:08.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.110+0000 7f78cffff640 1 -- 172.21.15.120:0/1987605904 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917376177 0 0) 0x7f78d80b40b0 con 0x7f78d8155550 2024-03-31T16:36:08.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.111+0000 7f78ddc9d640 1 --2- 172.21.15.120:0/1987605904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d80aede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f78d8073970 tx=0x7f78d002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb876051bb96bd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.111+0000 7f78cffff640 1 -- 172.21.15.120:0/1987605904 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0039070 con 0x7f78d80d07c0 2024-03-31T16:36:08.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.111+0000 7f78cffff640 1 -- 172.21.15.120:0/1987605904 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d002cbf0 con 0x7f78d80d07c0 2024-03-31T16:36:08.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.111+0000 7f78cffff640 1 -- 172.21.15.120:0/1987605904 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0034440 con 0x7f78d80d07c0 2024-03-31T16:36:08.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.112+0000 7f78df700640 1 -- 172.21.15.120:0/1987605904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 msgr2=0x7f78d80aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.112+0000 7f78df700640 1 --2- 172.21.15.120:0/1987605904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d80aede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f78d8073970 tx=0x7f78d002be40 comp rx=0 tx=0).stop 2024-03-31T16:36:08.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.112+0000 7f78df700640 1 -- 172.21.15.120:0/1987605904 shutdown_connections 2024-03-31T16:36:08.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.112+0000 7f78df700640 1 --2- 172.21.15.120:0/1987605904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d80aede0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.112+0000 7f78df700640 1 --2- 172.21.15.120:0/1987605904 >> v2:172.21.15.203:3300/0 conn(0x7f78d8155930 0x7f78d80d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.112+0000 7f78df700640 1 -- 172.21.15.120:0/1987605904 >> 172.21.15.120:0/1987605904 conn(0x7f78d806b750 msgr2=0x7f78d806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:08.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.112+0000 7f78df700640 1 -- 172.21.15.120:0/1987605904 shutdown_connections 2024-03-31T16:36:08.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.112+0000 7f78df700640 1 -- 172.21.15.120:0/1987605904 wait complete. 2024-03-31T16:36:08.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.113+0000 7f78df700640 1 Processor -- start 2024-03-31T16:36:08.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.113+0000 7f78df700640 1 -- start start 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78df700640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d8099b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78df700640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78d8155550 0x7f78d80add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78df700640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78d8155930 0x7f78d809aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78df700640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f78d815ba20 con 0x7f78d80d07c0 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78df700640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f78d80b4c30 con 0x7f78d8155930 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78df700640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f78d815bba0 con 0x7f78d8155550 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d8099b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d8099b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38624/0 (socket says 172.21.15.120:38624) 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 -- 172.21.15.120:0/380129825 learned_addr learned my addr 172.21.15.120:0/380129825 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dcc9b640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78d8155550 0x7f78d80add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78ddc9d640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78d8155930 0x7f78d809aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 -- 172.21.15.120:0/380129825 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78d8155550 msgr2=0x7f78d80add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78d8155550 0x7f78d80add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 -- 172.21.15.120:0/380129825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78d8155930 msgr2=0x7f78d809aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78d8155930 0x7f78d809aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 -- 172.21.15.120:0/380129825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d80aead0 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78dd49c640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d8099b70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f78d400c500 tx=0x7f78d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78cdffb640 1 -- 172.21.15.120:0/380129825 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4018070 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78cdffb640 1 -- 172.21.15.120:0/380129825 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d4007580 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d80aedb0 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.114+0000 7f78cdffb640 1 -- 172.21.15.120:0/380129825 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4004a20 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.115+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d80af370 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.116+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d80685c0 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.116+0000 7f78cdffb640 1 -- 172.21.15.120:0/380129825 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78d401b070 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.116+0000 7f78cdffb640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f78bc06c8f0 0x7f78bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.116+0000 7f78cdffb640 1 -- 172.21.15.120:0/380129825 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f78d408ad70 con 0x7f78d80d07c0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.116+0000 7f78dcc9b640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f78bc06c8f0 0x7f78bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.117+0000 7f78dcc9b640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f78bc06c8f0 0x7f78bc06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f78d815bf60 tx=0x7f78c8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.121+0000 7f78cdffb640 1 -- 172.21.15.120:0/380129825 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f78d4058be0 con 0x7f78d80d07c0 2024-03-31T16:36:08.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.298+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78d80b3ad0 con 0x7f78d80d07c0 2024-03-31T16:36:08.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.299+0000 7f78cdffb640 1 -- 172.21.15.120:0/380129825 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f78d405cee0 con 0x7f78d80d07c0 2024-03-31T16:36:08.303 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:08.303 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:08.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f78bc06c8f0 msgr2=0x7f78bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f78bc06c8f0 0x7f78bc06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f78d815bf60 tx=0x7f78c8009190 comp rx=0 tx=0).stop 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 msgr2=0x7f78d8099b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d8099b70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f78d400c500 tx=0x7f78d400c9c0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 shutdown_connections 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f78bc06c8f0 0x7f78bc06edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f78d8155930 0x7f78d809aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f78d8155550 0x7f78d80add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 --2- 172.21.15.120:0/380129825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f78d80d07c0 0x7f78d8099b70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 >> 172.21.15.120:0/380129825 conn(0x7f78d806b750 msgr2=0x7f78d806ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 shutdown_connections 2024-03-31T16:36:08.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.301+0000 7f78df700640 1 -- 172.21.15.120:0/380129825 wait complete. 2024-03-31T16:36:08.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:36:08.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:36:08.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.416+0000 7f71cb311640 1 Processor -- start 2024-03-31T16:36:08.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.417+0000 7f71cb311640 1 -- start start 2024-03-31T16:36:08.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.417+0000 7f71cb311640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c415e860 0x7f71c406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.417+0000 7f71cb311640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f71c406da30 0x7f71c40d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.417+0000 7f71cb311640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71c40d4910 0x7f71c40d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.417+0000 7f71cb311640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f71c40d4d60 con 0x7f71c40d4910 2024-03-31T16:36:08.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.417+0000 7f71cb311640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f71c40cf220 con 0x7f71c406da30 2024-03-31T16:36:08.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.417+0000 7f71cb311640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f71c406dfa0 con 0x7f71c415e860 2024-03-31T16:36:08.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c98ae640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71c40d4910 0x7f71c40d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c98ae640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f71c40d4910 0x7f71c40d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38628/0 (socket says 172.21.15.120:38628) 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c98ae640 1 -- 172.21.15.120:0/136482000 learned_addr learned my addr 172.21.15.120:0/136482000 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c88ac640 1 --2- 172.21.15.120:0/136482000 >> v2:172.21.15.203:3300/0 conn(0x7f71c406da30 0x7f71c40d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c90ad640 1 --2- 172.21.15.120:0/136482000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c415e860 0x7f71c406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c98ae640 1 -- 172.21.15.120:0/136482000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c415e860 msgr2=0x7f71c406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c98ae640 1 --2- 172.21.15.120:0/136482000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c415e860 0x7f71c406d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c98ae640 1 -- 172.21.15.120:0/136482000 >> v2:172.21.15.203:3300/0 conn(0x7f71c406da30 msgr2=0x7f71c40d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c98ae640 1 --2- 172.21.15.120:0/136482000 >> v2:172.21.15.203:3300/0 conn(0x7f71c406da30 0x7f71c40d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.418+0000 7f71c98ae640 1 -- 172.21.15.120:0/136482000 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c406e240 con 0x7f71c40d4910 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71c98ae640 1 --2- 172.21.15.120:0/136482000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c40d4910 0x7f71c40d0e30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71c408e770 tx=0x7f71bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a719c0987ec34f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71bbfff640 1 -- 172.21.15.120:0/136482000 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc035020 con 0x7f71c40d4910 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71bbfff640 1 -- 172.21.15.120:0/136482000 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc031870 con 0x7f71c40d4910 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71bbfff640 1 -- 172.21.15.120:0/136482000 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc031c40 con 0x7f71c40d4910 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 -- 172.21.15.120:0/136482000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c40d4910 msgr2=0x7f71c40d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 --2- 172.21.15.120:0/136482000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c40d4910 0x7f71c40d0e30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f71c408e770 tx=0x7f71bc02b910 comp rx=0 tx=0).stop 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 -- 172.21.15.120:0/136482000 shutdown_connections 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 --2- 172.21.15.120:0/136482000 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c40d4910 0x7f71c40d0e30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 --2- 172.21.15.120:0/136482000 >> v2:172.21.15.203:3300/0 conn(0x7f71c406da30 0x7f71c40d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 --2- 172.21.15.120:0/136482000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c415e860 0x7f71c406d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 -- 172.21.15.120:0/136482000 >> 172.21.15.120:0/136482000 conn(0x7f71c409d7d0 msgr2=0x7f71c408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:08.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 -- 172.21.15.120:0/136482000 shutdown_connections 2024-03-31T16:36:08.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.419+0000 7f71cb311640 1 -- 172.21.15.120:0/136482000 wait complete. 2024-03-31T16:36:08.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71cb311640 1 Processor -- start 2024-03-31T16:36:08.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71cb311640 1 -- start start 2024-03-31T16:36:08.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71cb311640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71c406da30 0x7f71c40b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71cb311640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c40d4910 0x7f71c40b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71cb311640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c415e860 0x7f71c40cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71cb311640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f71c40cedb0 con 0x7f71c415e860 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71cb311640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71c40d2c50 con 0x7f71c406da30 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71cb311640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f71c40cef30 con 0x7f71c40d4910 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71c98ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c415e860 0x7f71c40cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71c98ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c415e860 0x7f71c40cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38630/0 (socket says 172.21.15.120:38630) 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.421+0000 7f71c98ae640 1 -- 172.21.15.120:0/3517033524 learned_addr learned my addr 172.21.15.120:0/3517033524 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71c90ad640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71c406da30 0x7f71c40b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71c88ac640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c40d4910 0x7f71c40b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71c98ae640 1 -- 172.21.15.120:0/3517033524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c40d4910 msgr2=0x7f71c40b98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71c98ae640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c40d4910 0x7f71c40b98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71c98ae640 1 -- 172.21.15.120:0/3517033524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71c406da30 msgr2=0x7f71c40b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71c98ae640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71c406da30 0x7f71c40b81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71c98ae640 1 -- 172.21.15.120:0/3517033524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c40b8830 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71c98ae640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c415e860 0x7f71c40cc650 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f71bc02b950 tx=0x7f71bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71b9ffb640 1 -- 172.21.15.120:0/3517033524 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc040070 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71b9ffb640 1 -- 172.21.15.120:0/3517033524 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc030c20 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c40b8b10 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71b9ffb640 1 -- 172.21.15.120:0/3517033524 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc035040 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.422+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c40b90d0 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.423+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c40685c0 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.424+0000 7f71b9ffb640 1 -- 172.21.15.120:0/3517033524 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71bc038020 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.424+0000 7f71b9ffb640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f71a806c920 0x7f71a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.424+0000 7f71b9ffb640 1 -- 172.21.15.120:0/3517033524 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f71bc0ad680 con 0x7f71c415e860 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.424+0000 7f71c90ad640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f71a806c920 0x7f71a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.424+0000 7f71c90ad640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f71a806c920 0x7f71a806ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f71c0011340 tx=0x7f71c000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.428+0000 7f71b9ffb640 1 -- 172.21.15.120:0/3517033524 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f71bc07b4f0 con 0x7f71c415e860 2024-03-31T16:36:08.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.602+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f71c40ba0e0 con 0x7f71c415e860 2024-03-31T16:36:08.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.602+0000 7f71b9ffb640 1 -- 172.21.15.120:0/3517033524 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f71bc07f7f0 con 0x7f71c415e860 2024-03-31T16:36:08.607 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.604+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f71a806c920 msgr2=0x7f71a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.604+0000 7f71cb311640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f71a806c920 0x7f71a806ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f71c0011340 tx=0x7f71c000b040 comp rx=0 tx=0).stop 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.604+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c415e860 msgr2=0x7f71c40cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.604+0000 7f71cb311640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c415e860 0x7f71c40cc650 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f71bc02b950 tx=0x7f71bc0046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.605+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 shutdown_connections 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.605+0000 7f71cb311640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f71a806c920 0x7f71a806ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.605+0000 7f71cb311640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f71c415e860 0x7f71c40cc650 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.605+0000 7f71cb311640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71c40d4910 0x7f71c40b98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.605+0000 7f71cb311640 1 --2- 172.21.15.120:0/3517033524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71c406da30 0x7f71c40b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.605+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 >> 172.21.15.120:0/3517033524 conn(0x7f71c409d7d0 msgr2=0x7f71c40cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:08.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.605+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 shutdown_connections 2024-03-31T16:36:08.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.605+0000 7f71cb311640 1 -- 172.21.15.120:0/3517033524 wait complete. 2024-03-31T16:36:08.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:36:08.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.719+0000 7f6d60650640 1 Processor -- start 2024-03-31T16:36:08.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.719+0000 7f6d60650640 1 -- start start 2024-03-31T16:36:08.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.719+0000 7f6d60650640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6d580b0670 0x7f6d5815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.719+0000 7f6d60650640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6d5806bc80 0x7f6d58168450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.719+0000 7f6d60650640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d580b5b10 con 0x7f6d58070120 2024-03-31T16:36:08.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d60650640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f6d580b63e0 con 0x7f6d5806bc80 2024-03-31T16:36:08.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d60650640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5806c3f0 con 0x7f6d580b0670 2024-03-31T16:36:08.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5ebed640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6d5806bc80 0x7f6d58168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5dbeb640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6d58070120 0x7f6d5806b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54394/0 (socket says 172.21.15.120:54394) 2024-03-31T16:36:08.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5dbeb640 1 -- 172.21.15.120:0/1283967715 learned_addr learned my addr 172.21.15.120:0/1283967715 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:08.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5e3ec640 1 --2- 172.21.15.120:0/1283967715 >> v2:172.21.15.203:3300/0 conn(0x7f6d580b0670 0x7f6d5815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5ebed640 1 -- 172.21.15.120:0/1283967715 >> v2:172.21.15.203:3300/0 conn(0x7f6d580b0670 msgr2=0x7f6d5815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:08.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5ebed640 1 --2- 172.21.15.120:0/1283967715 >> v2:172.21.15.203:3300/0 conn(0x7f6d580b0670 0x7f6d5815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5ebed640 1 -- 172.21.15.120:0/1283967715 >> v1:172.21.15.120:6789/0 conn(0x7f6d58070120 legacy=0x7f6d5806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5ebed640 1 -- 172.21.15.120:0/1283967715 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5815fdf0 con 0x7f6d5806bc80 2024-03-31T16:36:08.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.720+0000 7f6d5d3ea640 1 -- 172.21.15.120:0/1283967715 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028468062 0 0) 0x7f6d48001110 con 0x7f6d58070120 2024-03-31T16:36:08.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d5ebed640 1 --2- 172.21.15.120:0/1283967715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58168450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d580d2240 tx=0x7f6d5002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36577d1cfa50bc6c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d5d3ea640 1 -- 172.21.15.120:0/1283967715 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50039070 con 0x7f6d5806bc80 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d5d3ea640 1 -- 172.21.15.120:0/1283967715 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5002cc80 con 0x7f6d5806bc80 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d5d3ea640 1 -- 172.21.15.120:0/1283967715 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50034660 con 0x7f6d5806bc80 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d60650640 1 -- 172.21.15.120:0/1283967715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 msgr2=0x7f6d58168450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d60650640 1 --2- 172.21.15.120:0/1283967715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58168450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d580d2240 tx=0x7f6d5002bed0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d60650640 1 -- 172.21.15.120:0/1283967715 shutdown_connections 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d60650640 1 --2- 172.21.15.120:0/1283967715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58168450 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d60650640 1 --2- 172.21.15.120:0/1283967715 >> v2:172.21.15.203:3300/0 conn(0x7f6d580b0670 0x7f6d5815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d60650640 1 -- 172.21.15.120:0/1283967715 >> 172.21.15.120:0/1283967715 conn(0x7f6d580b65a0 msgr2=0x7f6d580b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d60650640 1 -- 172.21.15.120:0/1283967715 shutdown_connections 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.721+0000 7f6d60650640 1 -- 172.21.15.120:0/1283967715 wait complete. 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d60650640 1 Processor -- start 2024-03-31T16:36:08.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d60650640 1 -- start start 2024-03-31T16:36:08.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d60650640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d60650640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d58070120 0x7f6d58138370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d60650640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d580b0670 0x7f6d580caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d60650640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6d580b6070 con 0x7f6d5806bc80 2024-03-31T16:36:08.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d60650640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d580b5d90 con 0x7f6d58070120 2024-03-31T16:36:08.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d60650640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d580b0a50 con 0x7f6d580b0670 2024-03-31T16:36:08.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d5e3ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d5e3ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38648/0 (socket says 172.21.15.120:38648) 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.723+0000 7f6d5e3ec640 1 -- 172.21.15.120:0/959847169 learned_addr learned my addr 172.21.15.120:0/959847169 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d5dbeb640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d58070120 0x7f6d58138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d5ebed640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d580b0670 0x7f6d580caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d5e3ec640 1 -- 172.21.15.120:0/959847169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d580b0670 msgr2=0x7f6d580caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d5e3ec640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d580b0670 0x7f6d580caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d5e3ec640 1 -- 172.21.15.120:0/959847169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d58070120 msgr2=0x7f6d58138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d5e3ec640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d58070120 0x7f6d58138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d5e3ec640 1 -- 172.21.15.120:0/959847169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d581584c0 con 0x7f6d5806bc80 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d5e3ec640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58157f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400e870 tx=0x7f6d5400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d4effd640 1 -- 172.21.15.120:0/959847169 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54017070 con 0x7f6d5806bc80 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d4effd640 1 -- 172.21.15.120:0/959847169 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5400c940 con 0x7f6d5806bc80 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d580cee90 con 0x7f6d5806bc80 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d4effd640 1 -- 172.21.15.120:0/959847169 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400cd30 con 0x7f6d5806bc80 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.724+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d580cf450 con 0x7f6d5806bc80 2024-03-31T16:36:08.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.725+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d58068cd0 con 0x7f6d5806bc80 2024-03-31T16:36:08.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.725+0000 7f6d4effd640 1 -- 172.21.15.120:0/959847169 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d5401a070 con 0x7f6d5806bc80 2024-03-31T16:36:08.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.726+0000 7f6d4effd640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6d3c06c8f0 0x7f6d3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:08.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.726+0000 7f6d4effd640 1 -- 172.21.15.120:0/959847169 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6d5408ba00 con 0x7f6d5806bc80 2024-03-31T16:36:08.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.726+0000 7f6d5dbeb640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6d3c06c8f0 0x7f6d3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:08.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.726+0000 7f6d5dbeb640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6d3c06c8f0 0x7f6d3c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6d581f7860 tx=0x7f6d48007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:08.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.730+0000 7f6d4effd640 1 -- 172.21.15.120:0/959847169 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6d581584c0 con 0x7f6d5806bc80 2024-03-31T16:36:08.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.904+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6d580ae1c0 con 0x7f6d5806bc80 2024-03-31T16:36:08.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.904+0000 7f6d4effd640 1 -- 172.21.15.120:0/959847169 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6d54059750 con 0x7f6d5806bc80 2024-03-31T16:36:08.909 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:36:08.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6d3c06c8f0 msgr2=0x7f6d3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6d3c06c8f0 0x7f6d3c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6d581f7860 tx=0x7f6d48007b50 comp rx=0 tx=0).stop 2024-03-31T16:36:08.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 msgr2=0x7f6d58157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:08.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58157f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400e870 tx=0x7f6d5400ed30 comp rx=0 tx=0).stop 2024-03-31T16:36:08.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 shutdown_connections 2024-03-31T16:36:08.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f6d3c06c8f0 0x7f6d3c06edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d580b0670 0x7f6d580caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d58070120 0x7f6d58138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 --2- 172.21.15.120:0/959847169 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6d5806bc80 0x7f6d58157f80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:08.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.906+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 >> 172.21.15.120:0/959847169 conn(0x7f6d580b65a0 msgr2=0x7f6d58161150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:08.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.907+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 shutdown_connections 2024-03-31T16:36:08.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:08.907+0000 7f6d60650640 1 -- 172.21.15.120:0/959847169 wait complete. 2024-03-31T16:36:08.921 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:36:09.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.021+0000 7f2d4bf82640 1 Processor -- start 2024-03-31T16:36:09.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.021+0000 7f2d4bf82640 1 -- start start 2024-03-31T16:36:09.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4bf82640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2d44155930 0x7f2d440d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4bf82640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d440aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4bf82640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d440b40b0 con 0x7f2d44155550 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4bf82640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2d440d0c30 con 0x7f2d44155930 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4bf82640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d440b4390 con 0x7f2d440d07c0 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4a51f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d440aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4951d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2d44155930 0x7f2d440d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d49d1e640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f2d44155550 0x7f2d4415f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:41704/0 (socket says 172.21.15.120:41704) 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4951d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2d44155930 0x7f2d440d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:41776/0 (socket says 172.21.15.120:41776) 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4a51f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d440aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:44444/0 (socket says 172.21.15.120:44444) 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d49d1e640 1 -- 172.21.15.120:0/4043162928 learned_addr learned my addr 172.21.15.120:0/4043162928 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4951d640 1 -- 172.21.15.120:0/4043162928 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 msgr2=0x7f2d440aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4951d640 1 --2- 172.21.15.120:0/4043162928 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d440aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4951d640 1 -- 172.21.15.120:0/4043162928 >> v1:172.21.15.203:6789/0 conn(0x7f2d44155550 legacy=0x7f2d4415f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d4951d640 1 -- 172.21.15.120:0/4043162928 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d440b4670 con 0x7f2d44155930 2024-03-31T16:36:09.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.022+0000 7f2d48d1c640 1 -- 172.21.15.120:0/4043162928 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277057635 0 0) 0x7f2d440b40b0 con 0x7f2d44155550 2024-03-31T16:36:09.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.023+0000 7f2d4951d640 1 --2- 172.21.15.120:0/4043162928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 0x7f2d440d0280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2d340097a0 tx=0x7f2d3402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5614bee67fb08106 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.023+0000 7f2d48d1c640 1 -- 172.21.15.120:0/4043162928 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d34035020 con 0x7f2d44155930 2024-03-31T16:36:09.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.023+0000 7f2d48d1c640 1 -- 172.21.15.120:0/4043162928 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d34031830 con 0x7f2d44155930 2024-03-31T16:36:09.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.023+0000 7f2d48d1c640 1 -- 172.21.15.120:0/4043162928 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d34031c00 con 0x7f2d44155930 2024-03-31T16:36:09.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.024+0000 7f2d4bf82640 1 -- 172.21.15.120:0/4043162928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 msgr2=0x7f2d440d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.024+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/4043162928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 0x7f2d440d0280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2d340097a0 tx=0x7f2d3402b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.024+0000 7f2d4bf82640 1 -- 172.21.15.120:0/4043162928 shutdown_connections 2024-03-31T16:36:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.024+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/4043162928 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d440aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.024+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/4043162928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 0x7f2d440d0280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.024+0000 7f2d4bf82640 1 -- 172.21.15.120:0/4043162928 >> 172.21.15.120:0/4043162928 conn(0x7f2d4406b750 msgr2=0x7f2d4406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.024+0000 7f2d4bf82640 1 -- 172.21.15.120:0/4043162928 shutdown_connections 2024-03-31T16:36:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.024+0000 7f2d4bf82640 1 -- 172.21.15.120:0/4043162928 wait complete. 2024-03-31T16:36:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.025+0000 7f2d4bf82640 1 Processor -- start 2024-03-31T16:36:09.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.025+0000 7f2d4bf82640 1 -- start start 2024-03-31T16:36:09.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4bf82640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d441f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4bf82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d44155550 0x7f2d4414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4bf82640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 0x7f2d4414cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4bf82640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4415ba20 con 0x7f2d44155550 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4bf82640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d440b4c30 con 0x7f2d44155930 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4bf82640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4415bba0 con 0x7f2d440d07c0 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4951d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d44155550 0x7f2d4414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4951d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d44155550 0x7f2d4414eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38650/0 (socket says 172.21.15.120:38650) 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4951d640 1 -- 172.21.15.120:0/1211984147 learned_addr learned my addr 172.21.15.120:0/1211984147 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d49d1e640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d441f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4a51f640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 0x7f2d4414cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4951d640 1 -- 172.21.15.120:0/1211984147 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 msgr2=0x7f2d441f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4951d640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d441f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4951d640 1 -- 172.21.15.120:0/1211984147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 msgr2=0x7f2d4414cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4951d640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 0x7f2d4414cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.026+0000 7f2d4951d640 1 -- 172.21.15.120:0/1211984147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4414d830 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.027+0000 7f2d4951d640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d44155550 0x7f2d4414eda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2d34000c00 tx=0x7f2d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.027+0000 7f2d3a7fc640 1 -- 172.21.15.120:0/1211984147 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d34035070 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.027+0000 7f2d3a7fc640 1 -- 172.21.15.120:0/1211984147 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d34004230 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.027+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4414dfe0 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.027+0000 7f2d3a7fc640 1 -- 172.21.15.120:0/1211984147 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3403a630 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.027+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d4414e5a0 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.028+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d440685c0 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.028+0000 7f2d3a7fc640 1 -- 172.21.15.120:0/1211984147 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d34038020 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.028+0000 7f2d3a7fc640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2d2806c920 0x7f2d2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.029+0000 7f2d3a7fc640 1 -- 172.21.15.120:0/1211984147 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d340ad570 con 0x7f2d44155550 2024-03-31T16:36:09.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.029+0000 7f2d49d1e640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2d2806c920 0x7f2d2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.029+0000 7f2d49d1e640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2d2806c920 0x7f2d2806ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2d40000f60 tx=0x7f2d40007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.033+0000 7f2d3a7fc640 1 -- 172.21.15.120:0/1211984147 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2d34040070 con 0x7f2d44155550 2024-03-31T16:36:09.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.209+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2d440b3ad0 con 0x7f2d44155550 2024-03-31T16:36:09.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.210+0000 7f2d3a7fc640 1 -- 172.21.15.120:0/1211984147 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f2d3407b350 con 0x7f2d44155550 2024-03-31T16:36:09.214 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:36:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.211+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2d2806c920 msgr2=0x7f2d2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.211+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2d2806c920 0x7f2d2806ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2d40000f60 tx=0x7f2d40007d50 comp rx=0 tx=0).stop 2024-03-31T16:36:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.211+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d44155550 msgr2=0x7f2d4414eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.211+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d44155550 0x7f2d4414eda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2d34000c00 tx=0x7f2d340046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.212+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 shutdown_connections 2024-03-31T16:36:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.212+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2d2806c920 0x7f2d2806ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.212+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d44155930 0x7f2d4414cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.212+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d44155550 0x7f2d4414eda0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.212+0000 7f2d4bf82640 1 --2- 172.21.15.120:0/1211984147 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d440d07c0 0x7f2d441f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.212+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 >> 172.21.15.120:0/1211984147 conn(0x7f2d4406b750 msgr2=0x7f2d440b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:09.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.212+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 shutdown_connections 2024-03-31T16:36:09.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.212+0000 7f2d4bf82640 1 -- 172.21.15.120:0/1211984147 wait complete. 2024-03-31T16:36:09.227 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-31T16:36:09.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.323+0000 7f41d21fa640 1 Processor -- start 2024-03-31T16:36:09.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.323+0000 7f41d21fa640 1 -- start start 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41d21fa640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc0d0990 0x7f41cc0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41d21fa640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f41cc0af2e0 0x7f41cc1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41d21fa640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41cc0afab0 con 0x7f41cc153580 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41d21fa640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f41cc15cc80 con 0x7f41cc0af2e0 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41d21fa640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc15da00 con 0x7f41cc0d0990 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41cb7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f41cc153580 0x7f41cc0d0280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54408/0 (socket says 172.21.15.120:54408) 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41cb7fe640 1 -- 172.21.15.120:0/3953435836 learned_addr learned my addr 172.21.15.120:0/3953435836 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41cbfff640 1 --2- 172.21.15.120:0/3953435836 >> v2:172.21.15.203:3300/0 conn(0x7f41cc0af2e0 0x7f41cc1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41caffd640 1 --2- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc0d0990 0x7f41cc0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41ca7fc640 1 -- 172.21.15.120:0/3953435836 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1040666734 0 0) 0x7f41cc0afab0 con 0x7f41cc153580 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41ca7fc640 1 -- 172.21.15.120:0/3953435836 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41b4003520 con 0x7f41cc153580 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41cbfff640 1 -- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc0d0990 msgr2=0x7f41cc0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41cbfff640 1 --2- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc0d0990 0x7f41cc0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41cbfff640 1 -- 172.21.15.120:0/3953435836 >> v1:172.21.15.120:6789/0 conn(0x7f41cc153580 legacy=0x7f41cc0d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41cbfff640 1 -- 172.21.15.120:0/3953435836 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc15cf20 con 0x7f41cc0af2e0 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.324+0000 7f41caffd640 1 --2- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc0d0990 0x7f41cc0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.325+0000 7f41cbfff640 1 --2- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0af2e0 0x7f41cc1600d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009d90 tx=0x7f41c402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b0e84285fd4a344 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.325+0000 7f41ca7fc640 1 -- 172.21.15.120:0/3953435836 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4039070 con 0x7f41cc0af2e0 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.325+0000 7f41ca7fc640 1 -- 172.21.15.120:0/3953435836 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c402cbc0 con 0x7f41cc0af2e0 2024-03-31T16:36:09.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.325+0000 7f41ca7fc640 1 -- 172.21.15.120:0/3953435836 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c4034440 con 0x7f41cc0af2e0 2024-03-31T16:36:09.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.326+0000 7f41d21fa640 1 -- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0af2e0 msgr2=0x7f41cc1600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.326+0000 7f41d21fa640 1 --2- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0af2e0 0x7f41cc1600d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009d90 tx=0x7f41c402be10 comp rx=0 tx=0).stop 2024-03-31T16:36:09.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.326+0000 7f41d21fa640 1 -- 172.21.15.120:0/3953435836 shutdown_connections 2024-03-31T16:36:09.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.326+0000 7f41d21fa640 1 --2- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0af2e0 0x7f41cc1600d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.326+0000 7f41d21fa640 1 --2- 172.21.15.120:0/3953435836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc0d0990 0x7f41cc0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.326+0000 7f41d21fa640 1 -- 172.21.15.120:0/3953435836 >> 172.21.15.120:0/3953435836 conn(0x7f41cc06b750 msgr2=0x7f41cc06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.326+0000 7f41d21fa640 1 -- 172.21.15.120:0/3953435836 shutdown_connections 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.326+0000 7f41d21fa640 1 -- 172.21.15.120:0/3953435836 wait complete. 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.327+0000 7f41d21fa640 1 Processor -- start 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.327+0000 7f41d21fa640 1 -- start start 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41d21fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41cc0af2e0 0x7f41cc14e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41d21fa640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0d0990 0x7f41cc0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41d21fa640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc153580 0x7f41cc0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41d21fa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc153960 con 0x7f41cc0af2e0 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41d21fa640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc15d4e0 con 0x7f41cc0d0990 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41d21fa640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc0af710 con 0x7f41cc153580 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41cc0af2e0 0x7f41cc14e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41cc0af2e0 0x7f41cc14e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38660/0 (socket says 172.21.15.120:38660) 2024-03-31T16:36:09.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 -- 172.21.15.120:0/701179186 learned_addr learned my addr 172.21.15.120:0/701179186 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41caffd640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0d0990 0x7f41cc0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cbfff640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc153580 0x7f41cc0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 -- 172.21.15.120:0/701179186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc153580 msgr2=0x7f41cc0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc153580 0x7f41cc0cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 -- 172.21.15.120:0/701179186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0d0990 msgr2=0x7f41cc0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0d0990 0x7f41cc0cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 -- 172.21.15.120:0/701179186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc0cd950 con 0x7f41cc0af2e0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41cb7fe640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41cc0af2e0 0x7f41cc14e220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f41c000c460 tx=0x7f41c000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41b3fff640 1 -- 172.21.15.120:0/701179186 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0017070 con 0x7f41cc0af2e0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41b3fff640 1 -- 172.21.15.120:0/701179186 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c0005ce0 con 0x7f41cc0af2e0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41cc0cca50 con 0x7f41cc0af2e0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41b3fff640 1 -- 172.21.15.120:0/701179186 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0007290 con 0x7f41cc0af2e0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.328+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41cc0cd010 con 0x7f41cc0af2e0 2024-03-31T16:36:09.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.329+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41cc0b2b60 con 0x7f41cc0af2e0 2024-03-31T16:36:09.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.330+0000 7f41b3fff640 1 -- 172.21.15.120:0/701179186 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41c001a070 con 0x7f41cc0af2e0 2024-03-31T16:36:09.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.330+0000 7f41b3fff640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f41b806c8f0 0x7f41b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.336 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.330+0000 7f41b3fff640 1 -- 172.21.15.120:0/701179186 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f41c008ae10 con 0x7f41cc0af2e0 2024-03-31T16:36:09.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.330+0000 7f41caffd640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f41b806c8f0 0x7f41b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.337 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.331+0000 7f41caffd640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f41b806c8f0 0x7f41b806edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009560 tx=0x7f41bc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.338 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.334+0000 7f41b3fff640 1 -- 172.21.15.120:0/701179186 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f41c0058c00 con 0x7f41cc0af2e0 2024-03-31T16:36:09.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.520+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f41cc0ae3c0 con 0x7f41cc0af2e0 2024-03-31T16:36:09.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.521+0000 7f41b3fff640 1 -- 172.21.15.120:0/701179186 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f41cc0ae3c0 con 0x7f41cc0af2e0 2024-03-31T16:36:09.525 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-03-31T16:36:09.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f41b806c8f0 msgr2=0x7f41b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f41b806c8f0 0x7f41b806edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009560 tx=0x7f41bc009190 comp rx=0 tx=0).stop 2024-03-31T16:36:09.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41cc0af2e0 msgr2=0x7f41cc14e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41cc0af2e0 0x7f41cc14e220 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f41c000c460 tx=0x7f41c000c920 comp rx=0 tx=0).stop 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 shutdown_connections 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f41b806c8f0 0x7f41b806edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41cc153580 0x7f41cc0cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41cc0d0990 0x7f41cc0cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 --2- 172.21.15.120:0/701179186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41cc0af2e0 0x7f41cc14e220 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 >> 172.21.15.120:0/701179186 conn(0x7f41cc06b750 msgr2=0x7f41cc152760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 shutdown_connections 2024-03-31T16:36:09.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.523+0000 7f41d21fa640 1 -- 172.21.15.120:0/701179186 wait complete. 2024-03-31T16:36:09.538 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-31T16:36:09.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:09.538 DEBUG:teuthology.orchestra.run.smithi203:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-31T16:36:09.567 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-03-31T16:36:09.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:09.568 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-31T16:36:09.623 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-31T16:36:09.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:36:09.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.720+0000 7fcef6233640 1 Processor -- start 2024-03-31T16:36:09.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.720+0000 7fcef6233640 1 -- start start 2024-03-31T16:36:09.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fcef6233640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcef00d43d0 0x7fcef00d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fcef6233640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcef00cf6b0 0x7fcef00cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fcef6233640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef00d4d20 con 0x7fcef015e860 2024-03-31T16:36:09.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fcef6233640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcef00cf220 con 0x7fcef00cf6b0 2024-03-31T16:36:09.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fcef6233640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcef006dfa0 con 0x7fcef00d43d0 2024-03-31T16:36:09.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceeffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcef00cf6b0 0x7fcef00cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceeffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcef00cf6b0 0x7fcef00cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38674/0 (socket says 172.21.15.120:38674) 2024-03-31T16:36:09.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceeffff640 1 -- 172.21.15.120:0/2421323120 learned_addr learned my addr 172.21.15.120:0/2421323120 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceeeffd640 1 --2- 172.21.15.120:0/2421323120 >> v2:172.21.15.203:3300/0 conn(0x7fcef00d43d0 0x7fcef00d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceeffff640 1 -- 172.21.15.120:0/2421323120 >> v2:172.21.15.203:3300/0 conn(0x7fcef00d43d0 msgr2=0x7fcef00d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceeffff640 1 --2- 172.21.15.120:0/2421323120 >> v2:172.21.15.203:3300/0 conn(0x7fcef00d43d0 0x7fcef00d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceeffff640 1 -- 172.21.15.120:0/2421323120 >> v1:172.21.15.203:6789/0 conn(0x7fcef015e860 legacy=0x7fcef006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceee7fc640 1 -- 172.21.15.120:0/2421323120 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372390168 0 0) 0x7fcee0001110 con 0x7fcef015e860 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.721+0000 7fceeffff640 1 -- 172.21.15.120:0/2421323120 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef006e240 con 0x7fcef00cf6b0 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.722+0000 7fceeffff640 1 --2- 172.21.15.120:0/2421323120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00cf6b0 0x7fcef00cfa90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcef0162160 tx=0x7fcee802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c51245a55108903 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.722+0000 7fceee7fc640 1 -- 172.21.15.120:0/2421323120 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee802cb20 con 0x7fcef00cf6b0 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.722+0000 7fceee7fc640 1 -- 172.21.15.120:0/2421323120 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee802ccc0 con 0x7fcef00cf6b0 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.722+0000 7fceee7fc640 1 -- 172.21.15.120:0/2421323120 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8034610 con 0x7fcef00cf6b0 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.723+0000 7fcef6233640 1 -- 172.21.15.120:0/2421323120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00cf6b0 msgr2=0x7fcef00cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.723+0000 7fcef6233640 1 --2- 172.21.15.120:0/2421323120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00cf6b0 0x7fcef00cfa90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcef0162160 tx=0x7fcee802bf80 comp rx=0 tx=0).stop 2024-03-31T16:36:09.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.723+0000 7fcef6233640 1 -- 172.21.15.120:0/2421323120 shutdown_connections 2024-03-31T16:36:09.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.723+0000 7fcef6233640 1 --2- 172.21.15.120:0/2421323120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00cf6b0 0x7fcef00cfa90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.723+0000 7fcef6233640 1 --2- 172.21.15.120:0/2421323120 >> v2:172.21.15.203:3300/0 conn(0x7fcef00d43d0 0x7fcef00d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.723+0000 7fcef6233640 1 -- 172.21.15.120:0/2421323120 >> 172.21.15.120:0/2421323120 conn(0x7fcef009d7d0 msgr2=0x7fcef008bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:09.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.723+0000 7fcef6233640 1 -- 172.21.15.120:0/2421323120 shutdown_connections 2024-03-31T16:36:09.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.723+0000 7fcef6233640 1 -- 172.21.15.120:0/2421323120 wait complete. 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.724+0000 7fcef6233640 1 Processor -- start 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.724+0000 7fcef6233640 1 -- start start 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fcef6233640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcef00cf6b0 0x7fcef0156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fcef6233640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00d43d0 0x7fcef00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fcef6233640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcef015e860 0x7fcef01f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fcef6233640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcef006dc00 con 0x7fcef00d43d0 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fcef6233640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcef00d2c50 con 0x7fcef015e860 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fcef6233640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcef006dd80 con 0x7fcef00cf6b0 2024-03-31T16:36:09.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fceeeffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00d43d0 0x7fcef00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fceeeffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00d43d0 0x7fcef00c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38676/0 (socket says 172.21.15.120:38676) 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fceeeffd640 1 -- 172.21.15.120:0/3855256365 learned_addr learned my addr 172.21.15.120:0/3855256365 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fceeffff640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcef015e860 0x7fcef01f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fceef7fe640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcef00cf6b0 0x7fcef0156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fceeffff640 1 -- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcef00cf6b0 msgr2=0x7fcef0156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.725+0000 7fceeffff640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcef00cf6b0 0x7fcef0156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fceeffff640 1 -- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00d43d0 msgr2=0x7fcef00c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fceeffff640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00d43d0 0x7fcef00c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fceeffff640 1 -- 172.21.15.120:0/3855256365 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef01f7f60 con 0x7fcef015e860 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fceeeffd640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00d43d0 0x7fcef00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fceeffff640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcef015e860 0x7fcef01f7580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcee8032000 tx=0x7fcee8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fced7fff640 1 -- 172.21.15.120:0/3855256365 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8043070 con 0x7fcef015e860 2024-03-31T16:36:09.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fced7fff640 1 -- 172.21.15.120:0/3855256365 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee8003990 con 0x7fcef015e860 2024-03-31T16:36:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fced7fff640 1 -- 172.21.15.120:0/3855256365 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8009510 con 0x7fcef015e860 2024-03-31T16:36:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef01f8240 con 0x7fcef015e860 2024-03-31T16:36:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.726+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef00c83b0 con 0x7fcef015e860 2024-03-31T16:36:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.727+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef00685c0 con 0x7fcef015e860 2024-03-31T16:36:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.727+0000 7fced7fff640 1 -- 172.21.15.120:0/3855256365 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcee802cb30 con 0x7fcef015e860 2024-03-31T16:36:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.728+0000 7fced7fff640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcedc06c8f0 0x7fcedc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.728+0000 7fced7fff640 1 -- 172.21.15.120:0/3855256365 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcee80ade90 con 0x7fcef015e860 2024-03-31T16:36:09.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.728+0000 7fceef7fe640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcedc06c8f0 0x7fcedc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:09.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.728+0000 7fceef7fe640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcedc06c8f0 0x7fcedc06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcee0000f60 tx=0x7fcee0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:09.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.733+0000 7fced7fff640 1 -- 172.21.15.120:0/3855256365 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcee804d020 con 0x7fcef015e860 2024-03-31T16:36:09.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.943+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcef01f8410 con 0x7fcef015e860 2024-03-31T16:36:09.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.944+0000 7fced7fff640 1 -- 172.21.15.120:0/3855256365 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7fcee807bc70 con 0x7fcef015e860 2024-03-31T16:36:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:09.948 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:35:31.420280+0000","modified":"2024-03-31T16:35:33.846906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-03-31T16:36:09.949 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcedc06c8f0 msgr2=0x7fcedc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcedc06c8f0 0x7fcedc06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcee0000f60 tx=0x7fcee0009040 comp rx=0 tx=0).stop 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcef015e860 msgr2=0x7fcef01f7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcef015e860 0x7fcef01f7580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcee8032000 tx=0x7fcee8004a40 comp rx=0 tx=0).stop 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 shutdown_connections 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcedc06c8f0 0x7fcedc06edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcef015e860 0x7fcef01f7580 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcef00d43d0 0x7fcef00c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 --2- 172.21.15.120:0/3855256365 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcef00cf6b0 0x7fcef0156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 >> 172.21.15.120:0/3855256365 conn(0x7fcef009d7d0 msgr2=0x7fcef00cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 shutdown_connections 2024-03-31T16:36:09.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:09.946+0000 7fcef6233640 1 -- 172.21.15.120:0/3855256365 wait complete. 2024-03-31T16:36:09.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:10.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.057+0000 7f165764a640 1 Processor -- start 2024-03-31T16:36:10.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.058+0000 7f165764a640 1 -- start start 2024-03-31T16:36:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.058+0000 7f165764a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1650155930 0x7f16500d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.058+0000 7f165764a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16500b40b0 con 0x7f1650155550 2024-03-31T16:36:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f165764a640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16500b4390 con 0x7f16500d07c0 2024-03-31T16:36:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f165764a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f16500d0c10 con 0x7f1650155930 2024-03-31T16:36:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1655be7640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f16500d07c0 0x7f16500aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:41722/0 (socket says 172.21.15.120:41722) 2024-03-31T16:36:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1655be7640 1 -- 172.21.15.120:0/3142147948 learned_addr learned my addr 172.21.15.120:0/3142147948 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f16553e6640 1 --1- 172.21.15.120:0/3142147948 >> v1:172.21.15.120:6789/0 conn(0x7f1650155550 0x7f165015f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54420/0 (socket says 172.21.15.120:54420) 2024-03-31T16:36:10.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1654be5640 1 --2- 172.21.15.120:0/3142147948 >> v2:172.21.15.120:3300/0 conn(0x7f1650155930 0x7f16500d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1643fff640 1 -- 172.21.15.120:0/3142147948 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871184385 0 0) 0x7f16500b4390 con 0x7f16500d07c0 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1643fff640 1 -- 172.21.15.120:0/3142147948 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f163c003520 con 0x7f16500d07c0 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1654be5640 1 -- 172.21.15.120:0/3142147948 >> v1:172.21.15.203:6789/0 conn(0x7f16500d07c0 legacy=0x7f16500aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1654be5640 1 -- 172.21.15.120:0/3142147948 >> v1:172.21.15.120:6789/0 conn(0x7f1650155550 legacy=0x7f165015f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1643fff640 1 -- 172.21.15.120:0/3142147948 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23892713 0 0) 0x7f16500b40b0 con 0x7f1650155550 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.059+0000 7f1654be5640 1 -- 172.21.15.120:0/3142147948 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16500b4670 con 0x7f1650155930 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.060+0000 7f1654be5640 1 --2- 172.21.15.120:0/3142147948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155930 0x7f16500d0280 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f16440097a0 tx=0x7f164402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efdfe846eaac7d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.060+0000 7f1643fff640 1 -- 172.21.15.120:0/3142147948 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644035020 con 0x7f1650155930 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.060+0000 7f1643fff640 1 -- 172.21.15.120:0/3142147948 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1644031830 con 0x7f1650155930 2024-03-31T16:36:10.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.060+0000 7f1643fff640 1 -- 172.21.15.120:0/3142147948 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644031c00 con 0x7f1650155930 2024-03-31T16:36:10.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.060+0000 7f165764a640 1 -- 172.21.15.120:0/3142147948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155930 msgr2=0x7f16500d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.060+0000 7f165764a640 1 --2- 172.21.15.120:0/3142147948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155930 0x7f16500d0280 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f16440097a0 tx=0x7f164402b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.061+0000 7f165764a640 1 -- 172.21.15.120:0/3142147948 shutdown_connections 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.061+0000 7f165764a640 1 --2- 172.21.15.120:0/3142147948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155930 0x7f16500d0280 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.061+0000 7f165764a640 1 -- 172.21.15.120:0/3142147948 >> 172.21.15.120:0/3142147948 conn(0x7f165006b750 msgr2=0x7f165006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.061+0000 7f165764a640 1 -- 172.21.15.120:0/3142147948 shutdown_connections 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.061+0000 7f165764a640 1 -- 172.21.15.120:0/3142147948 wait complete. 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.062+0000 7f165764a640 1 Processor -- start 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.062+0000 7f165764a640 1 -- start start 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.062+0000 7f165764a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16500d07c0 0x7f165014f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f165764a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155550 0x7f165008bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f165764a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1650155930 0x7f165008c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f165764a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f165015ba20 con 0x7f1650155550 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f165764a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16500b4c30 con 0x7f1650155930 2024-03-31T16:36:10.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f165764a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f165015bba0 con 0x7f16500d07c0 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155550 0x7f165008bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155550 0x7f165008bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38696/0 (socket says 172.21.15.120:38696) 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 -- 172.21.15.120:0/2009694091 learned_addr learned my addr 172.21.15.120:0/2009694091 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f16553e6640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16500d07c0 0x7f165014f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1655be7640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1650155930 0x7f165008c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 -- 172.21.15.120:0/2009694091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16500d07c0 msgr2=0x7f165014f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16500d07c0 0x7f165014f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 -- 172.21.15.120:0/2009694091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1650155930 msgr2=0x7f165008c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1650155930 0x7f165008c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 -- 172.21.15.120:0/2009694091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165014e5d0 con 0x7f1650155550 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1654be5640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155550 0x7f165008bfb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f164402bee0 tx=0x7f16440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1641ffb640 1 -- 172.21.15.120:0/2009694091 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644035040 con 0x7f1650155550 2024-03-31T16:36:10.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1641ffb640 1 -- 172.21.15.120:0/2009694091 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164403a840 con 0x7f1650155550 2024-03-31T16:36:10.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165014e870 con 0x7f1650155550 2024-03-31T16:36:10.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.063+0000 7f1641ffb640 1 -- 172.21.15.120:0/2009694091 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164403ac10 con 0x7f1650155550 2024-03-31T16:36:10.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.064+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165014ee30 con 0x7f1650155550 2024-03-31T16:36:10.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.064+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16500685c0 con 0x7f1650155550 2024-03-31T16:36:10.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.065+0000 7f1641ffb640 1 -- 172.21.15.120:0/2009694091 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1644038020 con 0x7f1650155550 2024-03-31T16:36:10.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.065+0000 7f1641ffb640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f163406c920 0x7f163406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.065+0000 7f1641ffb640 1 -- 172.21.15.120:0/2009694091 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f16440adab0 con 0x7f1650155550 2024-03-31T16:36:10.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.065+0000 7f16553e6640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f163406c920 0x7f163406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.066+0000 7f16553e6640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f163406c920 0x7f163406ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f164c000f60 tx=0x7f164c007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.070+0000 7f1641ffb640 1 -- 172.21.15.120:0/2009694091 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f164407b920 con 0x7f1650155550 2024-03-31T16:36:10.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.249+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16500b2a50 con 0x7f1650155550 2024-03-31T16:36:10.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.250+0000 7f1641ffb640 1 -- 172.21.15.120:0/2009694091 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f164407fc20 con 0x7f1650155550 2024-03-31T16:36:10.254 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:10.254 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:10.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f163406c920 msgr2=0x7f163406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f163406c920 0x7f163406ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f164c000f60 tx=0x7f164c007d50 comp rx=0 tx=0).stop 2024-03-31T16:36:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155550 msgr2=0x7f165008bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155550 0x7f165008bfb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f164402bee0 tx=0x7f16440046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 shutdown_connections 2024-03-31T16:36:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f163406c920 0x7f163406ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1650155930 0x7f165008c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1650155550 0x7f165008bfb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 --2- 172.21.15.120:0/2009694091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16500d07c0 0x7f165014f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 >> 172.21.15.120:0/2009694091 conn(0x7f165006b750 msgr2=0x7f16500b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:10.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 shutdown_connections 2024-03-31T16:36:10.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.252+0000 7f165764a640 1 -- 172.21.15.120:0/2009694091 wait complete. 2024-03-31T16:36:10.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:35:29.923938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:35:30.364493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:36:10.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:36:10.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.366+0000 7f03f4796640 1 Processor -- start 2024-03-31T16:36:10.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.366+0000 7f03f4796640 1 -- start start 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f4796640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f03ec0d0990 0x7f03ec0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f4796640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec0af2e0 0x7f03ec1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f4796640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec0afab0 con 0x7f03ec153580 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f4796640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f03ec15cc80 con 0x7f03ec0d0990 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f4796640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f03ec15da00 con 0x7f03ec0af2e0 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f1d31640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f03ec0d0990 0x7f03ec0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f1d31640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f03ec0d0990 0x7f03ec0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38712/0 (socket says 172.21.15.120:38712) 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f1d31640 1 -- 172.21.15.120:0/2138018368 learned_addr learned my addr 172.21.15.120:0/2138018368 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f2d33640 1 --2- 172.21.15.120:0/2138018368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec0af2e0 0x7f03ec1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f1d31640 1 -- 172.21.15.120:0/2138018368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec0af2e0 msgr2=0x7f03ec1600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f1d31640 1 --2- 172.21.15.120:0/2138018368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec0af2e0 0x7f03ec1600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f1d31640 1 -- 172.21.15.120:0/2138018368 >> v1:172.21.15.203:6789/0 conn(0x7f03ec153580 legacy=0x7f03ec0d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f1d31640 1 -- 172.21.15.120:0/2138018368 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec15cf20 con 0x7f03ec0d0990 2024-03-31T16:36:10.373 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.367+0000 7f03f2d33640 1 --2- 172.21.15.120:0/2138018368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec0af2e0 0x7f03ec1600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:10.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.368+0000 7f03f1d31640 1 --2- 172.21.15.120:0/2138018368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0aeda0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009870 tx=0x7f03dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4ae188fd0f0069 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.368+0000 7f03f1530640 1 -- 172.21.15.120:0/2138018368 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc035020 con 0x7f03ec0d0990 2024-03-31T16:36:10.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.368+0000 7f03f1530640 1 -- 172.21.15.120:0/2138018368 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03dc031640 con 0x7f03ec0d0990 2024-03-31T16:36:10.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.368+0000 7f03f1530640 1 -- 172.21.15.120:0/2138018368 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc02d040 con 0x7f03ec0d0990 2024-03-31T16:36:10.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.369+0000 7f03f4796640 1 -- 172.21.15.120:0/2138018368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 msgr2=0x7f03ec0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.369+0000 7f03f4796640 1 --2- 172.21.15.120:0/2138018368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0aeda0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f03dc009870 tx=0x7f03dc02b8f0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.369+0000 7f03f4796640 1 -- 172.21.15.120:0/2138018368 shutdown_connections 2024-03-31T16:36:10.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.369+0000 7f03f4796640 1 --2- 172.21.15.120:0/2138018368 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec0af2e0 0x7f03ec1600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.369+0000 7f03f4796640 1 --2- 172.21.15.120:0/2138018368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0aeda0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.369+0000 7f03f4796640 1 -- 172.21.15.120:0/2138018368 >> 172.21.15.120:0/2138018368 conn(0x7f03ec06b750 msgr2=0x7f03ec06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:10.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.369+0000 7f03f4796640 1 -- 172.21.15.120:0/2138018368 shutdown_connections 2024-03-31T16:36:10.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.369+0000 7f03f4796640 1 -- 172.21.15.120:0/2138018368 wait complete. 2024-03-31T16:36:10.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.370+0000 7f03f4796640 1 Processor -- start 2024-03-31T16:36:10.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.370+0000 7f03f4796640 1 -- start start 2024-03-31T16:36:10.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f4796640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03ec0af2e0 0x7f03ec14a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f4796640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f4796640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec153580 0x7f03ec0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f4796640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec153960 con 0x7f03ec0d0990 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f4796640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec15d4e0 con 0x7f03ec0af2e0 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f4796640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f03ec0af710 con 0x7f03ec153580 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38720/0 (socket says 172.21.15.120:38720) 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 -- 172.21.15.120:0/3317267709 learned_addr learned my addr 172.21.15.120:0/3317267709 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f2532640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03ec0af2e0 0x7f03ec14a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f2d33640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec153580 0x7f03ec0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 -- 172.21.15.120:0/3317267709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec153580 msgr2=0x7f03ec0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec153580 0x7f03ec0b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 -- 172.21.15.120:0/3317267709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03ec0af2e0 msgr2=0x7f03ec14a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03ec0af2e0 0x7f03ec14a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 -- 172.21.15.120:0/3317267709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec0cb3c0 con 0x7f03ec0d0990 2024-03-31T16:36:10.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.371+0000 7f03f1d31640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0b10d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f03dc02b930 tx=0x7f03dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.372+0000 7f03e2ffd640 1 -- 172.21.15.120:0/3317267709 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc040070 con 0x7f03ec0d0990 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.372+0000 7f03e2ffd640 1 -- 172.21.15.120:0/3317267709 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03dc03e070 con 0x7f03ec0d0990 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.372+0000 7f03e2ffd640 1 -- 172.21.15.120:0/3317267709 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc035040 con 0x7f03ec0d0990 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.372+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec0cb630 con 0x7f03ec0d0990 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.372+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec0cbbf0 con 0x7f03ec0d0990 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.372+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec0685c0 con 0x7f03ec0d0990 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.373+0000 7f03e2ffd640 1 -- 172.21.15.120:0/3317267709 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03dc038020 con 0x7f03ec0d0990 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.373+0000 7f03e2ffd640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f03d006c920 0x7f03d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.373+0000 7f03e2ffd640 1 -- 172.21.15.120:0/3317267709 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f03dc0ad370 con 0x7f03ec0d0990 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.373+0000 7f03f2532640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f03d006c920 0x7f03d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.374+0000 7f03f2532640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f03d006c920 0x7f03d006ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f03e8001780 tx=0x7f03e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.378+0000 7f03e2ffd640 1 -- 172.21.15.120:0/3317267709 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f03dc07b150 con 0x7f03ec0d0990 2024-03-31T16:36:10.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.550+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f03ec15bf70 con 0x7f03ec0d0990 2024-03-31T16:36:10.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.551+0000 7f03e2ffd640 1 -- 172.21.15.120:0/3317267709 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f03dc07f450 con 0x7f03ec0d0990 2024-03-31T16:36:10.555 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:36:10.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.552+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f03d006c920 msgr2=0x7f03d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.552+0000 7f03f4796640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f03d006c920 0x7f03d006ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f03e8001780 tx=0x7f03e8009040 comp rx=0 tx=0).stop 2024-03-31T16:36:10.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.552+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 msgr2=0x7f03ec0b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.552+0000 7f03f4796640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0b10d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f03dc02b930 tx=0x7f03dc0046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.553+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 shutdown_connections 2024-03-31T16:36:10.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.553+0000 7f03f4796640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f03d006c920 0x7f03d006ede0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.553+0000 7f03f4796640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f03ec153580 0x7f03ec0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.553+0000 7f03f4796640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03ec0d0990 0x7f03ec0b10d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.553+0000 7f03f4796640 1 --2- 172.21.15.120:0/3317267709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f03ec0af2e0 0x7f03ec14a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.553+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 >> 172.21.15.120:0/3317267709 conn(0x7f03ec06b750 msgr2=0x7f03ec15a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:10.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.553+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 shutdown_connections 2024-03-31T16:36:10.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.553+0000 7f03f4796640 1 -- 172.21.15.120:0/3317267709 wait complete. 2024-03-31T16:36:10.568 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-31T16:36:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.666+0000 7fcc94a77640 1 Processor -- start 2024-03-31T16:36:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.666+0000 7fcc94a77640 1 -- start start 2024-03-31T16:36:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.667+0000 7fcc94a77640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcc900d06c0 0x7fcc90169260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.667+0000 7fcc94a77640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc9006dfa0 con 0x7fcc900d43d0 2024-03-31T16:36:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.667+0000 7fcc94a77640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc9006e240 con 0x7fcc9015e860 2024-03-31T16:36:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.667+0000 7fcc94a77640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcc900cf220 con 0x7fcc900d06c0 2024-03-31T16:36:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.667+0000 7fcc8dd9b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcc900d43d0 0x7fcc900d47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54430/0 (socket says 172.21.15.120:54430) 2024-03-31T16:36:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.667+0000 7fcc8dd9b640 1 -- 172.21.15.120:0/731344320 learned_addr learned my addr 172.21.15.120:0/731344320 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.667+0000 7fcc8ed9d640 1 --2- 172.21.15.120:0/731344320 >> v2:172.21.15.203:3300/0 conn(0x7fcc900d06c0 0x7fcc90169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.668+0000 7fcc8d59a640 1 -- 172.21.15.120:0/731344320 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565507292 0 0) 0x7fcc9006dfa0 con 0x7fcc900d43d0 2024-03-31T16:36:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.668+0000 7fcc8d59a640 1 -- 172.21.15.120:0/731344320 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc78003520 con 0x7fcc900d43d0 2024-03-31T16:36:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.668+0000 7fcc8ed9d640 1 -- 172.21.15.120:0/731344320 >> v1:172.21.15.203:6789/0 conn(0x7fcc9015e860 legacy=0x7fcc9006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.668+0000 7fcc8d59a640 1 -- 172.21.15.120:0/731344320 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041052894 0 0) 0x7fcc9006e240 con 0x7fcc9015e860 2024-03-31T16:36:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.668+0000 7fcc8ed9d640 1 -- 172.21.15.120:0/731344320 >> v1:172.21.15.120:6789/0 conn(0x7fcc900d43d0 legacy=0x7fcc900d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.668+0000 7fcc8ed9d640 1 -- 172.21.15.120:0/731344320 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9006e520 con 0x7fcc900d06c0 2024-03-31T16:36:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.668+0000 7fcc8ed9d640 1 --2- 172.21.15.120:0/731344320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d06c0 0x7fcc90169260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcc880097a0 tx=0x7fcc8802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc0fc77d0fe3816 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc8d59a640 1 -- 172.21.15.120:0/731344320 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88034070 con 0x7fcc900d06c0 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc8d59a640 1 -- 172.21.15.120:0/731344320 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc88030610 con 0x7fcc900d06c0 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc8d59a640 1 -- 172.21.15.120:0/731344320 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc880309e0 con 0x7fcc900d06c0 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc94a77640 1 -- 172.21.15.120:0/731344320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d06c0 msgr2=0x7fcc90169260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc94a77640 1 --2- 172.21.15.120:0/731344320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d06c0 0x7fcc90169260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcc880097a0 tx=0x7fcc8802b960 comp rx=0 tx=0).stop 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc94a77640 1 -- 172.21.15.120:0/731344320 shutdown_connections 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc94a77640 1 --2- 172.21.15.120:0/731344320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d06c0 0x7fcc90169260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc94a77640 1 -- 172.21.15.120:0/731344320 >> 172.21.15.120:0/731344320 conn(0x7fcc9009d7d0 msgr2=0x7fcc9008bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc94a77640 1 -- 172.21.15.120:0/731344320 shutdown_connections 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.669+0000 7fcc94a77640 1 -- 172.21.15.120:0/731344320 wait complete. 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc94a77640 1 Processor -- start 2024-03-31T16:36:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc94a77640 1 -- start start 2024-03-31T16:36:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc94a77640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc900d06c0 0x7fcc900c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc94a77640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d43d0 0x7fcc9015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc94a77640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc9015e860 0x7fcc9015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc94a77640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9006dd80 con 0x7fcc9015e860 2024-03-31T16:36:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc94a77640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9006dc00 con 0x7fcc900d43d0 2024-03-31T16:36:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc94a77640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc900cedb0 con 0x7fcc900d06c0 2024-03-31T16:36:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc8ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc9015e860 0x7fcc9015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.671+0000 7fcc8ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc9015e860 0x7fcc9015fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38734/0 (socket says 172.21.15.120:38734) 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8ed9d640 1 -- 172.21.15.120:0/2084418437 learned_addr learned my addr 172.21.15.120:0/2084418437 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8dd9b640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d43d0 0x7fcc9015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8e59c640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc900d06c0 0x7fcc900c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8ed9d640 1 -- 172.21.15.120:0/2084418437 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc900d06c0 msgr2=0x7fcc900c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8ed9d640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc900d06c0 0x7fcc900c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8ed9d640 1 -- 172.21.15.120:0/2084418437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d43d0 msgr2=0x7fcc9015ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8ed9d640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d43d0 0x7fcc9015ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8ed9d640 1 -- 172.21.15.120:0/2084418437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc900b70c0 con 0x7fcc9015e860 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc8ed9d640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc9015e860 0x7fcc9015fc90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcc8802b9a0 tx=0x7fcc880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc7effd640 1 -- 172.21.15.120:0/2084418437 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88034040 con 0x7fcc9015e860 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc7effd640 1 -- 172.21.15.120:0/2084418437 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc88030410 con 0x7fcc9015e860 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc900ca380 con 0x7fcc9015e860 2024-03-31T16:36:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc7effd640 1 -- 172.21.15.120:0/2084418437 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88004270 con 0x7fcc9015e860 2024-03-31T16:36:10.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.672+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc900b7640 con 0x7fcc9015e860 2024-03-31T16:36:10.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.673+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc900ca550 con 0x7fcc9015e860 2024-03-31T16:36:10.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.673+0000 7fcc7effd640 1 -- 172.21.15.120:0/2084418437 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc8804b060 con 0x7fcc9015e860 2024-03-31T16:36:10.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.674+0000 7fcc7effd640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc7006c920 0x7fcc7006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.674+0000 7fcc8e59c640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc7006c920 0x7fcc7006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.674+0000 7fcc7effd640 1 -- 172.21.15.120:0/2084418437 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcc880ad3e0 con 0x7fcc9015e860 2024-03-31T16:36:10.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.674+0000 7fcc8e59c640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc7006c920 0x7fcc7006ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc800012e0 tx=0x7fcc80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.678+0000 7fcc7effd640 1 -- 172.21.15.120:0/2084418437 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcc8807b250 con 0x7fcc9015e860 2024-03-31T16:36:10.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.853+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcc900d4930 con 0x7fcc9015e860 2024-03-31T16:36:10.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.854+0000 7fcc7effd640 1 -- 172.21.15.120:0/2084418437 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fcc8807f550 con 0x7fcc9015e860 2024-03-31T16:36:10.858 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-03-31T16:36:10.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.855+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc7006c920 msgr2=0x7fcc7006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.855+0000 7fcc94a77640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc7006c920 0x7fcc7006ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc800012e0 tx=0x7fcc80009040 comp rx=0 tx=0).stop 2024-03-31T16:36:10.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.855+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc9015e860 msgr2=0x7fcc9015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.855+0000 7fcc94a77640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc9015e860 0x7fcc9015fc90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcc8802b9a0 tx=0x7fcc880046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.856+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 shutdown_connections 2024-03-31T16:36:10.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.856+0000 7fcc94a77640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc7006c920 0x7fcc7006ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.856+0000 7fcc94a77640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc9015e860 0x7fcc9015fc90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.856+0000 7fcc94a77640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc900d43d0 0x7fcc9015ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.856+0000 7fcc94a77640 1 --2- 172.21.15.120:0/2084418437 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc900d06c0 0x7fcc900c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.856+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 >> 172.21.15.120:0/2084418437 conn(0x7fcc9009d7d0 msgr2=0x7fcc900b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:10.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.856+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 shutdown_connections 2024-03-31T16:36:10.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.856+0000 7fcc94a77640 1 -- 172.21.15.120:0/2084418437 wait complete. 2024-03-31T16:36:10.871 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-31T16:36:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.971+0000 7f1c63eeb640 1 Processor -- start 2024-03-31T16:36:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.971+0000 7f1c63eeb640 1 -- start start 2024-03-31T16:36:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c63eeb640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1c5c15ac50 0x7f1c5c0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c63eeb640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5c0b4c00 con 0x7f1c5c15eca0 2024-03-31T16:36:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c63eeb640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5c0b4ee0 con 0x7f1c5c15a870 2024-03-31T16:36:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c63eeb640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1c5c06d5b0 con 0x7f1c5c15ac50 2024-03-31T16:36:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c61486640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1c5c15eca0 0x7f1c5c0b3f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54438/0 (socket says 172.21.15.120:54438) 2024-03-31T16:36:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c61486640 1 -- 172.21.15.120:0/1283933738 learned_addr learned my addr 172.21.15.120:0/1283933738 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c62488640 1 --2- 172.21.15.120:0/1283933738 >> v2:172.21.15.203:3300/0 conn(0x7f1c5c15ac50 0x7f1c5c0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c60c85640 1 -- 172.21.15.120:0/1283933738 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778323862 0 0) 0x7f1c5c0b4c00 con 0x7f1c5c15eca0 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c60c85640 1 -- 172.21.15.120:0/1283933738 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c48003520 con 0x7f1c5c15eca0 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c60c85640 1 -- 172.21.15.120:0/1283933738 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716843633 0 0) 0x7f1c5c0b4ee0 con 0x7f1c5c15a870 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c60c85640 1 -- 172.21.15.120:0/1283933738 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c5c0b4c00 con 0x7f1c5c15a870 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c62488640 1 -- 172.21.15.120:0/1283933738 >> v1:172.21.15.203:6789/0 conn(0x7f1c5c15a870 legacy=0x7f1c5c15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c62488640 1 -- 172.21.15.120:0/1283933738 >> v1:172.21.15.120:6789/0 conn(0x7f1c5c15eca0 legacy=0x7f1c5c0b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c60c85640 1 -- 172.21.15.120:0/1283933738 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3482762678 0 0) 0x7f1c48003520 con 0x7f1c5c15eca0 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.972+0000 7f1c62488640 1 -- 172.21.15.120:0/1283933738 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c06d800 con 0x7f1c5c15ac50 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.973+0000 7f1c62488640 1 --2- 172.21.15.120:0/1283933738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c0b4620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c06d730 tx=0x7f1c5402be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2ac8c41d1a8c37c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.973+0000 7f1c60c85640 1 -- 172.21.15.120:0/1283933738 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c54039070 con 0x7f1c5c15ac50 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.973+0000 7f1c60c85640 1 -- 172.21.15.120:0/1283933738 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c5402c930 con 0x7f1c5c15ac50 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.973+0000 7f1c60c85640 1 -- 172.21.15.120:0/1283933738 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c001670 con 0x7f1c5c15ac50 2024-03-31T16:36:10.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.974+0000 7f1c63eeb640 1 -- 172.21.15.120:0/1283933738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15ac50 msgr2=0x7f1c5c0b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.974+0000 7f1c63eeb640 1 --2- 172.21.15.120:0/1283933738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c0b4620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c06d730 tx=0x7f1c5402be00 comp rx=0 tx=0).stop 2024-03-31T16:36:10.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.974+0000 7f1c63eeb640 1 -- 172.21.15.120:0/1283933738 shutdown_connections 2024-03-31T16:36:10.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.974+0000 7f1c63eeb640 1 --2- 172.21.15.120:0/1283933738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c0b4620 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.974+0000 7f1c63eeb640 1 -- 172.21.15.120:0/1283933738 >> 172.21.15.120:0/1283933738 conn(0x7f1c5c06b750 msgr2=0x7f1c5c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:10.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.974+0000 7f1c63eeb640 1 -- 172.21.15.120:0/1283933738 shutdown_connections 2024-03-31T16:36:10.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.974+0000 7f1c63eeb640 1 -- 172.21.15.120:0/1283933738 wait complete. 2024-03-31T16:36:10.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.975+0000 7f1c63eeb640 1 Processor -- start 2024-03-31T16:36:10.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.975+0000 7f1c63eeb640 1 -- start start 2024-03-31T16:36:10.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c63eeb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15a870 0x7f1c5c098a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c63eeb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c09b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c63eeb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c5c15eca0 0x7f1c5c09b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c63eeb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c06db70 con 0x7f1c5c15ac50 2024-03-31T16:36:10.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c63eeb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c06f2a0 con 0x7f1c5c15a870 2024-03-31T16:36:10.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c63eeb640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5c0d0280 con 0x7f1c5c15eca0 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c09b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c09b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38740/0 (socket says 172.21.15.120:38740) 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 -- 172.21.15.120:0/2625320579 learned_addr learned my addr 172.21.15.120:0/2625320579 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61c87640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15a870 0x7f1c5c098a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c62488640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c5c15eca0 0x7f1c5c09b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 -- 172.21.15.120:0/2625320579 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c5c15eca0 msgr2=0x7f1c5c09b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c5c15eca0 0x7f1c5c09b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 -- 172.21.15.120:0/2625320579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15a870 msgr2=0x7f1c5c098a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15a870 0x7f1c5c098a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 -- 172.21.15.120:0/2625320579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c09e140 con 0x7f1c5c15ac50 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c61486640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c09b210 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c520 tx=0x7f1c4c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c527fc640 1 -- 172.21.15.120:0/2625320579 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c017070 con 0x7f1c5c15ac50 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c527fc640 1 -- 172.21.15.120:0/2625320579 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4c005d00 con 0x7f1c5c15ac50 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5c15b140 con 0x7f1c5c15ac50 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c527fc640 1 -- 172.21.15.120:0/2625320579 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0072b0 con 0x7f1c5c15ac50 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.976+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c5c15b700 con 0x7f1c5c15ac50 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.978+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5c0685c0 con 0x7f1c5c15ac50 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.978+0000 7f1c527fc640 1 -- 172.21.15.120:0/2625320579 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c4c01a070 con 0x7f1c5c15ac50 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.978+0000 7f1c527fc640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c4006c8f0 0x7f1c4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.979+0000 7f1c527fc640 1 -- 172.21.15.120:0/2625320579 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c4c08af90 con 0x7f1c5c15ac50 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.979+0000 7f1c61c87640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c4006c8f0 0x7f1c4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:10.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.979+0000 7f1c61c87640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c4006c8f0 0x7f1c4006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c580011e0 tx=0x7f1c58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:10.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:10.983+0000 7f1c527fc640 1 -- 172.21.15.120:0/2625320579 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1c4c058d70 con 0x7f1c5c15ac50 2024-03-31T16:36:11.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.158+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1c5c0b32e0 con 0x7f1c5c15ac50 2024-03-31T16:36:11.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.158+0000 7f1c527fc640 1 -- 172.21.15.120:0/2625320579 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f1c4c05d070 con 0x7f1c5c15ac50 2024-03-31T16:36:11.163 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-03-31T16:36:11.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c4006c8f0 msgr2=0x7f1c4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c4006c8f0 0x7f1c4006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c580011e0 tx=0x7f1c58009040 comp rx=0 tx=0).stop 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5c15ac50 msgr2=0x7f1c5c09b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c09b210 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c520 tx=0x7f1c4c00c9e0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 shutdown_connections 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c4006c8f0 0x7f1c4006edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c5c15eca0 0x7f1c5c09b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c5c15ac50 0x7f1c5c09b210 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 --2- 172.21.15.120:0/2625320579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c5c15a870 0x7f1c5c098a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 >> 172.21.15.120:0/2625320579 conn(0x7f1c5c06b750 msgr2=0x7f1c5c0b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 shutdown_connections 2024-03-31T16:36:11.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.160+0000 7f1c63eeb640 1 -- 172.21.15.120:0/2625320579 wait complete. 2024-03-31T16:36:11.175 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:36:11.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.271+0000 7f1cf3a06640 1 Processor -- start 2024-03-31T16:36:11.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.271+0000 7f1cf3a06640 1 -- start start 2024-03-31T16:36:11.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.272+0000 7f1cf3a06640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec15e7b0 0x7f1cec0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.272+0000 7f1cf3a06640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1cec0d1d70 0x7f1cec0c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.272+0000 7f1cf3a06640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cec0d01a0 con 0x7f1cec0c7640 2024-03-31T16:36:11.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.272+0000 7f1cf3a06640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1cec0d1240 con 0x7f1cec0d1d70 2024-03-31T16:36:11.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.272+0000 7f1cf3a06640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1cec0d0480 con 0x7f1cec15e7b0 2024-03-31T16:36:11.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.272+0000 7f1cf1fa3640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1cec0c7640 0x7f1cec071000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54454/0 (socket says 172.21.15.120:54454) 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.272+0000 7f1cf1fa3640 1 -- 172.21.15.120:0/500886440 learned_addr learned my addr 172.21.15.120:0/500886440 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.272+0000 7f1cf17a2640 1 --2- 172.21.15.120:0/500886440 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec15e7b0 0x7f1cec0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.273+0000 7f1cf0fa1640 1 --2- 172.21.15.120:0/500886440 >> v2:172.21.15.203:3300/0 conn(0x7f1cec0d1d70 0x7f1cec0c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.273+0000 7f1ce3fff640 1 -- 172.21.15.120:0/500886440 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125376284 0 0) 0x7f1cec0d01a0 con 0x7f1cec0c7640 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.273+0000 7f1ce3fff640 1 -- 172.21.15.120:0/500886440 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cd8003520 con 0x7f1cec0c7640 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.273+0000 7f1cf17a2640 1 -- 172.21.15.120:0/500886440 >> v2:172.21.15.203:3300/0 conn(0x7f1cec0d1d70 msgr2=0x7f1cec0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.273+0000 7f1cf17a2640 1 --2- 172.21.15.120:0/500886440 >> v2:172.21.15.203:3300/0 conn(0x7f1cec0d1d70 0x7f1cec0c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.273+0000 7f1cf17a2640 1 -- 172.21.15.120:0/500886440 >> v1:172.21.15.120:6789/0 conn(0x7f1cec0c7640 legacy=0x7f1cec071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.273+0000 7f1cf17a2640 1 -- 172.21.15.120:0/500886440 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cec0d0760 con 0x7f1cec15e7b0 2024-03-31T16:36:11.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.273+0000 7f1cf0fa1640 1 --2- 172.21.15.120:0/500886440 >> v2:172.21.15.203:3300/0 conn(0x7f1cec0d1d70 0x7f1cec0c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:11.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf17a2640 1 --2- 172.21.15.120:0/500886440 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec15e7b0 0x7f1cec0b4980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009d90 tx=0x7f1ce802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86f40b15e43d21d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1ce3fff640 1 -- 172.21.15.120:0/500886440 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8039070 con 0x7f1cec15e7b0 2024-03-31T16:36:11.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1ce3fff640 1 -- 172.21.15.120:0/500886440 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce802cc50 con 0x7f1cec15e7b0 2024-03-31T16:36:11.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1ce3fff640 1 -- 172.21.15.120:0/500886440 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8034440 con 0x7f1cec15e7b0 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf3a06640 1 -- 172.21.15.120:0/500886440 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec15e7b0 msgr2=0x7f1cec0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/500886440 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec15e7b0 0x7f1cec0b4980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009d90 tx=0x7f1ce802bea0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf3a06640 1 -- 172.21.15.120:0/500886440 shutdown_connections 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/500886440 >> v2:172.21.15.203:3300/0 conn(0x7f1cec0d1d70 0x7f1cec0c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/500886440 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec15e7b0 0x7f1cec0b4980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf3a06640 1 -- 172.21.15.120:0/500886440 >> 172.21.15.120:0/500886440 conn(0x7f1cec0b3e90 msgr2=0x7f1cec0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf3a06640 1 -- 172.21.15.120:0/500886440 shutdown_connections 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.274+0000 7f1cf3a06640 1 -- 172.21.15.120:0/500886440 wait complete. 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf3a06640 1 Processor -- start 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf3a06640 1 -- start start 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf3a06640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cec0c7640 0x7f1cec141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf3a06640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec0d1d70 0x7f1cec142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf3a06640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cec15e7b0 0x7f1cec154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf3a06640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec0cfe30 con 0x7f1cec15e7b0 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf3a06640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec0d0d20 con 0x7f1cec0c7640 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf3a06640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1cec06da40 con 0x7f1cec0d1d70 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf1fa3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cec15e7b0 0x7f1cec154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf1fa3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cec15e7b0 0x7f1cec154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38750/0 (socket says 172.21.15.120:38750) 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.276+0000 7f1cf1fa3640 1 -- 172.21.15.120:0/2316867034 learned_addr learned my addr 172.21.15.120:0/2316867034 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf17a2640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cec0c7640 0x7f1cec141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf0fa1640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec0d1d70 0x7f1cec142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf1fa3640 1 -- 172.21.15.120:0/2316867034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec0d1d70 msgr2=0x7f1cec142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf1fa3640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec0d1d70 0x7f1cec142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf1fa3640 1 -- 172.21.15.120:0/2316867034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cec0c7640 msgr2=0x7f1cec141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf1fa3640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cec0c7640 0x7f1cec141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf1fa3640 1 -- 172.21.15.120:0/2316867034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cec141d70 con 0x7f1cec15e7b0 2024-03-31T16:36:11.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf1fa3640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cec15e7b0 0x7f1cec154b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c3c0 tx=0x7f1ce4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1ce1ffb640 1 -- 172.21.15.120:0/2316867034 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4017070 con 0x7f1cec15e7b0 2024-03-31T16:36:11.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1ce1ffb640 1 -- 172.21.15.120:0/2316867034 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce4005ce0 con 0x7f1cec15e7b0 2024-03-31T16:36:11.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cec0c9f30 con 0x7f1cec15e7b0 2024-03-31T16:36:11.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1ce1ffb640 1 -- 172.21.15.120:0/2316867034 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4007310 con 0x7f1cec15e7b0 2024-03-31T16:36:11.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.277+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cec0ca4f0 con 0x7f1cec15e7b0 2024-03-31T16:36:11.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.278+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cec068cd0 con 0x7f1cec15e7b0 2024-03-31T16:36:11.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.279+0000 7f1ce1ffb640 1 -- 172.21.15.120:0/2316867034 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ce401a070 con 0x7f1cec15e7b0 2024-03-31T16:36:11.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.279+0000 7f1ce1ffb640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cd006c920 0x7f1cd006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.279+0000 7f1ce1ffb640 1 -- 172.21.15.120:0/2316867034 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1ce408ad50 con 0x7f1cec15e7b0 2024-03-31T16:36:11.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.279+0000 7f1cf17a2640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cd006c920 0x7f1cd006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.279+0000 7f1cf17a2640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cd006c920 0x7f1cd006ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8036000 tx=0x7f1ce8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.283+0000 7f1ce1ffb640 1 -- 172.21.15.120:0/2316867034 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1ce408e030 con 0x7f1cec15e7b0 2024-03-31T16:36:11.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.496+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1cec0b39f0 con 0x7f1cec15e7b0 2024-03-31T16:36:11.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.496+0000 7f1ce1ffb640 1 -- 172.21.15.120:0/2316867034 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f1cec141d70 con 0x7f1cec15e7b0 2024-03-31T16:36:11.501 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:11.501 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:35:31.420280+0000","modified":"2024-03-31T16:35:33.846906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-03-31T16:36:11.501 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cd006c920 msgr2=0x7f1cd006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cd006c920 0x7f1cd006ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8036000 tx=0x7f1ce8030000 comp rx=0 tx=0).stop 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cec15e7b0 msgr2=0x7f1cec154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cec15e7b0 0x7f1cec154b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c3c0 tx=0x7f1ce4001e70 comp rx=0 tx=0).stop 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 shutdown_connections 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1cd006c920 0x7f1cd006ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1cec15e7b0 0x7f1cec154b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1cec0d1d70 0x7f1cec142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 --2- 172.21.15.120:0/2316867034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1cec0c7640 0x7f1cec141830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 >> 172.21.15.120:0/2316867034 conn(0x7f1cec0b3e90 msgr2=0x7f1cec15d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 shutdown_connections 2024-03-31T16:36:11.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.498+0000 7f1cf3a06640 1 -- 172.21.15.120:0/2316867034 wait complete. 2024-03-31T16:36:11.513 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:11.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.610+0000 7efd3ab8f640 1 Processor -- start 2024-03-31T16:36:11.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.610+0000 7efd3ab8f640 1 -- start start 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd3ab8f640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7efd34153580 0x7efd340d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd3ab8f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efd340d07c0 0x7efd340aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd3ab8f640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd340afab0 con 0x7efd340af2e0 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd3ab8f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7efd340d0c30 con 0x7efd340d07c0 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd3ab8f640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7efd3415cc80 con 0x7efd34153580 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd33fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efd340d07c0 0x7efd340aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd33fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efd340d07c0 0x7efd340aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38758/0 (socket says 172.21.15.120:38758) 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd33fff640 1 -- 172.21.15.120:0/2812317766 learned_addr learned my addr 172.21.15.120:0/2812317766 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd3892b640 1 --2- 172.21.15.120:0/2812317766 >> v2:172.21.15.203:3300/0 conn(0x7efd34153580 0x7efd340d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd33fff640 1 -- 172.21.15.120:0/2812317766 >> v2:172.21.15.203:3300/0 conn(0x7efd34153580 msgr2=0x7efd340d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd33fff640 1 --2- 172.21.15.120:0/2812317766 >> v2:172.21.15.203:3300/0 conn(0x7efd34153580 0x7efd340d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd33fff640 1 -- 172.21.15.120:0/2812317766 >> v1:172.21.15.203:6789/0 conn(0x7efd340af2e0 legacy=0x7efd3406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.611+0000 7efd33fff640 1 -- 172.21.15.120:0/2812317766 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3415da00 con 0x7efd340d07c0 2024-03-31T16:36:11.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.612+0000 7efd33fff640 1 --2- 172.21.15.120:0/2812317766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd340d07c0 0x7efd340aeda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd340b5270 tx=0x7efd2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9001df7298553e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.612+0000 7efd337fe640 1 -- 172.21.15.120:0/2812317766 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28035020 con 0x7efd340d07c0 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.612+0000 7efd337fe640 1 -- 172.21.15.120:0/2812317766 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd28031870 con 0x7efd340d07c0 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.612+0000 7efd337fe640 1 -- 172.21.15.120:0/2812317766 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28031c40 con 0x7efd340d07c0 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.613+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2812317766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd340d07c0 msgr2=0x7efd340aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.613+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2812317766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd340d07c0 0x7efd340aeda0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd340b5270 tx=0x7efd2802b910 comp rx=0 tx=0).stop 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.613+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2812317766 shutdown_connections 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.613+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2812317766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd340d07c0 0x7efd340aeda0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.613+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2812317766 >> v2:172.21.15.203:3300/0 conn(0x7efd34153580 0x7efd340d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.613+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2812317766 >> 172.21.15.120:0/2812317766 conn(0x7efd3406b750 msgr2=0x7efd3406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.613+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2812317766 shutdown_connections 2024-03-31T16:36:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.613+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2812317766 wait complete. 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.614+0000 7efd3ab8f640 1 Processor -- start 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.614+0000 7efd3ab8f640 1 -- start start 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3ab8f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd340af2e0 0x7efd341484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3ab8f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd340d07c0 0x7efd340cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3ab8f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd34153580 0x7efd34159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3ab8f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efd3415d4e0 con 0x7efd34153580 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3ab8f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd3415d200 con 0x7efd340d07c0 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3ab8f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd34153960 con 0x7efd340af2e0 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd34153580 0x7efd34159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd34153580 0x7efd34159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38766/0 (socket says 172.21.15.120:38766) 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 -- 172.21.15.120:0/2442103030 learned_addr learned my addr 172.21.15.120:0/2442103030 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3892b640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd340af2e0 0x7efd341484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd33fff640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd340d07c0 0x7efd340cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 -- 172.21.15.120:0/2442103030 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd340af2e0 msgr2=0x7efd341484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd340af2e0 0x7efd341484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 -- 172.21.15.120:0/2442103030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd340d07c0 msgr2=0x7efd340cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd340d07c0 0x7efd340cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 -- 172.21.15.120:0/2442103030 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd34148a10 con 0x7efd34153580 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.615+0000 7efd3912c640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd34153580 0x7efd34159370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00c6b0 tx=0x7efd2c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.616+0000 7efd317fa640 1 -- 172.21.15.120:0/2442103030 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c003b70 con 0x7efd34153580 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.616+0000 7efd317fa640 1 -- 172.21.15.120:0/2442103030 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd2c003d30 con 0x7efd34153580 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.616+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd340ce820 con 0x7efd34153580 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.616+0000 7efd317fa640 1 -- 172.21.15.120:0/2442103030 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c005310 con 0x7efd34153580 2024-03-31T16:36:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.616+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd340cede0 con 0x7efd34153580 2024-03-31T16:36:11.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.617+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd340685c0 con 0x7efd34153580 2024-03-31T16:36:11.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.617+0000 7efd317fa640 1 -- 172.21.15.120:0/2442103030 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd2c0054b0 con 0x7efd34153580 2024-03-31T16:36:11.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.617+0000 7efd317fa640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd2006c8f0 0x7efd2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.618+0000 7efd317fa640 1 -- 172.21.15.120:0/2442103030 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd2c08b850 con 0x7efd34153580 2024-03-31T16:36:11.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.618+0000 7efd3892b640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd2006c8f0 0x7efd2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.618+0000 7efd3892b640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd2006c8f0 0x7efd2006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd24009b40 tx=0x7efd24009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.622+0000 7efd317fa640 1 -- 172.21.15.120:0/2442103030 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efd2c059630 con 0x7efd34153580 2024-03-31T16:36:11.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.797+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd3415bc20 con 0x7efd34153580 2024-03-31T16:36:11.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.798+0000 7efd317fa640 1 -- 172.21.15.120:0/2442103030 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7efd2c05d930 con 0x7efd34153580 2024-03-31T16:36:11.803 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:11.803 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:35:33.069020+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd2006c8f0 msgr2=0x7efd2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd2006c8f0 0x7efd2006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd24009b40 tx=0x7efd24009190 comp rx=0 tx=0).stop 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd34153580 msgr2=0x7efd34159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd34153580 0x7efd34159370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00c6b0 tx=0x7efd2c00cb70 comp rx=0 tx=0).stop 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 shutdown_connections 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efd2006c8f0 0x7efd2006edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd34153580 0x7efd34159370 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd340d07c0 0x7efd340cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 --2- 172.21.15.120:0/2442103030 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd340af2e0 0x7efd341484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.800+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 >> 172.21.15.120:0/2442103030 conn(0x7efd3406b750 msgr2=0x7efd340b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.801+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 shutdown_connections 2024-03-31T16:36:11.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.801+0000 7efd3ab8f640 1 -- 172.21.15.120:0/2442103030 wait complete. 2024-03-31T16:36:11.816 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-31T16:36:11.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:36:11.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.914+0000 7faf7242c640 1 Processor -- start 2024-03-31T16:36:11.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.914+0000 7faf7242c640 1 -- start start 2024-03-31T16:36:11.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.914+0000 7faf7242c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c169260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.914+0000 7faf7242c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6c06dfa0 con 0x7faf6c15e860 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.914+0000 7faf7242c640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6c06e240 con 0x7faf6c0d43d0 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.914+0000 7faf7242c640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c0cf220 con 0x7faf6c0d06c0 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf6bfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7faf6c15e860 0x7faf6c06d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54462/0 (socket says 172.21.15.120:54462) 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf6bfff640 1 -- 172.21.15.120:0/1903506574 learned_addr learned my addr 172.21.15.120:0/1903506574 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf709c9640 1 --2- 172.21.15.120:0/1903506574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf6affd640 1 -- 172.21.15.120:0/1903506574 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797413423 0 0) 0x7faf6c06dfa0 con 0x7faf6c15e860 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf6affd640 1 -- 172.21.15.120:0/1903506574 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf58003520 con 0x7faf6c15e860 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf6affd640 1 -- 172.21.15.120:0/1903506574 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920217876 0 0) 0x7faf6c06e240 con 0x7faf6c0d43d0 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf6affd640 1 -- 172.21.15.120:0/1903506574 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf6c06dfa0 con 0x7faf6c0d43d0 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf709c9640 1 -- 172.21.15.120:0/1903506574 >> v1:172.21.15.203:6789/0 conn(0x7faf6c0d43d0 legacy=0x7faf6c0d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf709c9640 1 -- 172.21.15.120:0/1903506574 >> v1:172.21.15.120:6789/0 conn(0x7faf6c15e860 legacy=0x7faf6c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.915+0000 7faf709c9640 1 -- 172.21.15.120:0/1903506574 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c06e520 con 0x7faf6c0d06c0 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.916+0000 7faf709c9640 1 --2- 172.21.15.120:0/1903506574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c169260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf64009dc0 tx=0x7faf6402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52698998d3ec6c5c server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.916+0000 7faf6affd640 1 -- 172.21.15.120:0/1903506574 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64039070 con 0x7faf6c0d06c0 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.916+0000 7faf6affd640 1 -- 172.21.15.120:0/1903506574 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6402cc40 con 0x7faf6c0d06c0 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.916+0000 7faf6affd640 1 -- 172.21.15.120:0/1903506574 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64034440 con 0x7faf6c0d06c0 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.917+0000 7faf7242c640 1 -- 172.21.15.120:0/1903506574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 msgr2=0x7faf6c169260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.917+0000 7faf7242c640 1 --2- 172.21.15.120:0/1903506574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c169260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faf64009dc0 tx=0x7faf6402be90 comp rx=0 tx=0).stop 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.917+0000 7faf7242c640 1 -- 172.21.15.120:0/1903506574 shutdown_connections 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.917+0000 7faf7242c640 1 --2- 172.21.15.120:0/1903506574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c169260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.917+0000 7faf7242c640 1 -- 172.21.15.120:0/1903506574 >> 172.21.15.120:0/1903506574 conn(0x7faf6c09d7d0 msgr2=0x7faf6c08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.917+0000 7faf7242c640 1 -- 172.21.15.120:0/1903506574 shutdown_connections 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.917+0000 7faf7242c640 1 -- 172.21.15.120:0/1903506574 wait complete. 2024-03-31T16:36:11.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.918+0000 7faf7242c640 1 Processor -- start 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.918+0000 7faf7242c640 1 -- start start 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf7242c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c0b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf7242c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf6c0d43d0 0x7faf6c0b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf7242c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf6c15e860 0x7faf6c157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf7242c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c06dd80 con 0x7faf6c0d43d0 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf7242c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf6c06dc00 con 0x7faf6c15e860 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf7242c640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c0cedb0 con 0x7faf6c0d06c0 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf6c0d43d0 0x7faf6c0b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf6c0d43d0 0x7faf6c0b7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38780/0 (socket says 172.21.15.120:38780) 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6bfff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c0b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf709c9640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf6c15e860 0x7faf6c157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 -- 172.21.15.120:0/1843392682 learned_addr learned my addr 172.21.15.120:0/1843392682 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 -- 172.21.15.120:0/1843392682 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 msgr2=0x7faf6c0b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c0b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 -- 172.21.15.120:0/1843392682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf6c15e860 msgr2=0x7faf6c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf6c15e860 0x7faf6c157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 -- 172.21.15.120:0/1843392682 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c0b7f70 con 0x7faf6c0d43d0 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf6b7fe640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf6c0d43d0 0x7faf6c0b7a30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c500 tx=0x7faf5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf68ff9640 1 -- 172.21.15.120:0/1843392682 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0052d0 con 0x7faf6c0d43d0 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf68ff9640 1 -- 172.21.15.120:0/1843392682 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5c005490 con 0x7faf6c0d43d0 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6c0b8210 con 0x7faf6c0d43d0 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.919+0000 7faf68ff9640 1 -- 172.21.15.120:0/1843392682 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c012870 con 0x7faf6c0d43d0 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.920+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6c0b87d0 con 0x7faf6c0d43d0 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.921+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6c0685c0 con 0x7faf6c0d43d0 2024-03-31T16:36:11.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.921+0000 7faf68ff9640 1 -- 172.21.15.120:0/1843392682 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf5c012a10 con 0x7faf6c0d43d0 2024-03-31T16:36:11.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.921+0000 7faf68ff9640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7faf4c06c920 0x7faf4c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:11.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.921+0000 7faf68ff9640 1 -- 172.21.15.120:0/1843392682 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faf5c08b6a0 con 0x7faf6c0d43d0 2024-03-31T16:36:11.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.921+0000 7faf6bfff640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7faf4c06c920 0x7faf4c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:11.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.922+0000 7faf6bfff640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7faf4c06c920 0x7faf4c06ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf54000f60 tx=0x7faf54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:11.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:11.926+0000 7faf68ff9640 1 -- 172.21.15.120:0/1843392682 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7faf5c059490 con 0x7faf6c0d43d0 2024-03-31T16:36:12.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.140+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf6c0b6840 con 0x7faf6c0d43d0 2024-03-31T16:36:12.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.140+0000 7faf68ff9640 1 -- 172.21.15.120:0/1843392682 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7faf5c05d790 con 0x7faf6c0d43d0 2024-03-31T16:36:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:12.145 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:35:31.420280+0000","modified":"2024-03-31T16:35:33.846906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-03-31T16:36:12.145 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7faf4c06c920 msgr2=0x7faf4c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7faf4c06c920 0x7faf4c06ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf54000f60 tx=0x7faf54009040 comp rx=0 tx=0).stop 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf6c0d43d0 msgr2=0x7faf6c0b7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf6c0d43d0 0x7faf6c0b7a30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c500 tx=0x7faf5c00c9c0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 shutdown_connections 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7faf4c06c920 0x7faf4c06ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf6c15e860 0x7faf6c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf6c0d43d0 0x7faf6c0b7a30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 --2- 172.21.15.120:0/1843392682 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faf6c0d06c0 0x7faf6c0b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.142+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 >> 172.21.15.120:0/1843392682 conn(0x7faf6c09d7d0 msgr2=0x7faf6c0d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:12.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.143+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 shutdown_connections 2024-03-31T16:36:12.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.143+0000 7faf7242c640 1 -- 172.21.15.120:0/1843392682 wait complete. 2024-03-31T16:36:12.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:36:12.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.257+0000 7f6039faf640 1 Processor -- start 2024-03-31T16:36:12.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.257+0000 7f6039faf640 1 -- start start 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.257+0000 7f6039faf640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f603415e860 0x7f603406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.257+0000 7f6039faf640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f603406da30 0x7f60340d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.257+0000 7f6039faf640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f603406dfa0 con 0x7f60340d4910 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.257+0000 7f6039faf640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f60340d4d60 con 0x7f603415e860 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.257+0000 7f6039faf640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f60340cf220 con 0x7f603406da30 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f6033fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f60340d4910 0x7f60340d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54468/0 (socket says 172.21.15.120:54468) 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f6033fff640 1 -- 172.21.15.120:0/2094483967 learned_addr learned my addr 172.21.15.120:0/2094483967 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f60337fe640 1 --2- 172.21.15.120:0/2094483967 >> v2:172.21.15.203:3300/0 conn(0x7f603415e860 0x7f603406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f602bfff640 1 --2- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f603406da30 0x7f60340d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f6032ffd640 1 -- 172.21.15.120:0/2094483967 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714749138 0 0) 0x7f603406dfa0 con 0x7f60340d4910 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f6032ffd640 1 -- 172.21.15.120:0/2094483967 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6020003520 con 0x7f60340d4910 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f60337fe640 1 -- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f603406da30 msgr2=0x7f60340d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f60337fe640 1 --2- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f603406da30 0x7f60340d43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f60337fe640 1 -- 172.21.15.120:0/2094483967 >> v1:172.21.15.120:6789/0 conn(0x7f60340d4910 legacy=0x7f60340d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f60337fe640 1 -- 172.21.15.120:0/2094483967 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603406e240 con 0x7f603415e860 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.258+0000 7f602bfff640 1 --2- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f603406da30 0x7f60340d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f60337fe640 1 --2- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 0x7f603406d4f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f60240097a0 tx=0x7f602402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ff3d4284237222 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6032ffd640 1 -- 172.21.15.120:0/2094483967 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024035020 con 0x7f603415e860 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6032ffd640 1 -- 172.21.15.120:0/2094483967 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6024031830 con 0x7f603415e860 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6032ffd640 1 -- 172.21.15.120:0/2094483967 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024031c00 con 0x7f603415e860 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6039faf640 1 -- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 msgr2=0x7f603406d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6039faf640 1 --2- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 0x7f603406d4f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f60240097a0 tx=0x7f602402b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6039faf640 1 -- 172.21.15.120:0/2094483967 shutdown_connections 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6039faf640 1 --2- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f603406da30 0x7f60340d43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6039faf640 1 --2- 172.21.15.120:0/2094483967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 0x7f603406d4f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.259+0000 7f6039faf640 1 -- 172.21.15.120:0/2094483967 >> 172.21.15.120:0/2094483967 conn(0x7f603409d7d0 msgr2=0x7f603408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.260+0000 7f6039faf640 1 -- 172.21.15.120:0/2094483967 shutdown_connections 2024-03-31T16:36:12.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.260+0000 7f6039faf640 1 -- 172.21.15.120:0/2094483967 wait complete. 2024-03-31T16:36:12.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f6039faf640 1 Processor -- start 2024-03-31T16:36:12.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f6039faf640 1 -- start start 2024-03-31T16:36:12.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f6039faf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f603406da30 0x7f60341f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f6039faf640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60340d4910 0x7f60340ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f6039faf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 0x7f60340b7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f6039faf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f60340cedb0 con 0x7f603406da30 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f6039faf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60340d2c50 con 0x7f603415e860 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f6039faf640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f60340cef30 con 0x7f60340d4910 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.261+0000 7f60337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f603406da30 0x7f60341f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f60337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f603406da30 0x7f60341f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38788/0 (socket says 172.21.15.120:38788) 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f60337fe640 1 -- 172.21.15.120:0/3066883874 learned_addr learned my addr 172.21.15.120:0/3066883874 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f6033fff640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 0x7f60340b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f602bfff640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60340d4910 0x7f60340ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f60337fe640 1 -- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60340d4910 msgr2=0x7f60340ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f60337fe640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60340d4910 0x7f60340ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f60337fe640 1 -- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 msgr2=0x7f60340b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f60337fe640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 0x7f60340b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f60337fe640 1 -- 172.21.15.120:0/3066883874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60341f54b0 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f6033fff640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 0x7f60340b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f60337fe640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f603406da30 0x7f60341f4f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f602402b910 tx=0x7f60240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f6030ff9640 1 -- 172.21.15.120:0/3066883874 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024040070 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f6030ff9640 1 -- 172.21.15.120:0/3066883874 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602403a930 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60340ce5b0 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f6030ff9640 1 -- 172.21.15.120:0/3066883874 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024035040 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.262+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60340b9140 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.263+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603409dbb0 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.264+0000 7f6030ff9640 1 -- 172.21.15.120:0/3066883874 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f602404b060 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.264+0000 7f6030ff9640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f601406c8f0 0x7f601406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.264+0000 7f6030ff9640 1 -- 172.21.15.120:0/3066883874 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f60240ad1b0 con 0x7f603406da30 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.264+0000 7f602bfff640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f601406c8f0 0x7f601406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.264+0000 7f602bfff640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f601406c8f0 0x7f601406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f601c009560 tx=0x7f601c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.268+0000 7f6030ff9640 1 -- 172.21.15.120:0/3066883874 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f603409dbb0 con 0x7f603406da30 2024-03-31T16:36:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.479+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60340685c0 con 0x7f603406da30 2024-03-31T16:36:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.479+0000 7f6030ff9640 1 -- 172.21.15.120:0/3066883874 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f60341f54b0 con 0x7f603406da30 2024-03-31T16:36:12.483 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/2985305023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2985305023},{"type":"v1","addr":"172.21.15.120:6836","nonce":2985305023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/2783817569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2783817569},{"type":"v1","addr":"172.21.15.203:6834","nonce":2783817569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1595221279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1595221279},{"type":"v1","addr":"172.21.15.120:6837","nonce":1595221279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:35:31.420280+0000","modified":"2024-03-31T16:35:33.846906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6835/705983605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":705983605},{"type":"v1","addr":"172.21.15.203:6835","nonce":705983605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-03-31T16:36:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2024-03-31T16:36:12.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f601406c8f0 msgr2=0x7f601406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f601406c8f0 0x7f601406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f601c009560 tx=0x7f601c009190 comp rx=0 tx=0).stop 2024-03-31T16:36:12.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f603406da30 msgr2=0x7f60341f4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f603406da30 0x7f60341f4f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f602402b910 tx=0x7f60240046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 shutdown_connections 2024-03-31T16:36:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f601406c8f0 0x7f601406edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f603415e860 0x7f60340b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f60340d4910 0x7f60340ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 --2- 172.21.15.120:0/3066883874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f603406da30 0x7f60341f4f70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 >> 172.21.15.120:0/3066883874 conn(0x7f603409d7d0 msgr2=0x7f60340b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 shutdown_connections 2024-03-31T16:36:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.481+0000 7f6039faf640 1 -- 172.21.15.120:0/3066883874 wait complete. 2024-03-31T16:36:12.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:12.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.592+0000 7f3f4d1f2640 1 Processor -- start 2024-03-31T16:36:12.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.592+0000 7f3f4d1f2640 1 -- start start 2024-03-31T16:36:12.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f4d1f2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f481590c0 0x7f3f4815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f4d1f2640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4815fe10 con 0x7f3f4806c580 2024-03-31T16:36:12.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f4d1f2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f48163260 con 0x7f3f4806fa50 2024-03-31T16:36:12.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f4d1f2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4806e5b0 con 0x7f3f481590c0 2024-03-31T16:36:12.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f46d9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f481590c0 0x7f3f4815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f3ffff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3f4806c580 0x7f3f48162440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54484/0 (socket says 172.21.15.120:54484) 2024-03-31T16:36:12.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f3ffff640 1 -- 172.21.15.120:0/1236139406 learned_addr learned my addr 172.21.15.120:0/1236139406 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:12.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f46d9d640 1 -- 172.21.15.120:0/1236139406 >> v1:172.21.15.203:6789/0 conn(0x7f3f4806fa50 legacy=0x7f3f48162b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f46d9d640 1 -- 172.21.15.120:0/1236139406 >> v1:172.21.15.120:6789/0 conn(0x7f3f4806c580 legacy=0x7f3f48162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f46d9d640 1 -- 172.21.15.120:0/1236139406 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f48067900 con 0x7f3f481590c0 2024-03-31T16:36:12.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.593+0000 7f3f4659c640 1 -- 172.21.15.120:0/1236139406 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521659967 0 0) 0x7f3f30001110 con 0x7f3f4806c580 2024-03-31T16:36:12.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.594+0000 7f3f46d9d640 1 --2- 172.21.15.120:0/1236139406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f481590c0 0x7f3f4815f8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3f380097a0 tx=0x7f3f3802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7199312aba72f433 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.594+0000 7f3f4659c640 1 -- 172.21.15.120:0/1236139406 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f38034070 con 0x7f3f481590c0 2024-03-31T16:36:12.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.594+0000 7f3f4659c640 1 -- 172.21.15.120:0/1236139406 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f38030610 con 0x7f3f481590c0 2024-03-31T16:36:12.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.594+0000 7f3f4659c640 1 -- 172.21.15.120:0/1236139406 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f380309e0 con 0x7f3f481590c0 2024-03-31T16:36:12.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.594+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1236139406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f481590c0 msgr2=0x7f3f4815f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.594+0000 7f3f4d1f2640 1 --2- 172.21.15.120:0/1236139406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f481590c0 0x7f3f4815f8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3f380097a0 tx=0x7f3f3802b960 comp rx=0 tx=0).stop 2024-03-31T16:36:12.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.595+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1236139406 shutdown_connections 2024-03-31T16:36:12.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.595+0000 7f3f4d1f2640 1 --2- 172.21.15.120:0/1236139406 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f481590c0 0x7f3f4815f8d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.595+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1236139406 >> 172.21.15.120:0/1236139406 conn(0x7f3f48071e60 msgr2=0x7f3f48072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:12.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.595+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1236139406 shutdown_connections 2024-03-31T16:36:12.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.595+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1236139406 wait complete. 2024-03-31T16:36:12.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.596+0000 7f3f4d1f2640 1 Processor -- start 2024-03-31T16:36:12.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.596+0000 7f3f4d1f2640 1 -- start start 2024-03-31T16:36:12.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.596+0000 7f3f4d1f2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f4806c580 0x7f3f480cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4d1f2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f4806fa50 0x7f3f48144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4d1f2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f481590c0 0x7f3f481e8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4d1f2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4806df60 con 0x7f3f4806fa50 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4d1f2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3f480b4ab0 con 0x7f3f4806c580 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4d1f2640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4806e240 con 0x7f3f481590c0 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f4806fa50 0x7f3f48144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f4806fa50 0x7f3f48144350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38814/0 (socket says 172.21.15.120:38814) 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 -- 172.21.15.120:0/1749183751 learned_addr learned my addr 172.21.15.120:0/1749183751 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f46d9d640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f4806c580 0x7f3f480cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4759e640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f481590c0 0x7f3f481e8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 -- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f481590c0 msgr2=0x7f3f481e8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f481590c0 0x7f3f481e8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 -- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f4806c580 msgr2=0x7f3f480cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f4806c580 0x7f3f480cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 -- 172.21.15.120:0/1749183751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f480ce860 con 0x7f3f4806fa50 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4759e640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f481590c0 0x7f3f481e8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3ffff640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f4806fa50 0x7f3f48144350 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c750 tx=0x7f3f3000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3f7fe640 1 -- 172.21.15.120:0/1749183751 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30018070 con 0x7f3f4806fa50 2024-03-31T16:36:12.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3f7fe640 1 -- 172.21.15.120:0/1749183751 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f300070d0 con 0x7f3f4806fa50 2024-03-31T16:36:12.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f480ceb40 con 0x7f3f4806fa50 2024-03-31T16:36:12.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f3f7fe640 1 -- 172.21.15.120:0/1749183751 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f300074c0 con 0x7f3f4806fa50 2024-03-31T16:36:12.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.597+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f480cf100 con 0x7f3f4806fa50 2024-03-31T16:36:12.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.598+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f480685c0 con 0x7f3f4806fa50 2024-03-31T16:36:12.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.599+0000 7f3f3f7fe640 1 -- 172.21.15.120:0/1749183751 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f300047e0 con 0x7f3f4806fa50 2024-03-31T16:36:12.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.599+0000 7f3f3f7fe640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3f2806c8f0 0x7f3f2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.599+0000 7f3f46d9d640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3f2806c8f0 0x7f3f2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.599+0000 7f3f3f7fe640 1 -- 172.21.15.120:0/1749183751 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f3f3008aee0 con 0x7f3f4806fa50 2024-03-31T16:36:12.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.600+0000 7f3f46d9d640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3f2806c8f0 0x7f3f2806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3f38036000 tx=0x7f3f38008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.604+0000 7f3f3f7fe640 1 -- 172.21.15.120:0/1749183751 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3f4815fe10 con 0x7f3f4806fa50 2024-03-31T16:36:12.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.780+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f48067590 con 0x7f3f4806fa50 2024-03-31T16:36:12.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.781+0000 7f3f3f7fe640 1 -- 172.21.15.120:0/1749183751 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16866 (secure 0 0 0) 0x7f3f30058bc0 con 0x7f3f4806fa50 2024-03-31T16:36:12.785 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:12.785 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":21,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:12.167744+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:35:29.923938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-31T16:35:30.364493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3f2806c8f0 msgr2=0x7f3f2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3f2806c8f0 0x7f3f2806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3f38036000 tx=0x7f3f38008030 comp rx=0 tx=0).stop 2024-03-31T16:36:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f4806fa50 msgr2=0x7f3f48144350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f4806fa50 0x7f3f48144350 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c750 tx=0x7f3f3000cc10 comp rx=0 tx=0).stop 2024-03-31T16:36:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 shutdown_connections 2024-03-31T16:36:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3f2806c8f0 0x7f3f2806edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3f481590c0 0x7f3f481e8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f4806fa50 0x7f3f48144350 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 --2- 172.21.15.120:0/1749183751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3f4806c580 0x7f3f480cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 >> 172.21.15.120:0/1749183751 conn(0x7f3f48071e60 msgr2=0x7f3f48157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 shutdown_connections 2024-03-31T16:36:12.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.783+0000 7f3f4d1f2640 1 -- 172.21.15.120:0/1749183751 wait complete. 2024-03-31T16:36:12.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-31T16:36:12.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.896+0000 7fd0cacc5640 1 Processor -- start 2024-03-31T16:36:12.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.896+0000 7fd0cacc5640 1 -- start start 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.896+0000 7fd0cacc5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd0c40d43d0 0x7fd0c40d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.896+0000 7fd0cacc5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c40cf6b0 0x7fd0c40cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.896+0000 7fd0cacc5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c40d4d20 con 0x7fd0c415e860 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.896+0000 7fd0cacc5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c40cf220 con 0x7fd0c40d43d0 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.896+0000 7fd0cacc5640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c406dfa0 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd0c40d43d0 0x7fd0c40d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c8a61640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd0c415e860 0x7fd0c406d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54496/0 (socket says 172.21.15.120:54496) 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c8a61640 1 -- 172.21.15.120:0/783697733 learned_addr learned my addr 172.21.15.120:0/783697733 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c9262640 1 --2- 172.21.15.120:0/783697733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c40cf6b0 0x7fd0c40cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c3fff640 1 -- 172.21.15.120:0/783697733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c40cf6b0 msgr2=0x7fd0c40cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c3fff640 1 --2- 172.21.15.120:0/783697733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c40cf6b0 0x7fd0c40cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c3fff640 1 -- 172.21.15.120:0/783697733 >> v1:172.21.15.120:6789/0 conn(0x7fd0c415e860 legacy=0x7fd0c406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c37fe640 1 -- 172.21.15.120:0/783697733 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1897169866 0 0) 0x7fd0b8001110 con 0x7fd0c415e860 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.897+0000 7fd0c3fff640 1 -- 172.21.15.120:0/783697733 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c406e240 con 0x7fd0c40d43d0 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0c3fff640 1 --2- 172.21.15.120:0/783697733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40d43d0 0x7fd0c40d47e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00097a0 tx=0x7fd0b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4074c2ba61ea0d server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0c37fe640 1 -- 172.21.15.120:0/783697733 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0035020 con 0x7fd0c40d43d0 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0c37fe640 1 -- 172.21.15.120:0/783697733 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b0031830 con 0x7fd0c40d43d0 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0c37fe640 1 -- 172.21.15.120:0/783697733 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0031c00 con 0x7fd0c40d43d0 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0cacc5640 1 -- 172.21.15.120:0/783697733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40d43d0 msgr2=0x7fd0c40d47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/783697733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40d43d0 0x7fd0c40d47e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00097a0 tx=0x7fd0b002b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0cacc5640 1 -- 172.21.15.120:0/783697733 shutdown_connections 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/783697733 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c40cf6b0 0x7fd0c40cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/783697733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40d43d0 0x7fd0c40d47e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0cacc5640 1 -- 172.21.15.120:0/783697733 >> 172.21.15.120:0/783697733 conn(0x7fd0c409d7d0 msgr2=0x7fd0c408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0cacc5640 1 -- 172.21.15.120:0/783697733 shutdown_connections 2024-03-31T16:36:12.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.898+0000 7fd0cacc5640 1 -- 172.21.15.120:0/783697733 wait complete. 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.899+0000 7fd0cacc5640 1 Processor -- start 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.899+0000 7fd0cacc5640 1 -- start start 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0cacc5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40cf6b0 0x7fd0c4152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0cacc5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0c40d43d0 0x7fd0c4160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0cacc5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c415e860 0x7fd0c40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0cacc5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c406dc00 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0cacc5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c40d2c50 con 0x7fd0c40d43d0 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0cacc5640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c406dd80 con 0x7fd0c415e860 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0c8a61640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40cf6b0 0x7fd0c4152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0c8a61640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40cf6b0 0x7fd0c4152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38838/0 (socket says 172.21.15.120:38838) 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0c8a61640 1 -- 172.21.15.120:0/3201745448 learned_addr learned my addr 172.21.15.120:0/3201745448 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.900+0000 7fd0c3fff640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0c40d43d0 0x7fd0c4160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c9262640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c415e860 0x7fd0c40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c8a61640 1 -- 172.21.15.120:0/3201745448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c415e860 msgr2=0x7fd0c40b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c8a61640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c415e860 0x7fd0c40b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c8a61640 1 -- 172.21.15.120:0/3201745448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0c40d43d0 msgr2=0x7fd0c4160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c8a61640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0c40d43d0 0x7fd0c4160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c8a61640 1 -- 172.21.15.120:0/3201745448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c40c7f70 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c8a61640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40cf6b0 0x7fd0c4152bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c400 tx=0x7fd0b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c17fa640 1 -- 172.21.15.120:0/3201745448 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8017070 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c17fa640 1 -- 172.21.15.120:0/3201745448 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b8005ce0 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c40c8230 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0c17fa640 1 -- 172.21.15.120:0/3201745448 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8007310 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.908 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.901+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c40c87f0 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.902+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c40685c0 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.903+0000 7fd0c17fa640 1 -- 172.21.15.120:0/3201745448 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0b801a070 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.903+0000 7fd0c17fa640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd0a806c8f0 0x7fd0a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:12.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.903+0000 7fd0c17fa640 1 -- 172.21.15.120:0/3201745448 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fd0b808aec0 con 0x7fd0c40cf6b0 2024-03-31T16:36:12.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.903+0000 7fd0c3fff640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd0a806c8f0 0x7fd0a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:12.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.903+0000 7fd0c3fff640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd0a806c8f0 0x7fd0a806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0036000 tx=0x7fd0b0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:12.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:12.907+0000 7fd0c17fa640 1 -- 172.21.15.120:0/3201745448 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd0c40d4d20 con 0x7fd0c40cf6b0 2024-03-31T16:36:13.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.119+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd0c40d0830 con 0x7fd0c40cf6b0 2024-03-31T16:36:13.124 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-03-31T16:36:13.120+0000 7fee2d7ce640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-31T16:36:13.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.121+0000 7fd0c17fa640 1 -- 172.21.15.120:0/3201745448 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7fd0b8058cb0 con 0x7fd0c40cf6b0 2024-03-31T16:36:13.125 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd0a806c8f0 msgr2=0x7fd0a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd0a806c8f0 0x7fd0a806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0036000 tx=0x7fd0b0008030 comp rx=0 tx=0).stop 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40cf6b0 msgr2=0x7fd0c4152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40cf6b0 0x7fd0c4152bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c400 tx=0x7fd0b800c8c0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 shutdown_connections 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd0a806c8f0 0x7fd0a806edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd0c415e860 0x7fd0c40b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd0c40d43d0 0x7fd0c4160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 --2- 172.21.15.120:0/3201745448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd0c40cf6b0 0x7fd0c4152bd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.123+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 >> 172.21.15.120:0/3201745448 conn(0x7fd0c409d7d0 msgr2=0x7fd0c406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.124+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 shutdown_connections 2024-03-31T16:36:13.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.124+0000 7fd0cacc5640 1 -- 172.21.15.120:0/3201745448 wait complete. 2024-03-31T16:36:13.133 INFO:tasks.ceph.mds.b.smithi203.stderr: -7388> 2024-03-31T16:35:36.503+0000 7f407a8d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-31T16:36:13.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-31T16:36:13.164 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-03-31T16:36:13.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.239+0000 7fa176732640 1 Processor -- start 2024-03-31T16:36:13.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.239+0000 7fa176732640 1 -- start start 2024-03-31T16:36:13.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa176732640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa1700d0280 0x7fa1700d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:13.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa176732640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa170141c10 0x7fa170071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:13.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa176732640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17015ec80 con 0x7fa170071eb0 2024-03-31T16:36:13.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa176732640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa1700d0ba0 con 0x7fa1700d0280 2024-03-31T16:36:13.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa176732640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa17015ef20 con 0x7fa170141c10 2024-03-31T16:36:13.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa16ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa1700d0280 0x7fa1700d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:13.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa16ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa1700d0280 0x7fa1700d0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38850/0 (socket says 172.21.15.120:38850) 2024-03-31T16:36:13.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa16ffff640 1 -- 172.21.15.120:0/493450637 learned_addr learned my addr 172.21.15.120:0/493450637 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:13.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa16f7fe640 1 --2- 172.21.15.120:0/493450637 >> v2:172.21.15.203:3300/0 conn(0x7fa170141c10 0x7fa170071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:13.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa16ffff640 1 -- 172.21.15.120:0/493450637 >> v2:172.21.15.203:3300/0 conn(0x7fa170141c10 msgr2=0x7fa170071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:13.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa16ffff640 1 --2- 172.21.15.120:0/493450637 >> v2:172.21.15.203:3300/0 conn(0x7fa170141c10 0x7fa170071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa16ffff640 1 -- 172.21.15.120:0/493450637 >> v1:172.21.15.203:6789/0 conn(0x7fa170071eb0 legacy=0x7fa17006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:13.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.240+0000 7fa16ffff640 1 -- 172.21.15.120:0/493450637 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17015f200 con 0x7fa1700d0280 2024-03-31T16:36:13.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.241+0000 7fa16ffff640 1 --2- 172.21.15.120:0/493450637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1700d0280 0x7fa1700d0660 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa1700b5270 tx=0x7fa16002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230821284951b4cb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:13.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.241+0000 7fa16effd640 1 -- 172.21.15.120:0/493450637 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160035020 con 0x7fa1700d0280 2024-03-31T16:36:13.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.241+0000 7fa16effd640 1 -- 172.21.15.120:0/493450637 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa160031870 con 0x7fa1700d0280 2024-03-31T16:36:13.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.241+0000 7fa16effd640 1 -- 172.21.15.120:0/493450637 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160031c40 con 0x7fa1700d0280 2024-03-31T16:36:13.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.242+0000 7fa176732640 1 -- 172.21.15.120:0/493450637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1700d0280 msgr2=0x7fa1700d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:13.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.242+0000 7fa176732640 1 --2- 172.21.15.120:0/493450637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1700d0280 0x7fa1700d0660 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa1700b5270 tx=0x7fa16002b910 comp rx=0 tx=0).stop 2024-03-31T16:36:13.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.242+0000 7fa176732640 1 -- 172.21.15.120:0/493450637 shutdown_connections 2024-03-31T16:36:13.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.242+0000 7fa176732640 1 --2- 172.21.15.120:0/493450637 >> v2:172.21.15.203:3300/0 conn(0x7fa170141c10 0x7fa170071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.242+0000 7fa176732640 1 --2- 172.21.15.120:0/493450637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa1700d0280 0x7fa1700d0660 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.242+0000 7fa176732640 1 -- 172.21.15.120:0/493450637 >> 172.21.15.120:0/493450637 conn(0x7fa17006b750 msgr2=0x7fa17006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.242+0000 7fa176732640 1 -- 172.21.15.120:0/493450637 shutdown_connections 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.242+0000 7fa176732640 1 -- 172.21.15.120:0/493450637 wait complete. 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.243+0000 7fa176732640 1 Processor -- start 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.243+0000 7fa176732640 1 -- start start 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa176732640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa170071eb0 0x7fa1700ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa176732640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1700d0280 0x7fa1700b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa176732640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa170141c10 0x7fa1700b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa176732640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa170158e90 con 0x7fa170141c10 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa176732640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa17015f7c0 con 0x7fa1700d0280 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa176732640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa1700adf70 con 0x7fa170071eb0 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa170141c10 0x7fa1700b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:13.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa170141c10 0x7fa1700b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38866/0 (socket says 172.21.15.120:38866) 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 -- 172.21.15.120:0/1578100263 learned_addr learned my addr 172.21.15.120:0/1578100263 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa16f7fe640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1700d0280 0x7fa1700b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa16ffff640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa170071eb0 0x7fa1700ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 -- 172.21.15.120:0/1578100263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa170071eb0 msgr2=0x7fa1700ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa170071eb0 0x7fa1700ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 -- 172.21.15.120:0/1578100263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1700d0280 msgr2=0x7fa1700b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1700d0280 0x7fa1700b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 -- 172.21.15.120:0/1578100263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1700af290 con 0x7fa170141c10 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa174ccf640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa170141c10 0x7fa1700b16a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa16800c780 tx=0x7fa16800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa16cff9640 1 -- 172.21.15.120:0/1578100263 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168004b60 con 0x7fa170141c10 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa16cff9640 1 -- 172.21.15.120:0/1578100263 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa168004d00 con 0x7fa170141c10 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1700ae1f0 con 0x7fa170141c10 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa16cff9640 1 -- 172.21.15.120:0/1578100263 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16800aa90 con 0x7fa170141c10 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.244+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1700ae7b0 con 0x7fa170141c10 2024-03-31T16:36:13.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.246+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1700685c0 con 0x7fa170141c10 2024-03-31T16:36:13.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.246+0000 7fa16cff9640 1 -- 172.21.15.120:0/1578100263 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa16800ac30 con 0x7fa170141c10 2024-03-31T16:36:13.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.246+0000 7fa16cff9640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa15c06c8f0 0x7fa15c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:13.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.246+0000 7fa16cff9640 1 -- 172.21.15.120:0/1578100263 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5911+0+0 (secure 0 0 0) 0x7fa16808be50 con 0x7fa170141c10 2024-03-31T16:36:13.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.246+0000 7fa16ffff640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa15c06c8f0 0x7fa15c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:13.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.247+0000 7fa16ffff640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa15c06c8f0 0x7fa15c06edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa160036000 tx=0x7fa16003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:13.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.251+0000 7fa16cff9640 1 -- 172.21.15.120:0/1578100263 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa168020070 con 0x7fa170141c10 2024-03-31T16:36:13.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:13.463+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa1700cfdb0 con 0x7fa170141c10 2024-03-31T16:36:14.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.122+0000 7fa16cff9640 1 -- 172.21.15.120:0/1578100263 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fa168059ad0 con 0x7fa170141c10 2024-03-31T16:36:14.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa15c06c8f0 msgr2=0x7fa15c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:14.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa15c06c8f0 0x7fa15c06edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa160036000 tx=0x7fa16003c040 comp rx=0 tx=0).stop 2024-03-31T16:36:14.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa170141c10 msgr2=0x7fa1700b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:14.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa170141c10 0x7fa1700b16a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa16800c780 tx=0x7fa16800cc40 comp rx=0 tx=0).stop 2024-03-31T16:36:14.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 shutdown_connections 2024-03-31T16:36:14.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa15c06c8f0 0x7fa15c06edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa170141c10 0x7fa1700b16a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1700d0280 0x7fa1700b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 --2- 172.21.15.120:0/1578100263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa170071eb0 0x7fa1700ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 >> 172.21.15.120:0/1578100263 conn(0x7fa17006b750 msgr2=0x7fa170147190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:14.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 shutdown_connections 2024-03-31T16:36:14.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.125+0000 7fa176732640 1 -- 172.21.15.120:0/1578100263 wait complete. 2024-03-31T16:36:14.141 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-31T16:36:14.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.243+0000 7fcd16b40640 1 Processor -- start 2024-03-31T16:36:14.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.243+0000 7fcd16b40640 1 -- start start 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd16b40640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd100d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd16b40640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcd100d15a0 0x7fcd1015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd16b40640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd100b7410 con 0x7fcd100b7030 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd16b40640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcd10160150 con 0x7fcd100d15a0 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd16b40640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcd10160430 con 0x7fcd10070010 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd150dd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcd100d15a0 0x7fcd1015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd148dc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcd100b7030 0x7fcd1006f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54510/0 (socket says 172.21.15.120:54510) 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd148dc640 1 -- 172.21.15.120:0/1585830783 learned_addr learned my addr 172.21.15.120:0/1585830783 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:14.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd150dd640 1 -- 172.21.15.120:0/1585830783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 msgr2=0x7fcd100d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd07fff640 1 --2- 172.21.15.120:0/1585830783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd100d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd150dd640 1 --2- 172.21.15.120:0/1585830783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd100d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd150dd640 1 -- 172.21.15.120:0/1585830783 >> v1:172.21.15.120:6789/0 conn(0x7fcd100b7030 legacy=0x7fcd1006f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd150dd640 1 -- 172.21.15.120:0/1585830783 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd10160710 con 0x7fcd100d15a0 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd077fe640 1 -- 172.21.15.120:0/1585830783 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595164547 0 0) 0x7fcd100b7410 con 0x7fcd100b7030 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.244+0000 7fcd07fff640 1 --2- 172.21.15.120:0/1585830783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd100d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.245+0000 7fcd150dd640 1 --2- 172.21.15.120:0/1585830783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100d15a0 0x7fcd1015c9c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009d90 tx=0x7fcd0802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a64e8e1c461960 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.245+0000 7fcd077fe640 1 -- 172.21.15.120:0/1585830783 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08039070 con 0x7fcd100d15a0 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.245+0000 7fcd077fe640 1 -- 172.21.15.120:0/1585830783 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0802cbc0 con 0x7fcd100d15a0 2024-03-31T16:36:14.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.245+0000 7fcd077fe640 1 -- 172.21.15.120:0/1585830783 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08034440 con 0x7fcd100d15a0 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.246+0000 7fcd16b40640 1 -- 172.21.15.120:0/1585830783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100d15a0 msgr2=0x7fcd1015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.246+0000 7fcd16b40640 1 --2- 172.21.15.120:0/1585830783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100d15a0 0x7fcd1015c9c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009d90 tx=0x7fcd0802be10 comp rx=0 tx=0).stop 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.246+0000 7fcd16b40640 1 -- 172.21.15.120:0/1585830783 shutdown_connections 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.246+0000 7fcd16b40640 1 --2- 172.21.15.120:0/1585830783 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100d15a0 0x7fcd1015c9c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.246+0000 7fcd16b40640 1 --2- 172.21.15.120:0/1585830783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd100d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.246+0000 7fcd16b40640 1 -- 172.21.15.120:0/1585830783 >> 172.21.15.120:0/1585830783 conn(0x7fcd1006bbd0 msgr2=0x7fcd100b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.246+0000 7fcd16b40640 1 -- 172.21.15.120:0/1585830783 shutdown_connections 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.246+0000 7fcd16b40640 1 -- 172.21.15.120:0/1585830783 wait complete. 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.247+0000 7fcd16b40640 1 Processor -- start 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.247+0000 7fcd16b40640 1 -- start start 2024-03-31T16:36:14.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd16b40640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd101f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd16b40640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100b7030 0x7fcd100c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd16b40640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd100d15a0 0x7fcd1015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd16b40640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcd100b6280 con 0x7fcd100b7030 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd16b40640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcd100d1a30 con 0x7fcd100d15a0 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd16b40640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcd100b6400 con 0x7fcd10070010 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100b7030 0x7fcd100c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100b7030 0x7fcd100c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38880/0 (socket says 172.21.15.120:38880) 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 -- 172.21.15.120:0/481693849 learned_addr learned my addr 172.21.15.120:0/481693849 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd148dc640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd101f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd150dd640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd100d15a0 0x7fcd1015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 -- 172.21.15.120:0/481693849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 msgr2=0x7fcd101f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd101f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 -- 172.21.15.120:0/481693849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd100d15a0 msgr2=0x7fcd1015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:14.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd100d15a0 0x7fcd1015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:14.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 -- 172.21.15.120:0/481693849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd100c71c0 con 0x7fcd100b7030 2024-03-31T16:36:14.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd07fff640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100b7030 0x7fcd100c8570 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000c7f0 tx=0x7fcd0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:14.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd057fa640 1 -- 172.21.15.120:0/481693849 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00015070 con 0x7fcd100b7030 2024-03-31T16:36:14.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd057fa640 1 -- 172.21.15.120:0/481693849 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd00007820 con 0x7fcd100b7030 2024-03-31T16:36:14.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd100c74a0 con 0x7fcd100b7030 2024-03-31T16:36:14.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd057fa640 1 -- 172.21.15.120:0/481693849 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00007bd0 con 0x7fcd100b7030 2024-03-31T16:36:14.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.248+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd100c7a60 con 0x7fcd100b7030 2024-03-31T16:36:14.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.249+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd10068cd0 con 0x7fcd100b7030 2024-03-31T16:36:14.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.250+0000 7fcd057fa640 1 -- 172.21.15.120:0/481693849 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd00018070 con 0x7fcd100b7030 2024-03-31T16:36:14.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.250+0000 7fcd057fa640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fccfc06c8f0 0x7fccfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:14.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.250+0000 7fcd057fa640 1 -- 172.21.15.120:0/481693849 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5911+0+0 (secure 0 0 0) 0x7fcd0008bd00 con 0x7fcd100b7030 2024-03-31T16:36:14.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.250+0000 7fcd148dc640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fccfc06c8f0 0x7fccfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:14.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.251+0000 7fcd148dc640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fccfc06c8f0 0x7fccfc06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c000f60 tx=0x7fcd0c007b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:14.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.255+0000 7fcd057fa640 1 -- 172.21.15.120:0/481693849 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcd0005a0f0 con 0x7fcd100b7030 2024-03-31T16:36:14.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:14.427+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd100d2f90 con 0x7fcd100b7030 2024-03-31T16:36:15.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.183+0000 7fcd057fa640 1 -- 172.21.15.120:0/481693849 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7fcd000599f0 con 0x7fcd100b7030 2024-03-31T16:36:15.187 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2024-03-31T16:36:15.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fccfc06c8f0 msgr2=0x7fccfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:15.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fccfc06c8f0 0x7fccfc06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c000f60 tx=0x7fcd0c007b70 comp rx=0 tx=0).stop 2024-03-31T16:36:15.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100b7030 msgr2=0x7fcd100c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:15.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100b7030 0x7fcd100c8570 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000c7f0 tx=0x7fcd0000ccb0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 shutdown_connections 2024-03-31T16:36:15.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fccfc06c8f0 0x7fccfc06edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd100d15a0 0x7fcd1015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd100b7030 0x7fcd100c8570 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 --2- 172.21.15.120:0/481693849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd10070010 0x7fcd101f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.186+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 >> 172.21.15.120:0/481693849 conn(0x7fcd1006bbd0 msgr2=0x7fcd10074580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:15.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.187+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 shutdown_connections 2024-03-31T16:36:15.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.187+0000 7fcd16b40640 1 -- 172.21.15.120:0/481693849 wait complete. 2024-03-31T16:36:15.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-31T16:36:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.305+0000 7fb7dfb15640 1 Processor -- start 2024-03-31T16:36:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.305+0000 7fb7dfb15640 1 -- start start 2024-03-31T16:36:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dfb15640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb7d815f730 0x7fb7d81621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dfb15640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb7d815ec90 0x7fb7d80ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dfb15640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d80aecf0 0x7fb7d806b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dfb15640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d815fb10 con 0x7fb7d815f730 2024-03-31T16:36:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dfb15640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d8162aa0 con 0x7fb7d815ec90 2024-03-31T16:36:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dfb15640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d8162d80 con 0x7fb7d80aecf0 2024-03-31T16:36:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd8b1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb7d815f730 0x7fb7d81621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd8b1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb7d815f730 0x7fb7d81621a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54486/0 (socket says 172.21.15.120:54486) 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd8b1640 1 -- 172.21.15.120:0/2055574797 learned_addr learned my addr 172.21.15.120:0/2055574797 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd0b0640 1 --2- 172.21.15.120:0/2055574797 >> v2:172.21.15.203:3300/0 conn(0x7fb7d815ec90 0x7fb7d80ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd8b1640 1 -- 172.21.15.120:0/2055574797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d80aecf0 msgr2=0x7fb7d806b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7de0b2640 1 --2- 172.21.15.120:0/2055574797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d80aecf0 0x7fb7d806b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd8b1640 1 --2- 172.21.15.120:0/2055574797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d80aecf0 0x7fb7d806b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd8b1640 1 -- 172.21.15.120:0/2055574797 >> v2:172.21.15.203:3300/0 conn(0x7fb7d815ec90 msgr2=0x7fb7d80ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd8b1640 1 --2- 172.21.15.120:0/2055574797 >> v2:172.21.15.203:3300/0 conn(0x7fb7d815ec90 0x7fb7d80ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd8b1640 1 -- 172.21.15.120:0/2055574797 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d8163060 con 0x7fb7d815f730 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7de0b2640 1 --2- 172.21.15.120:0/2055574797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d80aecf0 0x7fb7d806b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.306+0000 7fb7dd0b0640 1 --2- 172.21.15.120:0/2055574797 >> v2:172.21.15.203:3300/0 conn(0x7fb7d815ec90 0x7fb7d80ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.307+0000 7fb7dd8b1640 1 --2- 172.21.15.120:0/2055574797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815f730 0x7fb7d81621a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8155ca0 tx=0x7fb7d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4bcff297574d40 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.307+0000 7fb7dc8af640 1 -- 172.21.15.120:0/2055574797 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d402e070 con 0x7fb7d815f730 2024-03-31T16:36:15.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.307+0000 7fb7dc8af640 1 -- 172.21.15.120:0/2055574797 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d4037070 con 0x7fb7d815f730 2024-03-31T16:36:15.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.307+0000 7fb7dc8af640 1 -- 172.21.15.120:0/2055574797 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4031a00 con 0x7fb7d815f730 2024-03-31T16:36:15.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.307+0000 7fb7dfb15640 1 -- 172.21.15.120:0/2055574797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815f730 msgr2=0x7fb7d81621a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:15.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.307+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/2055574797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815f730 0x7fb7d81621a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8155ca0 tx=0x7fb7d402b880 comp rx=0 tx=0).stop 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.308+0000 7fb7dfb15640 1 -- 172.21.15.120:0/2055574797 shutdown_connections 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.308+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/2055574797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d80aecf0 0x7fb7d806b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.308+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/2055574797 >> v2:172.21.15.203:3300/0 conn(0x7fb7d815ec90 0x7fb7d80ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.308+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/2055574797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815f730 0x7fb7d81621a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.308+0000 7fb7dfb15640 1 -- 172.21.15.120:0/2055574797 >> 172.21.15.120:0/2055574797 conn(0x7fb7d80b2670 msgr2=0x7fb7d80b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.308+0000 7fb7dfb15640 1 -- 172.21.15.120:0/2055574797 shutdown_connections 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.308+0000 7fb7dfb15640 1 -- 172.21.15.120:0/2055574797 wait complete. 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.309+0000 7fb7dfb15640 1 Processor -- start 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.309+0000 7fb7dfb15640 1 -- start start 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.309+0000 7fb7dfb15640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d80aecf0 0x7fb7d8146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.309+0000 7fb7dfb15640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815ec90 0x7fb7d80cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.309+0000 7fb7dfb15640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d815f730 0x7fb7d806e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:15.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.309+0000 7fb7dfb15640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d81626e0 con 0x7fb7d815ec90 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.309+0000 7fb7dfb15640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d80ae290 con 0x7fb7d80aecf0 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.309+0000 7fb7dfb15640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d8162860 con 0x7fb7d815f730 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815ec90 0x7fb7d80cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815ec90 0x7fb7d80cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54498/0 (socket says 172.21.15.120:54498) 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 -- 172.21.15.120:0/487740351 learned_addr learned my addr 172.21.15.120:0/487740351 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 -- 172.21.15.120:0/487740351 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d815f730 msgr2=0x7fb7d806e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d815f730 0x7fb7d806e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 -- 172.21.15.120:0/487740351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d80aecf0 msgr2=0x7fb7d8146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d80aecf0 0x7fb7d8146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 -- 172.21.15.120:0/487740351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d80cd2d0 con 0x7fb7d815ec90 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dd0b0640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815ec90 0x7fb7d80cc9f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800c7f0 tx=0x7fb7c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7ce7fc640 1 -- 172.21.15.120:0/487740351 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8015070 con 0x7fb7d815ec90 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7ce7fc640 1 -- 172.21.15.120:0/487740351 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c8007a30 con 0x7fb7d815ec90 2024-03-31T16:36:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d80cd5b0 con 0x7fb7d815ec90 2024-03-31T16:36:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7ce7fc640 1 -- 172.21.15.120:0/487740351 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c8007e00 con 0x7fb7d815ec90 2024-03-31T16:36:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.310+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d80cde50 con 0x7fb7d815ec90 2024-03-31T16:36:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.311+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d80ce050 con 0x7fb7d815ec90 2024-03-31T16:36:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.312+0000 7fb7ce7fc640 1 -- 172.21.15.120:0/487740351 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7c8018070 con 0x7fb7d815ec90 2024-03-31T16:36:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.312+0000 7fb7ce7fc640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb7bc06c8f0 0x7fb7bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.312+0000 7fb7ce7fc640 1 -- 172.21.15.120:0/487740351 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5473+0+0 (secure 0 0 0) 0x7fb7c808b9a0 con 0x7fb7d815ec90 2024-03-31T16:36:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.312+0000 7fb7dd8b1640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb7bc06c8f0 0x7fb7bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.312+0000 7fb7dd8b1640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb7bc06c8f0 0x7fb7bc06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4036000 tx=0x7fb7d4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.316+0000 7fb7ce7fc640 1 -- 172.21.15.120:0/487740351 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb7d80ce050 con 0x7fb7d815ec90 2024-03-31T16:36:15.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:15.494+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb7d80685c0 con 0x7fb7d815ec90 2024-03-31T16:36:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.188+0000 7fb7ce7fc640 1 -- 172.21.15.120:0/487740351 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7fb7c8059eb0 con 0x7fb7d815ec90 2024-03-31T16:36:16.193 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.192+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb7bc06c8f0 msgr2=0x7fb7bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.192+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb7bc06c8f0 0x7fb7bc06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4036000 tx=0x7fb7d4030000 comp rx=0 tx=0).stop 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.192+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815ec90 msgr2=0x7fb7d80cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.192+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815ec90 0x7fb7d80cc9f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800c7f0 tx=0x7fb7c800ccb0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.193+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 shutdown_connections 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.193+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb7bc06c8f0 0x7fb7bc06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.193+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb7d815f730 0x7fb7d806e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.193+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7d815ec90 0x7fb7d80cc9f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.193+0000 7fb7dfb15640 1 --2- 172.21.15.120:0/487740351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7d80aecf0 0x7fb7d8146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.193+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 >> 172.21.15.120:0/487740351 conn(0x7fb7d80b2670 msgr2=0x7fb7d806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:16.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.193+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 shutdown_connections 2024-03-31T16:36:16.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.193+0000 7fb7dfb15640 1 -- 172.21.15.120:0/487740351 wait complete. 2024-03-31T16:36:16.211 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-31T16:36:16.211 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-31T16:36:16.211 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-31T16:36:16.211 INFO:teuthology.orchestra.run:waiting for 300 2024-03-31T16:36:16.212 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-31T16:36:16.212 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-31T16:36:16.212 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-31T16:36:16.212 INFO:teuthology.orchestra.run:waiting for 300 2024-03-31T16:36:16.212 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-31T16:36:16.212 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-31T16:36:16.212 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-31T16:36:16.212 INFO:teuthology.orchestra.run:waiting for 300 2024-03-31T16:36:16.213 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-31T16:36:16.213 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-31T16:36:16.213 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-31T16:36:16.213 INFO:teuthology.orchestra.run:waiting for 300 2024-03-31T16:36:16.222 INFO:tasks.ceph.mds.a:Stopped 2024-03-31T16:36:16.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-31T16:36:16.223 INFO:tasks.ceph.mds.c:Stopped 2024-03-31T16:36:16.223 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-31T16:36:16.225 INFO:tasks.ceph.mds.b:Stopped 2024-03-31T16:36:16.225 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-31T16:36:16.226 INFO:tasks.ceph.mds.d:Stopped 2024-03-31T16:36:16.226 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-31T16:36:16.264 INFO:tasks.ceph.mds.a:Started 2024-03-31T16:36:16.265 DEBUG:teuthology.parallel:result is None 2024-03-31T16:36:16.265 INFO:tasks.ceph.mds.c:Started 2024-03-31T16:36:16.265 DEBUG:teuthology.parallel:result is None 2024-03-31T16:36:16.267 INFO:tasks.ceph.mds.b:Started 2024-03-31T16:36:16.267 DEBUG:teuthology.parallel:result is None 2024-03-31T16:36:16.268 INFO:tasks.ceph.mds.d:Started 2024-03-31T16:36:16.268 DEBUG:teuthology.parallel:result is None 2024-03-31T16:36:16.268 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-31T16:36:16.343 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2024-03-31T16:36:16.343 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-03-31T16:36:16.348 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-03-31T16:36:16.348 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-03-31T16:36:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.370+0000 7fb992b3d640 1 Processor -- start 2024-03-31T16:36:16.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.370+0000 7fb992b3d640 1 -- start start 2024-03-31T16:36:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb992b3d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb98c15e860 0x7fb98c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb992b3d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb98c06da30 0x7fb98c0d43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb992b3d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 0x7fb98c0d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:16.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb992b3d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb98c0cf220 con 0x7fb98c06da30 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb992b3d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb98c0d4d40 con 0x7fb98c15e860 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb992b3d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb98c06dfa0 con 0x7fb98c0d4910 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb98bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb98c06da30 0x7fb98c0d43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb98bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb98c06da30 0x7fb98c0d43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54552/0 (socket says 172.21.15.120:54552) 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb98bfff640 1 -- 172.21.15.120:0/3664007369 learned_addr learned my addr 172.21.15.120:0/3664007369 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb9908d9640 1 --2- 172.21.15.120:0/3664007369 >> v2:172.21.15.203:3300/0 conn(0x7fb98c15e860 0x7fb98c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb9910da640 1 --2- 172.21.15.120:0/3664007369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 0x7fb98c0d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb98bfff640 1 -- 172.21.15.120:0/3664007369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 msgr2=0x7fb98c0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb98bfff640 1 --2- 172.21.15.120:0/3664007369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 0x7fb98c0d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb98bfff640 1 -- 172.21.15.120:0/3664007369 >> v2:172.21.15.203:3300/0 conn(0x7fb98c15e860 msgr2=0x7fb98c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb98bfff640 1 --2- 172.21.15.120:0/3664007369 >> v2:172.21.15.203:3300/0 conn(0x7fb98c15e860 0x7fb98c06d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.376 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.371+0000 7fb98bfff640 1 -- 172.21.15.120:0/3664007369 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c06e240 con 0x7fb98c06da30 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.372+0000 7fb98bfff640 1 --2- 172.21.15.120:0/3664007369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c0d43d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0d1fa0 tx=0x7fb98002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe7dcc7df008c31 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.372+0000 7fb98b7fe640 1 -- 172.21.15.120:0/3664007369 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980035020 con 0x7fb98c06da30 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.372+0000 7fb98b7fe640 1 -- 172.21.15.120:0/3664007369 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb980031870 con 0x7fb98c06da30 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.372+0000 7fb98b7fe640 1 -- 172.21.15.120:0/3664007369 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980031c40 con 0x7fb98c06da30 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.372+0000 7fb992b3d640 1 -- 172.21.15.120:0/3664007369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 msgr2=0x7fb98c0d43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.372+0000 7fb992b3d640 1 --2- 172.21.15.120:0/3664007369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c0d43d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0d1fa0 tx=0x7fb98002b910 comp rx=0 tx=0).stop 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.372+0000 7fb992b3d640 1 -- 172.21.15.120:0/3664007369 shutdown_connections 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.372+0000 7fb992b3d640 1 --2- 172.21.15.120:0/3664007369 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c0d43d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.373+0000 7fb992b3d640 1 --2- 172.21.15.120:0/3664007369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 0x7fb98c0d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.373+0000 7fb992b3d640 1 --2- 172.21.15.120:0/3664007369 >> v2:172.21.15.203:3300/0 conn(0x7fb98c15e860 0x7fb98c06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.373+0000 7fb992b3d640 1 -- 172.21.15.120:0/3664007369 >> 172.21.15.120:0/3664007369 conn(0x7fb98c09d7d0 msgr2=0x7fb98c08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:16.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.373+0000 7fb992b3d640 1 -- 172.21.15.120:0/3664007369 shutdown_connections 2024-03-31T16:36:16.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.373+0000 7fb992b3d640 1 -- 172.21.15.120:0/3664007369 wait complete. 2024-03-31T16:36:16.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.374+0000 7fb992b3d640 1 Processor -- start 2024-03-31T16:36:16.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.374+0000 7fb992b3d640 1 -- start start 2024-03-31T16:36:16.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.374+0000 7fb992b3d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:16.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.374+0000 7fb992b3d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 0x7fb98c0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:16.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb992b3d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb98c15e860 0x7fb98c0b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb992b3d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c0cedb0 con 0x7fb98c06da30 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb992b3d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c0d2c50 con 0x7fb98c15e860 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb992b3d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb98c0cef30 con 0x7fb98c0d4910 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54556/0 (socket says 172.21.15.120:54556) 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 -- 172.21.15.120:0/620587867 learned_addr learned my addr 172.21.15.120:0/620587867 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb98bfff640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 0x7fb98c0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 -- 172.21.15.120:0/620587867 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 msgr2=0x7fb98c0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 0x7fb98c0ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 -- 172.21.15.120:0/620587867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb98c15e860 msgr2=0x7fb98c0b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb98c15e860 0x7fb98c0b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 -- 172.21.15.120:0/620587867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c1609a0 con 0x7fb98c06da30 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9908d9640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c153690 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb98400efc0 tx=0x7fb98400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:16.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9897fa640 1 -- 172.21.15.120:0/620587867 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984018020 con 0x7fb98c06da30 2024-03-31T16:36:16.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9897fa640 1 -- 172.21.15.120:0/620587867 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984014480 con 0x7fb98c06da30 2024-03-31T16:36:16.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98c160c80 con 0x7fb98c06da30 2024-03-31T16:36:16.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb9897fa640 1 -- 172.21.15.120:0/620587867 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984014850 con 0x7fb98c06da30 2024-03-31T16:36:16.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.375+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98c1605c0 con 0x7fb98c06da30 2024-03-31T16:36:16.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.376+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98c0685c0 con 0x7fb98c06da30 2024-03-31T16:36:16.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.377+0000 7fb9897fa640 1 -- 172.21.15.120:0/620587867 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb984005d10 con 0x7fb98c06da30 2024-03-31T16:36:16.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.377+0000 7fb9897fa640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb97806c8f0 0x7fb97806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:16.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.377+0000 7fb9897fa640 1 -- 172.21.15.120:0/620587867 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7fb98408c720 con 0x7fb98c06da30 2024-03-31T16:36:16.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.377+0000 7fb98bfff640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb97806c8f0 0x7fb97806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:16.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.378+0000 7fb98bfff640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb97806c8f0 0x7fb97806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb980036000 tx=0x7fb980008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:16.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.381+0000 7fb9897fa640 1 -- 172.21.15.120:0/620587867 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb984022030 con 0x7fb98c06da30 2024-03-31T16:36:16.570 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:16.566+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb98c0b6cf0 con 0x7fb98c06da30 2024-03-31T16:36:17.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.204+0000 7fb9897fa640 1 -- 172.21.15.120:0/620587867 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7fb984010040 con 0x7fb98c06da30 2024-03-31T16:36:17.208 INFO:teuthology.orchestra.run.smithi120.stderr: removed all blocklist entries 2024-03-31T16:36:17.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb97806c8f0 msgr2=0x7fb97806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb97806c8f0 0x7fb97806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb980036000 tx=0x7fb980008030 comp rx=0 tx=0).stop 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 msgr2=0x7fb98c153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c153690 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb98400efc0 tx=0x7fb98400c490 comp rx=0 tx=0).stop 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 shutdown_connections 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb97806c8f0 0x7fb97806edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb98c15e860 0x7fb98c0b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb98c0d4910 0x7fb98c0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 --2- 172.21.15.120:0/620587867 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb98c06da30 0x7fb98c153690 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 >> 172.21.15.120:0/620587867 conn(0x7fb98c09d7d0 msgr2=0x7fb98c0b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 shutdown_connections 2024-03-31T16:36:17.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.206+0000 7fb992b3d640 1 -- 172.21.15.120:0/620587867 wait complete. 2024-03-31T16:36:17.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-31T16:36:17.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.319+0000 7fbef40ba640 1 Processor -- start 2024-03-31T16:36:17.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.319+0000 7fbef40ba640 1 -- start start 2024-03-31T16:36:17.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef40ba640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec155550 0x7fbeec155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef40ba640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbeec15f800 0x7fbeec0d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef40ba640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec0b40b0 con 0x7fbeec0d07c0 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef40ba640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fbeec0d0c30 con 0x7fbeec15f800 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef40ba640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbeec0b4390 con 0x7fbeec155550 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef2657640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbeec0d07c0 0x7fbeec0aede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38080/0 (socket says 172.21.15.120:38080) 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef1655640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbeec15f800 0x7fbeec0d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef2657640 1 -- 172.21.15.120:0/424961799 learned_addr learned my addr 172.21.15.120:0/424961799 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef1e56640 1 --2- 172.21.15.120:0/424961799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec155550 0x7fbeec155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef1655640 1 -- 172.21.15.120:0/424961799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec155550 msgr2=0x7fbeec155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef1655640 1 --2- 172.21.15.120:0/424961799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec155550 0x7fbeec155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef1655640 1 -- 172.21.15.120:0/424961799 >> v1:172.21.15.120:6789/0 conn(0x7fbeec0d07c0 legacy=0x7fbeec0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef0e54640 1 -- 172.21.15.120:0/424961799 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556379613 0 0) 0x7fbeec0b40b0 con 0x7fbeec0d07c0 2024-03-31T16:36:17.325 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.320+0000 7fbef1655640 1 -- 172.21.15.120:0/424961799 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec0b4670 con 0x7fbeec15f800 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.321+0000 7fbef1655640 1 --2- 172.21.15.120:0/424961799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec15f800 0x7fbeec0d0280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0097a0 tx=0x7fbedc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2be97a7b2ea251 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.321+0000 7fbef0e54640 1 -- 172.21.15.120:0/424961799 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc035020 con 0x7fbeec15f800 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.321+0000 7fbef0e54640 1 -- 172.21.15.120:0/424961799 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbedc031830 con 0x7fbeec15f800 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.321+0000 7fbef0e54640 1 -- 172.21.15.120:0/424961799 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc031c00 con 0x7fbeec15f800 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.322+0000 7fbef40ba640 1 -- 172.21.15.120:0/424961799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec15f800 msgr2=0x7fbeec0d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.322+0000 7fbef40ba640 1 --2- 172.21.15.120:0/424961799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec15f800 0x7fbeec0d0280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0097a0 tx=0x7fbedc02b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.322+0000 7fbef40ba640 1 -- 172.21.15.120:0/424961799 shutdown_connections 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.322+0000 7fbef40ba640 1 --2- 172.21.15.120:0/424961799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec15f800 0x7fbeec0d0280 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.322+0000 7fbef40ba640 1 --2- 172.21.15.120:0/424961799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec155550 0x7fbeec155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.322+0000 7fbef40ba640 1 -- 172.21.15.120:0/424961799 >> 172.21.15.120:0/424961799 conn(0x7fbeec06b750 msgr2=0x7fbeec06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:17.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.322+0000 7fbef40ba640 1 -- 172.21.15.120:0/424961799 shutdown_connections 2024-03-31T16:36:17.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.322+0000 7fbef40ba640 1 -- 172.21.15.120:0/424961799 wait complete. 2024-03-31T16:36:17.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.323+0000 7fbef40ba640 1 Processor -- start 2024-03-31T16:36:17.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.323+0000 7fbef40ba640 1 -- start start 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef40ba640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec0d07c0 0x7fbeec0999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef40ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec155550 0x7fbeec14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef40ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec15f800 0x7fbeec0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef40ba640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec15fc80 con 0x7fbeec155550 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef40ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec0b4c30 con 0x7fbeec15f800 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef40ba640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbeec15ba20 con 0x7fbeec0d07c0 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec155550 0x7fbeec14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec155550 0x7fbeec14fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54578/0 (socket says 172.21.15.120:54578) 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 -- 172.21.15.120:0/2691930999 learned_addr learned my addr 172.21.15.120:0/2691930999 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:17.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1e56640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec0d07c0 0x7fbeec0999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef2657640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec15f800 0x7fbeec0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 -- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec0d07c0 msgr2=0x7fbeec0999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec0d07c0 0x7fbeec0999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 -- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec15f800 msgr2=0x7fbeec0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec15f800 0x7fbeec0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 -- 172.21.15.120:0/2691930999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec150230 con 0x7fbeec155550 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef2657640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec15f800 0x7fbeec0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef1655640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec155550 0x7fbeec14fcf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009890 tx=0x7fbedc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbee27fc640 1 -- 172.21.15.120:0/2691930999 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc041070 con 0x7fbeec155550 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbee27fc640 1 -- 172.21.15.120:0/2691930999 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbedc03b920 con 0x7fbeec155550 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbee27fc640 1 -- 172.21.15.120:0/2691930999 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc035040 con 0x7fbeec155550 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeec1504b0 con 0x7fbeec155550 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.324+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeec150a70 con 0x7fbeec155550 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.325+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeec0685c0 con 0x7fbeec155550 2024-03-31T16:36:17.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.326+0000 7fbee27fc640 1 -- 172.21.15.120:0/2691930999 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbedc04c060 con 0x7fbeec155550 2024-03-31T16:36:17.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.326+0000 7fbee27fc640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbed006c920 0x7fbed006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.326+0000 7fbee27fc640 1 -- 172.21.15.120:0/2691930999 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fbedc0ad130 con 0x7fbeec155550 2024-03-31T16:36:17.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.326+0000 7fbef1e56640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbed006c920 0x7fbed006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.327+0000 7fbef1e56640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbed006c920 0x7fbed006ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006fd0 tx=0x7fbee8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:17.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.331+0000 7fbee27fc640 1 -- 172.21.15.120:0/2691930999 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbeec150230 con 0x7fbeec155550 2024-03-31T16:36:17.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.573+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbeec0b3ad0 con 0x7fbeec155550 2024-03-31T16:36:17.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.574+0000 7fbee27fc640 1 -- 172.21.15.120:0/2691930999 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fbedc07b820 con 0x7fbeec155550 2024-03-31T16:36:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:17.578 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-03-31T16:36:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_dump": [ 2024-03-31T16:36:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.578 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.a", 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCZkAlmxexOMhAAxTUbZ7OmZjfYe4VqV7ohbw==", 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.b", 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCakAlmJbEQAxAAGL+jqmbvGToTvNoI4Fm0Bw==", 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.579 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.c", 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCZkAlmTNmgORAAm5NQ2b9Txcppx7bD+giykw==", 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.d", 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCakAlmsKZvChAA5K5/JOjsF5BbG2AhAPLgtw==", 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.0", 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCdkAlmhynYLhAAxmA5w/sU3IEvJ8b6ICchQw==", 2024-03-31T16:36:17.581 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.1", 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCgkAlm7ESpLRAAXruKdYeQEqCsyWGtuj9FxQ==", 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-03-31T16:36:17.582 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.2", 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCjkAlmdBOeKxAAmOCDp3t3DWkECjn5CoA1Iw==", 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.3", 2024-03-31T16:36:17.583 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCmkAlm8AYsKhAACJCojiW+hFv1X4VB5A6dTw==", 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.4", 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCskAlmZFL/MhAAFsoGo7npDE1JBMyealieXQ==", 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.5", 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCvkAlmTYb3MRAAO+Q3olp3y28msJJmk+ULIw==", 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.6", 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCykAlmYJ6hMBAARRs6KOWP243iHTOqL+rhFg==", 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-03-31T16:36:17.585 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.7", 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQC1kAlmu5QZLxAACVpUUkSfAg+WQTRKokbFHg==", 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.0", 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCakAlm7s+2DhAAf4okmBd2QJxliS57iZYpYA==", 2024-03-31T16:36:17.586 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.1", 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCakAlmvE3xFxAAITAIXc2BDoyf/yK5YNaesA==", 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-03-31T16:36:17.587 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.2", 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCakAlm7gaDFBAA51xcpsXhxLPyiDSOnPEq9g==", 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.588 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.3", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCakAlmwITKHRAAkk5mBqTz30JU9Sa74aVN5A==", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.admin", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA==", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2024-03-31T16:36:17.589 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-mds", 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQC7kAlmQU0+KhAALJIJK360NJp0OGdeOjR+Pw==", 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-mds" 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-mgr", 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQC7kAlmW1U+KhAAAJhH/RsvE1GLHAqQOQpFlA==", 2024-03-31T16:36:17.590 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-osd", 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQC7kAlm4Vs+KhAAXT0/IthsQ1MgC5cD/2ICrw==", 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-osd" 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rbd", 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQC7kAlmL2I+KhAAJWa3oFhHrMJNtYy8YBy80Q==", 2024-03-31T16:36:17.591 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQC7kAlm2Wg+KhAAfuN7ruPs0z1me3l8c08orw==", 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rgw", 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQC7kAlmo28+KhAAQ3hf1YYIfb1GdkFrBr8aow==", 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.x", 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCZkAlmm5riLhAAjLr9oFjkdjVLXk1mhohfEQ==", 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.y", 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQCZkAlmHrP4KhAA5ImEIJ5uCV5YTuxxPsLsIQ==", 2024-03-31T16:36:17.593 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2024-03-31T16:36:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2024-03-31T16:36:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2024-03-31T16:36:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2024-03-31T16:36:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:17.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-03-31T16:36:17.594 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-03-31T16:36:17.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbed006c920 msgr2=0x7fbed006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbed006c920 0x7fbed006ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006fd0 tx=0x7fbee8008040 comp rx=0 tx=0).stop 2024-03-31T16:36:17.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec155550 msgr2=0x7fbeec14fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec155550 0x7fbeec14fcf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009890 tx=0x7fbedc0046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 shutdown_connections 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbed006c920 0x7fbed006ede0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeec15f800 0x7fbeec0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeec155550 0x7fbeec14fcf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 --2- 172.21.15.120:0/2691930999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeec0d07c0 0x7fbeec0999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 >> 172.21.15.120:0/2691930999 conn(0x7fbeec06b750 msgr2=0x7fbeec0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 shutdown_connections 2024-03-31T16:36:17.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.576+0000 7fbef40ba640 1 -- 172.21.15.120:0/2691930999 wait complete. 2024-03-31T16:36:17.596 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-31T16:36:17.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.693+0000 7f80c42dc640 1 Processor -- start 2024-03-31T16:36:17.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.693+0000 7f80c42dc640 1 -- start start 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c42dc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f80bc15e7b0 0x7f80bc0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c42dc640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f80bc0d1d70 0x7f80bc0c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c42dc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c42dc640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f80bc0d1240 con 0x7f80bc15e7b0 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c42dc640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f80bc0d01a0 con 0x7f80bc0d1d70 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c42dc640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f80bc0d0480 con 0x7f80bc0c7640 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c2078640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f80bc15e7b0 0x7f80bc0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c2078640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f80bc15e7b0 0x7f80bc0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54580/0 (socket says 172.21.15.120:54580) 2024-03-31T16:36:17.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.694+0000 7f80c2078640 1 -- 172.21.15.120:0/2831549752 learned_addr learned my addr 172.21.15.120:0/2831549752 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c2879640 1 --2- 172.21.15.120:0/2831549752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c2078640 1 -- 172.21.15.120:0/2831549752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 msgr2=0x7f80bc071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c1877640 1 --2- 172.21.15.120:0/2831549752 >> v2:172.21.15.203:3300/0 conn(0x7f80bc0d1d70 0x7f80bc0c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c2078640 1 --2- 172.21.15.120:0/2831549752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c2078640 1 -- 172.21.15.120:0/2831549752 >> v2:172.21.15.203:3300/0 conn(0x7f80bc0d1d70 msgr2=0x7f80bc0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c2078640 1 --2- 172.21.15.120:0/2831549752 >> v2:172.21.15.203:3300/0 conn(0x7f80bc0d1d70 0x7f80bc0c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c2078640 1 -- 172.21.15.120:0/2831549752 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc0d0760 con 0x7f80bc15e7b0 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c2879640 1 --2- 172.21.15.120:0/2831549752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c1877640 1 --2- 172.21.15.120:0/2831549752 >> v2:172.21.15.203:3300/0 conn(0x7f80bc0d1d70 0x7f80bc0c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:17.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c2078640 1 --2- 172.21.15.120:0/2831549752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0b4980 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f80bc162150 tx=0x7f80b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed915c9a0e6b5856 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:17.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c1076640 1 -- 172.21.15.120:0/2831549752 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b802ca70 con 0x7f80bc15e7b0 2024-03-31T16:36:17.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c1076640 1 -- 172.21.15.120:0/2831549752 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b802cc10 con 0x7f80bc15e7b0 2024-03-31T16:36:17.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.695+0000 7f80c1076640 1 -- 172.21.15.120:0/2831549752 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b80343f0 con 0x7f80bc15e7b0 2024-03-31T16:36:17.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 -- 172.21.15.120:0/2831549752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 msgr2=0x7f80bc0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2831549752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0b4980 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f80bc162150 tx=0x7f80b802bed0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 -- 172.21.15.120:0/2831549752 shutdown_connections 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2831549752 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2831549752 >> v2:172.21.15.203:3300/0 conn(0x7f80bc0d1d70 0x7f80bc0c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2831549752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0b4980 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 -- 172.21.15.120:0/2831549752 >> 172.21.15.120:0/2831549752 conn(0x7f80bc0b3e90 msgr2=0x7f80bc0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 -- 172.21.15.120:0/2831549752 shutdown_connections 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.696+0000 7f80c42dc640 1 -- 172.21.15.120:0/2831549752 wait complete. 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.697+0000 7f80c42dc640 1 Processor -- start 2024-03-31T16:36:17.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.697+0000 7f80c42dc640 1 -- start start 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c42dc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c42dc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80bc0d1d70 0x7f80bc0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c42dc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c42dc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc0cfe30 con 0x7f80bc15e7b0 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c42dc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc0d0d20 con 0x7f80bc0d1d70 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c42dc640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f80bc071540 con 0x7f80bc0c7640 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2879640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2879640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54590/0 (socket says 172.21.15.120:54590) 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2879640 1 -- 172.21.15.120:0/2919649812 learned_addr learned my addr 172.21.15.120:0/2919649812 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:17.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2078640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c1877640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80bc0d1d70 0x7f80bc0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2879640 1 -- 172.21.15.120:0/2919649812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 msgr2=0x7f80bc147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2879640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2879640 1 -- 172.21.15.120:0/2919649812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80bc0d1d70 msgr2=0x7f80bc0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2879640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80bc0d1d70 0x7f80bc0cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.698+0000 7f80c2879640 1 -- 172.21.15.120:0/2919649812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc0cba30 con 0x7f80bc15e7b0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.699+0000 7f80c2879640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0cb3b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f80b400c7f0 tx=0x7f80b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.699+0000 7f80b2ffd640 1 -- 172.21.15.120:0/2919649812 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4015070 con 0x7f80bc15e7b0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.699+0000 7f80b2ffd640 1 -- 172.21.15.120:0/2919649812 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b4007820 con 0x7f80bc15e7b0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.699+0000 7f80b2ffd640 1 -- 172.21.15.120:0/2919649812 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4007c50 con 0x7f80bc15e7b0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.699+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc0cbd10 con 0x7f80bc15e7b0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.699+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc15f860 con 0x7f80bc15e7b0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.700+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc068cd0 con 0x7f80bc15e7b0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.700+0000 7f80b2ffd640 1 -- 172.21.15.120:0/2919649812 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80b4018070 con 0x7f80bc15e7b0 2024-03-31T16:36:17.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.701+0000 7f80b2ffd640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f80a006c8f0 0x7f80a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:17.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.701+0000 7f80b2ffd640 1 -- 172.21.15.120:0/2919649812 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f80b408b920 con 0x7f80bc15e7b0 2024-03-31T16:36:17.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.701+0000 7f80c2078640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f80a006c8f0 0x7f80a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:17.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.701+0000 7f80c2078640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f80a006c8f0 0x7f80a006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80b8035000 tx=0x7f80b8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:17.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.705+0000 7f80b2ffd640 1 -- 172.21.15.120:0/2919649812 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f80b4059a50 con 0x7f80bc15e7b0 2024-03-31T16:36:17.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.946+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f80bc06d820 con 0x7f80bc15e7b0 2024-03-31T16:36:17.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.950+0000 7f80b2ffd640 1 -- 172.21.15.120:0/2919649812 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f80b405dd50 con 0x7f80bc15e7b0 2024-03-31T16:36:17.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f80a006c8f0 msgr2=0x7f80a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f80a006c8f0 0x7f80a006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80b8035000 tx=0x7f80b8030000 comp rx=0 tx=0).stop 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 msgr2=0x7f80bc0cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0cb3b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f80b400c7f0 tx=0x7f80b400ccb0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 shutdown_connections 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f80a006c8f0 0x7f80a006edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc15e7b0 0x7f80bc0cb3b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80bc0d1d70 0x7f80bc0cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 --2- 172.21.15.120:0/2919649812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80bc0c7640 0x7f80bc147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 >> 172.21.15.120:0/2919649812 conn(0x7f80bc0b3e90 msgr2=0x7f80bc06dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 shutdown_connections 2024-03-31T16:36:17.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:17.952+0000 7f80c42dc640 1 -- 172.21.15.120:0/2919649812 wait complete. 2024-03-31T16:36:17.967 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-31T16:36:18.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.063+0000 7ff7cbe4e640 1 Processor -- start 2024-03-31T16:36:18.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.064+0000 7ff7cbe4e640 1 -- start start 2024-03-31T16:36:18.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.064+0000 7ff7cbe4e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7c4153580 0x7ff7c40d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7cbe4e640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff7c40d07c0 0x7ff7c40aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7cbe4e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7cbe4e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c40d0c30 con 0x7ff7c4153580 2024-03-31T16:36:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7cbe4e640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c40afab0 con 0x7ff7c40d07c0 2024-03-31T16:36:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7cbe4e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c415cc80 con 0x7ff7c40af2e0 2024-03-31T16:36:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c9bea640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7c4153580 0x7ff7c40d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c9bea640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff7c4153580 0x7ff7c40d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54600/0 (socket says 172.21.15.120:54600) 2024-03-31T16:36:18.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c9bea640 1 -- 172.21.15.120:0/1128390966 learned_addr learned my addr 172.21.15.120:0/1128390966 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c93e9640 1 --2- 172.21.15.120:0/1128390966 >> v2:172.21.15.203:3300/0 conn(0x7ff7c40d07c0 0x7ff7c40aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7ca3eb640 1 --2- 172.21.15.120:0/1128390966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c9bea640 1 -- 172.21.15.120:0/1128390966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 msgr2=0x7ff7c406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c9bea640 1 --2- 172.21.15.120:0/1128390966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c9bea640 1 -- 172.21.15.120:0/1128390966 >> v2:172.21.15.203:3300/0 conn(0x7ff7c40d07c0 msgr2=0x7ff7c40aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:18.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c9bea640 1 --2- 172.21.15.120:0/1128390966 >> v2:172.21.15.203:3300/0 conn(0x7ff7c40d07c0 0x7ff7c40aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.065+0000 7ff7c9bea640 1 -- 172.21.15.120:0/1128390966 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c415da00 con 0x7ff7c4153580 2024-03-31T16:36:18.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7c9bea640 1 --2- 172.21.15.120:0/1128390966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c4153580 0x7ff7c40d0280 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cff70 tx=0x7ff7c002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716b256d1d215517 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7c8be8640 1 -- 172.21.15.120:0/1128390966 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c002e070 con 0x7ff7c4153580 2024-03-31T16:36:18.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7c8be8640 1 -- 172.21.15.120:0/1128390966 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c0037070 con 0x7ff7c4153580 2024-03-31T16:36:18.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7c8be8640 1 -- 172.21.15.120:0/1128390966 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0031a00 con 0x7ff7c4153580 2024-03-31T16:36:18.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/1128390966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c4153580 msgr2=0x7ff7c40d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/1128390966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c4153580 0x7ff7c40d0280 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40cff70 tx=0x7ff7c002b880 comp rx=0 tx=0).stop 2024-03-31T16:36:18.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/1128390966 shutdown_connections 2024-03-31T16:36:18.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/1128390966 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/1128390966 >> v2:172.21.15.203:3300/0 conn(0x7ff7c40d07c0 0x7ff7c40aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/1128390966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c4153580 0x7ff7c40d0280 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.066+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/1128390966 >> 172.21.15.120:0/1128390966 conn(0x7ff7c406b750 msgr2=0x7ff7c406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:18.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.067+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/1128390966 shutdown_connections 2024-03-31T16:36:18.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.067+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/1128390966 wait complete. 2024-03-31T16:36:18.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7cbe4e640 1 Processor -- start 2024-03-31T16:36:18.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7cbe4e640 1 -- start start 2024-03-31T16:36:18.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7cbe4e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c41f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7cbe4e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c40d07c0 0x7ff7c40ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7cbe4e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7c4153580 0x7ff7c40cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7cbe4e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c415d4e0 con 0x7ff7c40d07c0 2024-03-31T16:36:18.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7cbe4e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c415d200 con 0x7ff7c4153580 2024-03-31T16:36:18.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7cbe4e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c4153960 con 0x7ff7c40af2e0 2024-03-31T16:36:18.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7c93e9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c40d07c0 0x7ff7c40ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7c93e9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c40d07c0 0x7ff7c40ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54614/0 (socket says 172.21.15.120:54614) 2024-03-31T16:36:18.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.068+0000 7ff7c93e9640 1 -- 172.21.15.120:0/2615479704 learned_addr learned my addr 172.21.15.120:0/2615479704 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:18.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7c9bea640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c41f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7ca3eb640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7c4153580 0x7ff7c40cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7c93e9640 1 -- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 msgr2=0x7ff7c41f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7c93e9640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c41f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7c93e9640 1 -- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7c4153580 msgr2=0x7ff7c40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7c93e9640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7c4153580 0x7ff7c40cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7c93e9640 1 -- 172.21.15.120:0/2615479704 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c4149120 con 0x7ff7c40d07c0 2024-03-31T16:36:18.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7ca3eb640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7c4153580 0x7ff7c40cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:18.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7c9bea640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c41f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7c93e9640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c40d07c0 0x7ff7c40ceee0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400d5f0 tx=0x7ff7b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7ba7fc640 1 -- 172.21.15.120:0/2615479704 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40125f0 con 0x7ff7c40d07c0 2024-03-31T16:36:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7ba7fc640 1 -- 172.21.15.120:0/2615479704 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b4019070 con 0x7ff7c40d07c0 2024-03-31T16:36:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7ba7fc640 1 -- 172.21.15.120:0/2615479704 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40129d0 con 0x7ff7c40d07c0 2024-03-31T16:36:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c4158010 con 0x7ff7c40d07c0 2024-03-31T16:36:18.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.069+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c41582b0 con 0x7ff7c40d07c0 2024-03-31T16:36:18.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.070+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c40685c0 con 0x7ff7c40d07c0 2024-03-31T16:36:18.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.071+0000 7ff7ba7fc640 1 -- 172.21.15.120:0/2615479704 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7b4012b70 con 0x7ff7c40d07c0 2024-03-31T16:36:18.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.071+0000 7ff7ba7fc640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff7a806c8f0 0x7ff7a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.071+0000 7ff7ba7fc640 1 -- 172.21.15.120:0/2615479704 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7ff7b408bb70 con 0x7ff7c40d07c0 2024-03-31T16:36:18.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.071+0000 7ff7c9bea640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff7a806c8f0 0x7ff7a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.071+0000 7ff7c9bea640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff7a806c8f0 0x7ff7a806edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0036000 tx=0x7ff7c003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.090 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.075+0000 7ff7ba7fc640 1 -- 172.21.15.120:0/2615479704 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff7b405a380 con 0x7ff7c40d07c0 2024-03-31T16:36:18.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.323+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7ff7c40cfd80 con 0x7ff7c40d07c0 2024-03-31T16:36:18.328 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.325+0000 7ff7ba7fc640 1 -- 172.21.15.120:0/2615479704 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7ff7b4059c80 con 0x7ff7c40d07c0 2024-03-31T16:36:18.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff7a806c8f0 msgr2=0x7ff7a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff7a806c8f0 0x7ff7a806edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0036000 tx=0x7ff7c003d040 comp rx=0 tx=0).stop 2024-03-31T16:36:18.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c40d07c0 msgr2=0x7ff7c40ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c40d07c0 0x7ff7c40ceee0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400d5f0 tx=0x7ff7b400dab0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 shutdown_connections 2024-03-31T16:36:18.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff7a806c8f0 0x7ff7a806edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7c4153580 0x7ff7c40cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff7c40d07c0 0x7ff7c40ceee0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 --2- 172.21.15.120:0/2615479704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff7c40af2e0 0x7ff7c41f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 >> 172.21.15.120:0/2615479704 conn(0x7ff7c406b750 msgr2=0x7ff7c415b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:18.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 shutdown_connections 2024-03-31T16:36:18.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.327+0000 7ff7cbe4e640 1 -- 172.21.15.120:0/2615479704 wait complete. 2024-03-31T16:36:18.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-31T16:36:18.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.438+0000 7fed0a677640 1 Processor -- start 2024-03-31T16:36:18.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.438+0000 7fed0a677640 1 -- start start 2024-03-31T16:36:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.439+0000 7fed0a677640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0415eca0 0x7fed040b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.439+0000 7fed0a677640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed040b4c00 con 0x7fed0415ac50 2024-03-31T16:36:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.439+0000 7fed0a677640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed040b4ee0 con 0x7fed0415a870 2024-03-31T16:36:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.439+0000 7fed0a677640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed0406d5b0 con 0x7fed0415eca0 2024-03-31T16:36:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.439+0000 7fed08c14640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fed0415ac50 0x7fed040b4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38092/0 (socket says 172.21.15.120:38092) 2024-03-31T16:36:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.439+0000 7fed08c14640 1 -- 172.21.15.120:0/2573740120 learned_addr learned my addr 172.21.15.120:0/2573740120 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.439+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909668191 0 0) 0x7fed040b4c00 con 0x7fed0415ac50 2024-03-31T16:36:18.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecec003520 con 0x7fed0415ac50 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed037fe640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0415eca0 0x7fed040b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3604413529 0 0) 0x7fecec003520 con 0x7fed0415ac50 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0415eca0 msgr2=0x7fed040b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0415eca0 0x7fed040b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 >> v1:172.21.15.203:6789/0 conn(0x7fed0415a870 legacy=0x7fed0415e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0406d800 con 0x7fed0415ac50 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7fecfc0019f0 con 0x7fed0415ac50 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 >> v1:172.21.15.120:6789/0 conn(0x7fed0415ac50 legacy=0x7fed040b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecec0039e0 0x7fecec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fecec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0415eca0 0x7fecec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fed0406d5b0 con 0x7fecec004800 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fecec00ba70 con 0x7fecec0039e0 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fecec00bc70 con 0x7fed0415eca0 2024-03-31T16:36:18.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed037fe640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fecec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed03fff640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecec0039e0 0x7fecec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed08c14640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0415eca0 0x7fecec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed037fe640 1 -- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0415eca0 msgr2=0x7fecec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed037fe640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0415eca0 0x7fecec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed037fe640 1 -- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecec0039e0 msgr2=0x7fecec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed037fe640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecec0039e0 0x7fecec003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.440+0000 7fed037fe640 1 -- 172.21.15.120:0/2573740120 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec003520 con 0x7fecec004800 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.441+0000 7fed037fe640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fecec004c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009a90 tx=0x7fecec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6803dc888af94be5 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.441+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8039070 con 0x7fecec004800 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.441+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf802c680 con 0x7fecec004800 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.441+0000 7fed02ffd640 1 -- 172.21.15.120:0/2573740120 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8009690 con 0x7fecec004800 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.442+0000 7fed0a677640 1 -- 172.21.15.120:0/2573740120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 msgr2=0x7fecec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.442+0000 7fed0a677640 1 --2- 172.21.15.120:0/2573740120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fecec004c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009a90 tx=0x7fecec005830 comp rx=0 tx=0).stop 2024-03-31T16:36:18.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.442+0000 7fed08c14640 1 -- 172.21.15.120:0/2573740120 reap_dead start 2024-03-31T16:36:18.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.442+0000 7fed0a677640 1 -- 172.21.15.120:0/2573740120 shutdown_connections 2024-03-31T16:36:18.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.442+0000 7fed0a677640 1 -- 172.21.15.120:0/2573740120 >> 172.21.15.120:0/2573740120 conn(0x7fed0406b750 msgr2=0x7fed0406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:18.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.442+0000 7fed0a677640 1 -- 172.21.15.120:0/2573740120 shutdown_connections 2024-03-31T16:36:18.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.442+0000 7fed0a677640 1 -- 172.21.15.120:0/2573740120 wait complete. 2024-03-31T16:36:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.443+0000 7fed0a677640 1 Processor -- start 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.443+0000 7fed0a677640 1 -- start start 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed0a677640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fed04148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed0a677640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed040afca0 0x7fed04167b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed0a677640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0414e800 0x7fed0414ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed0a677640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fed0406db70 con 0x7fecec004800 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed0a677640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed0406f220 con 0x7fed040afca0 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed0a677640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed040b3f10 con 0x7fed0414e800 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fed04148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fed04148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54632/0 (socket says 172.21.15.120:54632) 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 -- 172.21.15.120:0/183076316 learned_addr learned my addr 172.21.15.120:0/183076316 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed037fe640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed040afca0 0x7fed04167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed08c14640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0414e800 0x7fed0414ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 -- 172.21.15.120:0/183076316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0414e800 msgr2=0x7fed0414ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0414e800 0x7fed0414ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 -- 172.21.15.120:0/183076316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed040afca0 msgr2=0x7fed04167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed040afca0 0x7fed04167b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 -- 172.21.15.120:0/183076316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0415b9a0 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed03fff640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fed04148b80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fecf400f850 tx=0x7fecf400fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed00ff9640 1 -- 172.21.15.120:0/183076316 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf40050d0 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.444+0000 7fed00ff9640 1 -- 172.21.15.120:0/183076316 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4018070 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.445+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0414ccd0 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.445+0000 7fed00ff9640 1 -- 172.21.15.120:0/183076316 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf400d730 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.445+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed040b25c0 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.446+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed040685c0 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.446+0000 7fed00ff9640 1 -- 172.21.15.120:0/183076316 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecf400d8d0 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.446+0000 7fed00ff9640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fecf006c920 0x7fecf006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.446+0000 7fed00ff9640 1 -- 172.21.15.120:0/183076316 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fecf408b520 con 0x7fecec004800 2024-03-31T16:36:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.446+0000 7fed037fe640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fecf006c920 0x7fecf006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.447+0000 7fed037fe640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fecf006c920 0x7fecf006ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fecf8036000 tx=0x7fecf8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.451+0000 7fed00ff9640 1 -- 172.21.15.120:0/183076316 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fecf4059ca0 con 0x7fecec004800 2024-03-31T16:36:18.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.691+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fed040ae9a0 con 0x7fecec004800 2024-03-31T16:36:18.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.693+0000 7fed00ff9640 1 -- 172.21.15.120:0/183076316 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fecf40595a0 con 0x7fecec004800 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fecf006c920 msgr2=0x7fecf006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fecf006c920 0x7fecf006ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fecf8036000 tx=0x7fecf8030000 comp rx=0 tx=0).stop 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 msgr2=0x7fed04148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fed04148b80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fecf400f850 tx=0x7fecf400fc50 comp rx=0 tx=0).stop 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 shutdown_connections 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fecf006c920 0x7fecf006ede0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed0414e800 0x7fed0414ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed040afca0 0x7fed04167b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 --2- 172.21.15.120:0/183076316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fecec004800 0x7fed04148b80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.695+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 >> 172.21.15.120:0/183076316 conn(0x7fed0406b750 msgr2=0x7fed040d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.696+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 shutdown_connections 2024-03-31T16:36:18.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.696+0000 7fed0a677640 1 -- 172.21.15.120:0/183076316 wait complete. 2024-03-31T16:36:18.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-31T16:36:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.807+0000 7f424b61b640 1 Processor -- start 2024-03-31T16:36:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.807+0000 7f424b61b640 1 -- start start 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f424b61b640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f42441452f0 0x7f42441456d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f424b61b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f424406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f424b61b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42440ae4a0 con 0x7f424406bab0 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f424b61b640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f424415c990 con 0x7f42441452f0 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f424b61b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f42440afcf0 con 0x7f42440ae020 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f4248bb6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f424406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f42493b7640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f42441452f0 0x7f42441456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f4248bb6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f424406b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:35588/0 (socket says 172.21.15.120:35588) 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.808+0000 7f4248bb6640 1 -- 172.21.15.120:0/2079363699 learned_addr learned my addr 172.21.15.120:0/2079363699 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.809+0000 7f4248bb6640 1 -- 172.21.15.120:0/2079363699 >> v2:172.21.15.203:3300/0 conn(0x7f42441452f0 msgr2=0x7f42441456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.809+0000 7f4248bb6640 1 --2- 172.21.15.120:0/2079363699 >> v2:172.21.15.203:3300/0 conn(0x7f42441452f0 0x7f42441456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.809+0000 7f4248bb6640 1 -- 172.21.15.120:0/2079363699 >> v1:172.21.15.203:6789/0 conn(0x7f424406bab0 legacy=0x7f424415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.809+0000 7f4248bb6640 1 -- 172.21.15.120:0/2079363699 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42440affd0 con 0x7f42440ae020 2024-03-31T16:36:18.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.809+0000 7f423bfff640 1 -- 172.21.15.120:0/2079363699 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560497104 0 0) 0x7f42440ae4a0 con 0x7f424406bab0 2024-03-31T16:36:18.814 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.809+0000 7f42493b7640 1 --2- 172.21.15.120:0/2079363699 >> v2:172.21.15.203:3300/0 conn(0x7f42441452f0 0x7f42441456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-31T16:36:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f4248bb6640 1 --2- 172.21.15.120:0/2079363699 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f424406b570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4234009870 tx=0x7f423402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3b200f387f3a666 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f423bfff640 1 -- 172.21.15.120:0/2079363699 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234035020 con 0x7f42440ae020 2024-03-31T16:36:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f423bfff640 1 -- 172.21.15.120:0/2079363699 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4234031640 con 0x7f42440ae020 2024-03-31T16:36:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f423bfff640 1 -- 172.21.15.120:0/2079363699 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423402d040 con 0x7f42440ae020 2024-03-31T16:36:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f424b61b640 1 -- 172.21.15.120:0/2079363699 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 msgr2=0x7f424406b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f424b61b640 1 --2- 172.21.15.120:0/2079363699 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f424406b570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4234009870 tx=0x7f423402b8f0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f424b61b640 1 -- 172.21.15.120:0/2079363699 shutdown_connections 2024-03-31T16:36:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f424b61b640 1 --2- 172.21.15.120:0/2079363699 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f424406b570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f424b61b640 1 --2- 172.21.15.120:0/2079363699 >> v2:172.21.15.203:3300/0 conn(0x7f42441452f0 0x7f42441456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f424b61b640 1 -- 172.21.15.120:0/2079363699 >> 172.21.15.120:0/2079363699 conn(0x7f42440b6560 msgr2=0x7f42440b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f424b61b640 1 -- 172.21.15.120:0/2079363699 shutdown_connections 2024-03-31T16:36:18.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.810+0000 7f424b61b640 1 -- 172.21.15.120:0/2079363699 wait complete. 2024-03-31T16:36:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f424b61b640 1 Processor -- start 2024-03-31T16:36:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f424b61b640 1 -- start start 2024-03-31T16:36:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f424b61b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f424406bab0 0x7f4244155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f424b61b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f4244141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f424b61b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42441452f0 0x7f4244158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f424b61b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f42440b0870 con 0x7f42441452f0 2024-03-31T16:36:18.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f424b61b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f42440b0590 con 0x7f424406bab0 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f424b61b640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f42440af910 con 0x7f42440ae020 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.812+0000 7f4249bb8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42441452f0 0x7f4244158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4249bb8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42441452f0 0x7f4244158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54640/0 (socket says 172.21.15.120:54640) 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4249bb8640 1 -- 172.21.15.120:0/450797971 learned_addr learned my addr 172.21.15.120:0/450797971 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f42493b7640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f424406bab0 0x7f4244155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4248bb6640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f4244141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4249bb8640 1 -- 172.21.15.120:0/450797971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 msgr2=0x7f4244141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4249bb8640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f4244141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4249bb8640 1 -- 172.21.15.120:0/450797971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f424406bab0 msgr2=0x7f4244155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4249bb8640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f424406bab0 0x7f4244155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4249bb8640 1 -- 172.21.15.120:0/450797971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42440b1f50 con 0x7f42441452f0 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4249bb8640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42441452f0 0x7f4244158200 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f423c00c780 tx=0x7f423c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4239ffb640 1 -- 172.21.15.120:0/450797971 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c003b70 con 0x7f42441452f0 2024-03-31T16:36:18.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4239ffb640 1 -- 172.21.15.120:0/450797971 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423c003d10 con 0x7f42441452f0 2024-03-31T16:36:18.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f4239ffb640 1 -- 172.21.15.120:0/450797971 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c005270 con 0x7f42441452f0 2024-03-31T16:36:18.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42440b2230 con 0x7f42441452f0 2024-03-31T16:36:18.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.813+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42440b27f0 con 0x7f42441452f0 2024-03-31T16:36:18.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.814+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42440685c0 con 0x7f42441452f0 2024-03-31T16:36:18.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.815+0000 7f4239ffb640 1 -- 172.21.15.120:0/450797971 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f423c005410 con 0x7f42441452f0 2024-03-31T16:36:18.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.815+0000 7f4239ffb640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f422806c920 0x7f422806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:18.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.815+0000 7f4239ffb640 1 -- 172.21.15.120:0/450797971 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f423c08b4d0 con 0x7f42441452f0 2024-03-31T16:36:18.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.815+0000 7f42493b7640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f422806c920 0x7f422806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:18.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.816+0000 7f42493b7640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f422806c920 0x7f422806ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4240009560 tx=0x7f4240009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:18.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:18.819+0000 7f4239ffb640 1 -- 172.21.15.120:0/450797971 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f423c059690 con 0x7f42441452f0 2024-03-31T16:36:19.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.061+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f424415f560 con 0x7f42441452f0 2024-03-31T16:36:19.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.063+0000 7f4239ffb640 1 -- 172.21.15.120:0/450797971 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f423c05d990 con 0x7f42441452f0 2024-03-31T16:36:19.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f422806c920 msgr2=0x7f422806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f422806c920 0x7f422806ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4240009560 tx=0x7f4240009190 comp rx=0 tx=0).stop 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42441452f0 msgr2=0x7f4244158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42441452f0 0x7f4244158200 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f423c00c780 tx=0x7f423c00cb80 comp rx=0 tx=0).stop 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 shutdown_connections 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f422806c920 0x7f422806ede0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42441452f0 0x7f4244158200 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f42440ae020 0x7f4244141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 --2- 172.21.15.120:0/450797971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f424406bab0 0x7f4244155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 >> 172.21.15.120:0/450797971 conn(0x7f42440b6560 msgr2=0x7f424413f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 shutdown_connections 2024-03-31T16:36:19.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.065+0000 7f424b61b640 1 -- 172.21.15.120:0/450797971 wait complete. 2024-03-31T16:36:19.080 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-31T16:36:19.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.177+0000 7fd791622640 1 Processor -- start 2024-03-31T16:36:19.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.177+0000 7fd791622640 1 -- start start 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd791622640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd78c15e6d0 0x7fd78c0d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd791622640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c0ceef0 con 0x7fd78c0d0cb0 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd791622640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c15eab0 con 0x7fd78c0d4760 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd791622640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd78c0d1220 con 0x7fd78c15e6d0 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd78a7fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd78c0d0cb0 0x7fd78c0d4050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38108/0 (socket says 172.21.15.120:38108) 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd78a7fc640 1 -- 172.21.15.120:0/369780383 learned_addr learned my addr 172.21.15.120:0/369780383 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd78affd640 1 --2- 172.21.15.120:0/369780383 >> v2:172.21.15.203:3300/0 conn(0x7fd78c15e6d0 0x7fd78c0d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255427169 0 0) 0x7fd78c0ceef0 con 0x7fd78c0d0cb0 2024-03-31T16:36:19.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.178+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd774003520 con 0x7fd78c0d0cb0 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1169045438 0 0) 0x7fd774003520 con 0x7fd78c0d0cb0 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 >> v2:172.21.15.203:3300/0 conn(0x7fd78c15e6d0 msgr2=0x7fd78c0d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 --2- 172.21.15.120:0/369780383 >> v2:172.21.15.203:3300/0 conn(0x7fd78c15e6d0 0x7fd78c0d21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 >> v1:172.21.15.203:6789/0 conn(0x7fd78c0d4760 legacy=0x7fd78c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c0d1500 con 0x7fd78c0d0cb0 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7fd780001810 con 0x7fd78c0d0cb0 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 >> v1:172.21.15.120:6789/0 conn(0x7fd78c0d0cb0 legacy=0x7fd78c0d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7740039b0 0x7fd774003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd774004800 0x7fd774004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7740051c0 0x7fd77400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c0d1220 con 0x7fd7740039b0 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd77400c060 con 0x7fd774004800 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd77400c260 con 0x7fd7740051c0 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78affd640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7740039b0 0x7fd774003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78a7fc640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd774004800 0x7fd774004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78b7fe640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7740051c0 0x7fd77400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78affd640 1 -- 172.21.15.120:0/369780383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7740051c0 msgr2=0x7fd77400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78affd640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd7740051c0 0x7fd77400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78affd640 1 -- 172.21.15.120:0/369780383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd774004800 msgr2=0x7fd774004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78affd640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd774004800 0x7fd774004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78b7fe640 1 -- 172.21.15.120:0/369780383 reap_dead start 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.179+0000 7fd78affd640 1 -- 172.21.15.120:0/369780383 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd774003520 con 0x7fd7740039b0 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd78affd640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7740039b0 0x7fd774003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009ac0 tx=0x7fd774005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f1808c6e9817bb server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c039070 con 0x7fd7740039b0 2024-03-31T16:36:19.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c02c6d0 con 0x7fd7740039b0 2024-03-31T16:36:19.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd789ffb640 1 -- 172.21.15.120:0/369780383 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c009690 con 0x7fd7740039b0 2024-03-31T16:36:19.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd791622640 1 -- 172.21.15.120:0/369780383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7740039b0 msgr2=0x7fd774003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd791622640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7740039b0 0x7fd774003dd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009ac0 tx=0x7fd774005830 comp rx=0 tx=0).stop 2024-03-31T16:36:19.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd791622640 1 -- 172.21.15.120:0/369780383 shutdown_connections 2024-03-31T16:36:19.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd791622640 1 --2- 172.21.15.120:0/369780383 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7740039b0 0x7fd774003dd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd791622640 1 -- 172.21.15.120:0/369780383 >> 172.21.15.120:0/369780383 conn(0x7fd78c09d7b0 msgr2=0x7fd78c08bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:19.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.180+0000 7fd791622640 1 -- 172.21.15.120:0/369780383 shutdown_connections 2024-03-31T16:36:19.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.181+0000 7fd791622640 1 -- 172.21.15.120:0/369780383 wait complete. 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.182+0000 7fd791622640 1 Processor -- start 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.182+0000 7fd791622640 1 -- start start 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.182+0000 7fd791622640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7740039b0 0x7fd78c15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.182+0000 7fd791622640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd78c0b6720 0x7fd78c15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.182+0000 7fd791622640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd78c0cd7d0 0x7fd78c0cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.182+0000 7fd791622640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c06c890 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.182+0000 7fd791622640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c0d1ac0 con 0x7fd7740039b0 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.182+0000 7fd791622640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd78c06ca10 con 0x7fd78c0b6720 2024-03-31T16:36:19.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd78c0cd7d0 0x7fd78c0cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd78c0cd7d0 0x7fd78c0cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54650/0 (socket says 172.21.15.120:54650) 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 -- 172.21.15.120:0/3993553533 learned_addr learned my addr 172.21.15.120:0/3993553533 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78affd640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7740039b0 0x7fd78c15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78a7fc640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd78c0b6720 0x7fd78c15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 -- 172.21.15.120:0/3993553533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd78c0b6720 msgr2=0x7fd78c15ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd78c0b6720 0x7fd78c15ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 -- 172.21.15.120:0/3993553533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7740039b0 msgr2=0x7fd78c15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7740039b0 0x7fd78c15b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 -- 172.21.15.120:0/3993553533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c0b6ba0 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd78b7fe640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd78c0cd7d0 0x7fd78c0cdc50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd78c08c700 tx=0x7fd78400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd7737fe640 1 -- 172.21.15.120:0/3993553533 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784003970 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd7737fe640 1 -- 172.21.15.120:0/3993553533 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd784018070 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd7737fe640 1 -- 172.21.15.120:0/3993553533 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784003d70 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c0b4050 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.183+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78c0b5980 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.184+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78c0685c0 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.185+0000 7fd7737fe640 1 -- 172.21.15.120:0/3993553533 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7840050d0 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.185+0000 7fd7737fe640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd77806c920 0x7fd77806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.185+0000 7fd7737fe640 1 -- 172.21.15.120:0/3993553533 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd78408b4b0 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.185+0000 7fd78affd640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd77806c920 0x7fd77806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.185+0000 7fd78affd640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd77806c920 0x7fd77806ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd77c036000 tx=0x7fd77c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.189+0000 7fd7737fe640 1 -- 172.21.15.120:0/3993553533 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd78c0b6ba0 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.430+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fd78c06c670 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.432+0000 7fd7737fe640 1 -- 172.21.15.120:0/3993553533 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7fd784059b90 con 0x7fd78c0cd7d0 2024-03-31T16:36:19.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd77806c920 msgr2=0x7fd77806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd77806c920 0x7fd77806ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd77c036000 tx=0x7fd77c030000 comp rx=0 tx=0).stop 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd78c0cd7d0 msgr2=0x7fd78c0cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd78c0cd7d0 0x7fd78c0cdc50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd78c08c700 tx=0x7fd78400ec10 comp rx=0 tx=0).stop 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 shutdown_connections 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd77806c920 0x7fd77806ede0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd78c0cd7d0 0x7fd78c0cdc50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd78c0b6720 0x7fd78c15ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 --2- 172.21.15.120:0/3993553533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7740039b0 0x7fd78c15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 >> 172.21.15.120:0/3993553533 conn(0x7fd78c09d7b0 msgr2=0x7fd78c0b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 shutdown_connections 2024-03-31T16:36:19.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.434+0000 7fd791622640 1 -- 172.21.15.120:0/3993553533 wait complete. 2024-03-31T16:36:19.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-31T16:36:19.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.546+0000 7f39f9cfb640 1 Processor -- start 2024-03-31T16:36:19.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.546+0000 7f39f9cfb640 1 -- start start 2024-03-31T16:36:19.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f9cfb640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f39f40d0990 0x7f39f40aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f9cfb640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f39f40af2e0 0x7f39f41600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f9cfb640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f40afab0 con 0x7f39f4153580 2024-03-31T16:36:19.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f9cfb640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f39f415cc80 con 0x7f39f40af2e0 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f9cfb640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f39f415da00 con 0x7f39f40d0990 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f39f40af2e0 0x7f39f41600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f37fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f39f4153580 0x7f39f40d0280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38122/0 (socket says 172.21.15.120:38122) 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f37fe640 1 -- 172.21.15.120:0/2974573443 learned_addr learned my addr 172.21.15.120:0/2974573443 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f2ffd640 1 --2- 172.21.15.120:0/2974573443 >> v2:172.21.15.203:3300/0 conn(0x7f39f40d0990 0x7f39f40aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f3fff640 1 -- 172.21.15.120:0/2974573443 >> v2:172.21.15.203:3300/0 conn(0x7f39f40d0990 msgr2=0x7f39f40aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f3fff640 1 --2- 172.21.15.120:0/2974573443 >> v2:172.21.15.203:3300/0 conn(0x7f39f40d0990 0x7f39f40aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f3fff640 1 -- 172.21.15.120:0/2974573443 >> v1:172.21.15.120:6789/0 conn(0x7f39f4153580 legacy=0x7f39f40d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f3fff640 1 -- 172.21.15.120:0/2974573443 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f415cf20 con 0x7f39f40af2e0 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f27fc640 1 -- 172.21.15.120:0/2974573443 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051969042 0 0) 0x7f39f40afab0 con 0x7f39f4153580 2024-03-31T16:36:19.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.547+0000 7f39f2ffd640 1 --2- 172.21.15.120:0/2974573443 >> v2:172.21.15.203:3300/0 conn(0x7f39f40d0990 0x7f39f40aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:19.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.548+0000 7f39f3fff640 1 --2- 172.21.15.120:0/2974573443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f41600d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39f415a6b0 tx=0x7f39ec02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dae7d511e91b0a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.548+0000 7f39f27fc640 1 -- 172.21.15.120:0/2974573443 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec039070 con 0x7f39f40af2e0 2024-03-31T16:36:19.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.548+0000 7f39f27fc640 1 -- 172.21.15.120:0/2974573443 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec02cbf0 con 0x7f39f40af2e0 2024-03-31T16:36:19.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.548+0000 7f39f27fc640 1 -- 172.21.15.120:0/2974573443 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec034440 con 0x7f39f40af2e0 2024-03-31T16:36:19.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.549+0000 7f39f9cfb640 1 -- 172.21.15.120:0/2974573443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 msgr2=0x7f39f41600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.549+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/2974573443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f41600d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39f415a6b0 tx=0x7f39ec02be40 comp rx=0 tx=0).stop 2024-03-31T16:36:19.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.549+0000 7f39f9cfb640 1 -- 172.21.15.120:0/2974573443 shutdown_connections 2024-03-31T16:36:19.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.549+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/2974573443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f41600d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.549+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/2974573443 >> v2:172.21.15.203:3300/0 conn(0x7f39f40d0990 0x7f39f40aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.549+0000 7f39f9cfb640 1 -- 172.21.15.120:0/2974573443 >> 172.21.15.120:0/2974573443 conn(0x7f39f406b750 msgr2=0x7f39f406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:19.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.549+0000 7f39f9cfb640 1 -- 172.21.15.120:0/2974573443 shutdown_connections 2024-03-31T16:36:19.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.549+0000 7f39f9cfb640 1 -- 172.21.15.120:0/2974573443 wait complete. 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.550+0000 7f39f9cfb640 1 Processor -- start 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.550+0000 7f39f9cfb640 1 -- start start 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f9cfb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f414a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f9cfb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f40d0990 0x7f39f40cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f9cfb640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39f4153580 0x7f39f40cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f9cfb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39f4153960 con 0x7f39f40af2e0 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f9cfb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39f415d4e0 con 0x7f39f40d0990 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f9cfb640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39f40af6c0 con 0x7f39f4153580 2024-03-31T16:36:19.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f414a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f414a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54674/0 (socket says 172.21.15.120:54674) 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 -- 172.21.15.120:0/3224590693 learned_addr learned my addr 172.21.15.120:0/3224590693 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f2ffd640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f40d0990 0x7f39f40cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f3fff640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39f4153580 0x7f39f40cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 -- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39f4153580 msgr2=0x7f39f40cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39f4153580 0x7f39f40cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 -- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f40d0990 msgr2=0x7f39f40cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f40d0990 0x7f39f40cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 -- 172.21.15.120:0/3224590693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f4155ad0 con 0x7f39f40af2e0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f2ffd640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f40d0990 0x7f39f40cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.551+0000 7f39f37fe640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f414a880 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f39e400c500 tx=0x7f39e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.552+0000 7f39dbfff640 1 -- 172.21.15.120:0/3224590693 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4018070 con 0x7f39f40af2e0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.552+0000 7f39dbfff640 1 -- 172.21.15.120:0/3224590693 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e4007580 con 0x7f39f40af2e0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.552+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f4155db0 con 0x7f39f40af2e0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.552+0000 7f39dbfff640 1 -- 172.21.15.120:0/3224590693 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4004a20 con 0x7f39f40af2e0 2024-03-31T16:36:19.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.552+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f4156370 con 0x7f39f40af2e0 2024-03-31T16:36:19.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.553+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f40685c0 con 0x7f39f40af2e0 2024-03-31T16:36:19.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.553+0000 7f39dbfff640 1 -- 172.21.15.120:0/3224590693 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39e401b070 con 0x7f39f40af2e0 2024-03-31T16:36:19.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.553+0000 7f39dbfff640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f39e006c8f0 0x7f39e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.554+0000 7f39f2ffd640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f39e006c8f0 0x7f39e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.554+0000 7f39dbfff640 1 -- 172.21.15.120:0/3224590693 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f39e408aad0 con 0x7f39f40af2e0 2024-03-31T16:36:19.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.554+0000 7f39f2ffd640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f39e006c8f0 0x7f39e006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39f414adc0 tx=0x7f39e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.558+0000 7f39dbfff640 1 -- 172.21.15.120:0/3224590693 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f39e40592e0 con 0x7f39f40af2e0 2024-03-31T16:36:19.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.800+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f39f406eca0 con 0x7f39f40af2e0 2024-03-31T16:36:19.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.801+0000 7f39dbfff640 1 -- 172.21.15.120:0/3224590693 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f39e4058be0 con 0x7f39f40af2e0 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f39e006c8f0 msgr2=0x7f39e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f39e006c8f0 0x7f39e006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39f414adc0 tx=0x7f39e8008040 comp rx=0 tx=0).stop 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 msgr2=0x7f39f414a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f414a880 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f39e400c500 tx=0x7f39e400c9c0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 shutdown_connections 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f39e006c8f0 0x7f39e006edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39f4153580 0x7f39f40cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39f40d0990 0x7f39f40cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 --2- 172.21.15.120:0/3224590693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f40af2e0 0x7f39f414a880 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 >> 172.21.15.120:0/3224590693 conn(0x7f39f406b750 msgr2=0x7f39f40b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 shutdown_connections 2024-03-31T16:36:19.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.804+0000 7f39f9cfb640 1 -- 172.21.15.120:0/3224590693 wait complete. 2024-03-31T16:36:19.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:19.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.915+0000 7f249ff4d640 1 Processor -- start 2024-03-31T16:36:19.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.915+0000 7f249ff4d640 1 -- start start 2024-03-31T16:36:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.916+0000 7f249ff4d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 0x7f249815c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.916+0000 7f249ff4d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f24980d0540 0x7f24980ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.916+0000 7f249ff4d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249815cd90 con 0x7f249815da60 2024-03-31T16:36:19.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.916+0000 7f249ff4d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f249815d060 con 0x7f24980d0540 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.916+0000 7f249ff4d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f249815d340 con 0x7f249815f900 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.916+0000 7f249d4e8640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f249815da60 0x7f24980cfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38130/0 (socket says 172.21.15.120:38130) 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.916+0000 7f249d4e8640 1 -- 172.21.15.120:0/2427834899 learned_addr learned my addr 172.21.15.120:0/2427834899 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249dce9640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 0x7f249815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249e4ea640 1 --2- 172.21.15.120:0/2427834899 >> v2:172.21.15.203:3300/0 conn(0x7f24980d0540 0x7f24980ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616347547 0 0) 0x7f249815cd90 con 0x7f249815da60 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2484003520 con 0x7f249815da60 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 489472467 0 0) 0x7f2484003520 con 0x7f249815da60 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 msgr2=0x7f249815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 0x7f249815c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 >> v2:172.21.15.203:3300/0 conn(0x7f24980d0540 msgr2=0x7f24980ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 --2- 172.21.15.120:0/2427834899 >> v2:172.21.15.203:3300/0 conn(0x7f24980d0540 0x7f24980ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249815d620 con 0x7f249815da60 2024-03-31T16:36:19.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7f2494001670 con 0x7f249815da60 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 >> v1:172.21.15.120:6789/0 conn(0x7f249815da60 legacy=0x7f24980cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24840039b0 0x7f2484003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2484004800 0x7f2484004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 0x7f24840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f249815d060 con 0x7f24840039b0 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f249815d340 con 0x7f2484004800 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f248400b9c0 con 0x7f249815f900 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249dce9640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24840039b0 0x7f2484003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249d4e8640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2484004800 0x7f2484004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249e4ea640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 0x7f24840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249dce9640 1 -- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 msgr2=0x7f24840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249dce9640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 0x7f24840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249dce9640 1 -- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2484004800 msgr2=0x7f2484004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249dce9640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2484004800 0x7f2484004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249dce9640 1 -- 172.21.15.120:0/2427834899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2484003520 con 0x7f24840039b0 2024-03-31T16:36:19.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.917+0000 7f249e4ea640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f249815f900 0x7f24840051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.918+0000 7f249dce9640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24840039b0 0x7f2484003dd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f248c009ac0 tx=0x7f2484005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cce8cfc45dbbec1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.918+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c039070 con 0x7f24840039b0 2024-03-31T16:36:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.918+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c02c6b0 con 0x7f24840039b0 2024-03-31T16:36:19.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.918+0000 7f249cce7640 1 -- 172.21.15.120:0/2427834899 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c009690 con 0x7f24840039b0 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.919+0000 7f249ff4d640 1 -- 172.21.15.120:0/2427834899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24840039b0 msgr2=0x7f2484003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.919+0000 7f249ff4d640 1 --2- 172.21.15.120:0/2427834899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24840039b0 0x7f2484003dd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f248c009ac0 tx=0x7f2484005830 comp rx=0 tx=0).stop 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.919+0000 7f249e4ea640 1 -- 172.21.15.120:0/2427834899 reap_dead start 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.919+0000 7f249ff4d640 1 -- 172.21.15.120:0/2427834899 shutdown_connections 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.919+0000 7f249ff4d640 1 -- 172.21.15.120:0/2427834899 >> 172.21.15.120:0/2427834899 conn(0x7f24980b3e90 msgr2=0x7f24980b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.919+0000 7f249ff4d640 1 -- 172.21.15.120:0/2427834899 shutdown_connections 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.919+0000 7f249ff4d640 1 -- 172.21.15.120:0/2427834899 wait complete. 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.920+0000 7f249ff4d640 1 Processor -- start 2024-03-31T16:36:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.920+0000 7f249ff4d640 1 -- start start 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249ff4d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24840039b0 0x7f249815a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249ff4d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24980c9e20 0x7f24980ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249ff4d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24980b4f00 0x7f24980b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249ff4d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2498160010 con 0x7f24980c9e20 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249ff4d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f249815fe90 con 0x7f24840039b0 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249ff4d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2498160190 con 0x7f24980b4f00 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24980c9e20 0x7f24980ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24980c9e20 0x7f24980ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54688/0 (socket says 172.21.15.120:54688) 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 -- 172.21.15.120:0/1730879767 learned_addr learned my addr 172.21.15.120:0/1730879767 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249e4ea640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24980b4f00 0x7f24980b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249dce9640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24840039b0 0x7f249815a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 -- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24980b4f00 msgr2=0x7f24980b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24980b4f00 0x7f24980b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 -- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24840039b0 msgr2=0x7f249815a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24840039b0 0x7f249815a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 -- 172.21.15.120:0/1730879767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24980b83a0 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249dce9640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24840039b0 0x7f249815a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.921+0000 7f249d4e8640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24980c9e20 0x7f24980ca280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2494007340 tx=0x7f2494007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.922+0000 7f248a7fc640 1 -- 172.21.15.120:0/1730879767 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249400f9c0 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.922+0000 7f248a7fc640 1 -- 172.21.15.120:0/1730879767 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2494018070 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.922+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24980b7300 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.922+0000 7f248a7fc640 1 -- 172.21.15.120:0/1730879767 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249400fda0 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.922+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24980b78c0 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.923+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2498068cd0 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.923+0000 7f248a7fc640 1 -- 172.21.15.120:0/1730879767 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f249401d460 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.923+0000 7f248a7fc640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f247c06c8f0 0x7f247c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.923+0000 7f248a7fc640 1 -- 172.21.15.120:0/1730879767 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f249408b880 con 0x7f24980c9e20 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.924+0000 7f249dce9640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f247c06c8f0 0x7f247c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.924+0000 7f249dce9640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f247c06c8f0 0x7f247c06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f248c036000 tx=0x7f248c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:19.932 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:19.928+0000 7f248a7fc640 1 -- 172.21.15.120:0/1730879767 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f249405a000 con 0x7f24980c9e20 2024-03-31T16:36:20.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.107+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2498158d90 con 0x7f24980c9e20 2024-03-31T16:36:20.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.108+0000 7f248a7fc640 1 -- 172.21.15.120:0/1730879767 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+12903 (secure 0 0 0) 0x7f2494059900 con 0x7f24980c9e20 2024-03-31T16:36:20.112 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:20.112 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":28,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:17.217626+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f247c06c8f0 msgr2=0x7f247c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f247c06c8f0 0x7f247c06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f248c036000 tx=0x7f248c030000 comp rx=0 tx=0).stop 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24980c9e20 msgr2=0x7f24980ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24980c9e20 0x7f24980ca280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2494007340 tx=0x7f2494007800 comp rx=0 tx=0).stop 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 shutdown_connections 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f247c06c8f0 0x7f247c06edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24980b4f00 0x7f24980b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f24980c9e20 0x7f24980ca280 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 --2- 172.21.15.120:0/1730879767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24840039b0 0x7f249815a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 >> 172.21.15.120:0/1730879767 conn(0x7f24980b3e90 msgr2=0x7f24980d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:20.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 shutdown_connections 2024-03-31T16:36:20.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.110+0000 7f249ff4d640 1 -- 172.21.15.120:0/1730879767 wait complete. 2024-03-31T16:36:20.125 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-31T16:36:20.126 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-31T16:36:20.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.225+0000 7f3c31dc8640 1 Processor -- start 2024-03-31T16:36:20.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.225+0000 7f3c31dc8640 1 -- start start 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c31dc8640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c31dc8640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3c2c0d0990 0x7f3c2c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c31dc8640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2c0b40b0 con 0x7f3c2c15f800 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c31dc8640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2c0b4390 con 0x7f3c2c0d0990 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c31dc8640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2c0b4670 con 0x7f3c2c155550 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c2b7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c2bfff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3c2c0d0990 0x7f3c2c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c2b7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:35670/0 (socket says 172.21.15.120:35670) 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c2b7fe640 1 -- 172.21.15.120:0/1737563987 learned_addr learned my addr 172.21.15.120:0/1737563987 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:20.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.226+0000 7f3c2bfff640 1 --2- 172.21.15.120:0/1737563987 >> v2:172.21.15.203:3300/0 conn(0x7f3c2c0d0990 0x7f3c2c0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:59244/0 (socket says 172.21.15.120:59244) 2024-03-31T16:36:20.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.227+0000 7f3c2b7fe640 1 -- 172.21.15.120:0/1737563987 >> v2:172.21.15.203:3300/0 conn(0x7f3c2c0d0990 msgr2=0x7f3c2c0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:20.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.227+0000 7f3c2b7fe640 1 --2- 172.21.15.120:0/1737563987 >> v2:172.21.15.203:3300/0 conn(0x7f3c2c0d0990 0x7f3c2c0aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.227+0000 7f3c2b7fe640 1 -- 172.21.15.120:0/1737563987 >> v1:172.21.15.203:6789/0 conn(0x7f3c2c15f800 legacy=0x7f3c2c0d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.227+0000 7f3c2b7fe640 1 -- 172.21.15.120:0/1737563987 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2c0b4950 con 0x7f3c2c155550 2024-03-31T16:36:20.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c2b7fe640 1 --2- 172.21.15.120:0/1737563987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c155930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009870 tx=0x7f3c1c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de80c448b5ad8cd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c2a7fc640 1 -- 172.21.15.120:0/1737563987 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c035020 con 0x7f3c2c155550 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c2a7fc640 1 -- 172.21.15.120:0/1737563987 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1c031640 con 0x7f3c2c155550 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c2a7fc640 1 -- 172.21.15.120:0/1737563987 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c02d040 con 0x7f3c2c155550 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1737563987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 msgr2=0x7f3c2c155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1737563987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c155930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009870 tx=0x7f3c1c02b8f0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1737563987 shutdown_connections 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1737563987 >> v2:172.21.15.203:3300/0 conn(0x7f3c2c0d0990 0x7f3c2c0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1737563987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c155930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1737563987 >> 172.21.15.120:0/1737563987 conn(0x7f3c2c06b750 msgr2=0x7f3c2c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1737563987 shutdown_connections 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.228+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1737563987 wait complete. 2024-03-31T16:36:20.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.229+0000 7f3c31dc8640 1 Processor -- start 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c31dc8640 1 -- start start 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c31dc8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c2c0d0990 0x7f3c2c09b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c31dc8640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c1f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c31dc8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c2c15f800 0x7f3c2c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c31dc8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c15ba20 con 0x7f3c2c15f800 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c31dc8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c15fc80 con 0x7f3c2c0d0990 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c31dc8640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2c15bba0 con 0x7f3c2c155550 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c2bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c2c15f800 0x7f3c2c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c2bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c2c15f800 0x7f3c2c0b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54700/0 (socket says 172.21.15.120:54700) 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c2bfff640 1 -- 172.21.15.120:0/1927456111 learned_addr learned my addr 172.21.15.120:0/1927456111 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c2b7fe640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c2c0d0990 0x7f3c2c09b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.230+0000 7f3c2affd640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c1f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c2bfff640 1 -- 172.21.15.120:0/1927456111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 msgr2=0x7f3c2c1f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c2bfff640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c1f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c2bfff640 1 -- 172.21.15.120:0/1927456111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c2c0d0990 msgr2=0x7f3c2c09b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c2bfff640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c2c0d0990 0x7f3c2c09b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c2bfff640 1 -- 172.21.15.120:0/1927456111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2c09a330 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c2bfff640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c2c15f800 0x7f3c2c0b1d10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400ef90 tx=0x7f3c2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c13fff640 1 -- 172.21.15.120:0/1927456111 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24018020 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c13fff640 1 -- 172.21.15.120:0/1927456111 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c24014480 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c13fff640 1 -- 172.21.15.120:0/1927456111 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24009e60 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2c09a5d0 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.231+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2c09ab90 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.232+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2c0685c0 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.232+0000 7f3c13fff640 1 -- 172.21.15.120:0/1927456111 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c24005d10 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.233+0000 7f3c13fff640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c1806c8f0 0x7f3c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.233+0000 7f3c13fff640 1 -- 172.21.15.120:0/1927456111 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3c2408c340 con 0x7f3c2c15f800 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.233+0000 7f3c2b7fe640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c1806c8f0 0x7f3c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.233+0000 7f3c2b7fe640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c1806c8f0 0x7f3c1806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c036000 tx=0x7f3c1c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.237+0000 7f3c13fff640 1 -- 172.21.15.120:0/1927456111 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3c24022030 con 0x7f3c2c15f800 2024-03-31T16:36:20.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.412+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3c2c0b3ad0 con 0x7f3c2c15f800 2024-03-31T16:36:20.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.412+0000 7f3c13fff640 1 -- 172.21.15.120:0/1927456111 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f3c24010040 con 0x7f3c2c15f800 2024-03-31T16:36:20.416 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c1806c8f0 msgr2=0x7f3c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c1806c8f0 0x7f3c1806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c036000 tx=0x7f3c1c03c040 comp rx=0 tx=0).stop 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c2c15f800 msgr2=0x7f3c2c0b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c2c15f800 0x7f3c2c0b1d10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400ef90 tx=0x7f3c2400c490 comp rx=0 tx=0).stop 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 shutdown_connections 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c1806c8f0 0x7f3c1806edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c2c15f800 0x7f3c2c0b1d10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c2c155550 0x7f3c2c1f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 --2- 172.21.15.120:0/1927456111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c2c0d0990 0x7f3c2c09b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 >> 172.21.15.120:0/1927456111 conn(0x7f3c2c06b750 msgr2=0x7f3c2c071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:20.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 shutdown_connections 2024-03-31T16:36:20.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.414+0000 7f3c31dc8640 1 -- 172.21.15.120:0/1927456111 wait complete. 2024-03-31T16:36:20.429 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-31T16:36:20.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.525+0000 7f611064a640 1 Processor -- start 2024-03-31T16:36:20.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.525+0000 7f611064a640 1 -- start start 2024-03-31T16:36:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.526+0000 7f611064a640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f610815e7e0 0x7f61080d1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.526+0000 7f611064a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f61080cfb20 0x7f61080cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f611064a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610815ebc0 con 0x7f610806ca00 2024-03-31T16:36:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f611064a640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f610806d1c0 con 0x7f610815e7e0 2024-03-31T16:36:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f611064a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f610806d4a0 con 0x7f61080cfb20 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610dbe5640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f610806ca00 0x7f61080d2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38138/0 (socket says 172.21.15.120:38138) 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610dbe5640 1 -- 172.21.15.120:0/1035711859 learned_addr learned my addr 172.21.15.120:0/1035711859 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610ebe7640 1 --2- 172.21.15.120:0/1035711859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f61080cfb20 0x7f61080cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610e3e6640 1 --2- 172.21.15.120:0/1035711859 >> v2:172.21.15.203:3300/0 conn(0x7f610815e7e0 0x7f61080d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610d3e4640 1 -- 172.21.15.120:0/1035711859 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806813987 0 0) 0x7f610815ebc0 con 0x7f610806ca00 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610d3e4640 1 -- 172.21.15.120:0/1035711859 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60f0003520 con 0x7f610806ca00 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610ebe7640 1 -- 172.21.15.120:0/1035711859 >> v2:172.21.15.203:3300/0 conn(0x7f610815e7e0 msgr2=0x7f61080d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610ebe7640 1 --2- 172.21.15.120:0/1035711859 >> v2:172.21.15.203:3300/0 conn(0x7f610815e7e0 0x7f61080d1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610ebe7640 1 -- 172.21.15.120:0/1035711859 >> v1:172.21.15.120:6789/0 conn(0x7f610806ca00 legacy=0x7f61080d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.527+0000 7f610ebe7640 1 -- 172.21.15.120:0/1035711859 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61080cf320 con 0x7f61080cfb20 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.528+0000 7f610ebe7640 1 --2- 172.21.15.120:0/1035711859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f61080cfb20 0x7f61080cffb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f60f80097a0 tx=0x7f60f802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3158b4d6a82f012 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.528+0000 7f610d3e4640 1 -- 172.21.15.120:0/1035711859 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f80315a0 con 0x7f61080cfb20 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.528+0000 7f610d3e4640 1 -- 172.21.15.120:0/1035711859 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f8037070 con 0x7f61080cfb20 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.528+0000 7f610d3e4640 1 -- 172.21.15.120:0/1035711859 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8031940 con 0x7f61080cfb20 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.529+0000 7f611064a640 1 -- 172.21.15.120:0/1035711859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f61080cfb20 msgr2=0x7f61080cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.529+0000 7f611064a640 1 --2- 172.21.15.120:0/1035711859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f61080cfb20 0x7f61080cffb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f60f80097a0 tx=0x7f60f802b840 comp rx=0 tx=0).stop 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.529+0000 7f611064a640 1 -- 172.21.15.120:0/1035711859 shutdown_connections 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.529+0000 7f611064a640 1 --2- 172.21.15.120:0/1035711859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f61080cfb20 0x7f61080cffb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.529+0000 7f611064a640 1 --2- 172.21.15.120:0/1035711859 >> v2:172.21.15.203:3300/0 conn(0x7f610815e7e0 0x7f61080d1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.529+0000 7f611064a640 1 -- 172.21.15.120:0/1035711859 >> 172.21.15.120:0/1035711859 conn(0x7f610809d7c0 msgr2=0x7f610806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:20.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.529+0000 7f611064a640 1 -- 172.21.15.120:0/1035711859 shutdown_connections 2024-03-31T16:36:20.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.529+0000 7f611064a640 1 -- 172.21.15.120:0/1035711859 wait complete. 2024-03-31T16:36:20.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.530+0000 7f611064a640 1 Processor -- start 2024-03-31T16:36:20.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.530+0000 7f611064a640 1 -- start start 2024-03-31T16:36:20.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.530+0000 7f611064a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610806ca00 0x7f61081f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.530+0000 7f611064a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61080cfb20 0x7f61080d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f611064a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f610815e7e0 0x7f61080d3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f611064a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f610806ce60 con 0x7f610806ca00 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f611064a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61080cefd0 con 0x7f61080cfb20 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f611064a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f61080d2f30 con 0x7f610815e7e0 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610806ca00 0x7f61081f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610806ca00 0x7f61081f46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54708/0 (socket says 172.21.15.120:54708) 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 -- 172.21.15.120:0/1308361462 learned_addr learned my addr 172.21.15.120:0/1308361462 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610dbe5640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61080cfb20 0x7f61080d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610ebe7640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f610815e7e0 0x7f61080d3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 -- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f610815e7e0 msgr2=0x7f61080d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f610815e7e0 0x7f61080d3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 -- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61080cfb20 msgr2=0x7f61080d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61080cfb20 0x7f61080d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 -- 172.21.15.120:0/1308361462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61080b8370 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610dbe5640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61080cfb20 0x7f61080d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610ebe7640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f610815e7e0 0x7f61080d3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f610e3e6640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610806ca00 0x7f61081f46c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f610000efc0 tx=0x7f610000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f6106ffd640 1 -- 172.21.15.120:0/1308361462 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100018020 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f6106ffd640 1 -- 172.21.15.120:0/1308361462 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6100014480 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61080b8650 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f6106ffd640 1 -- 172.21.15.120:0/1308361462 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100014850 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.531+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61080b8c10 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.532+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61080685c0 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.533+0000 7f6106ffd640 1 -- 172.21.15.120:0/1308361462 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6100005d10 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.533+0000 7f6106ffd640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f60f406c8f0 0x7f60f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.533+0000 7f6106ffd640 1 -- 172.21.15.120:0/1308361462 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f610008c290 con 0x7f610806ca00 2024-03-31T16:36:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.533+0000 7f610dbe5640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f60f406c8f0 0x7f60f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.534+0000 7f610dbe5640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f60f406c8f0 0x7f60f406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61080cb740 tx=0x7f60fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.537+0000 7f6106ffd640 1 -- 172.21.15.120:0/1308361462 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6100022070 con 0x7f610806ca00 2024-03-31T16:36:20.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.715+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6108162be0 con 0x7f610806ca00 2024-03-31T16:36:20.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.716+0000 7f6106ffd640 1 -- 172.21.15.120:0/1308361462 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f6100010040 con 0x7f610806ca00 2024-03-31T16:36:20.720 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:20.720 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-03-31T16:36:20.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-03-31T16:36:20.720 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-03-31T16:36:20.721 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-03-31T16:36:20.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-03-31T16:36:20.721 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-03-31T16:36:20.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f60f406c8f0 msgr2=0x7f60f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f60f406c8f0 0x7f60f406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61080cb740 tx=0x7f60fc009040 comp rx=0 tx=0).stop 2024-03-31T16:36:20.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610806ca00 msgr2=0x7f61081f46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610806ca00 0x7f61081f46c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f610000efc0 tx=0x7f610000c490 comp rx=0 tx=0).stop 2024-03-31T16:36:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 shutdown_connections 2024-03-31T16:36:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f60f406c8f0 0x7f60f406edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f610815e7e0 0x7f61080d3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61080cfb20 0x7f61080d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 --2- 172.21.15.120:0/1308361462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610806ca00 0x7f61081f46c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 >> 172.21.15.120:0/1308361462 conn(0x7f610809d7c0 msgr2=0x7f61080d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 shutdown_connections 2024-03-31T16:36:20.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.718+0000 7f611064a640 1 -- 172.21.15.120:0/1308361462 wait complete. 2024-03-31T16:36:20.732 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-31T16:36:20.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-31T16:36:20.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.833+0000 7f43c3c42640 1 Processor -- start 2024-03-31T16:36:20.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.833+0000 7f43c3c42640 1 -- start start 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c3c42640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f43bc0b4560 0x7f43bc0af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c3c42640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc06c580 0x7f43bc06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c3c42640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43bc15e9b0 con 0x7f43bc15e5d0 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c3c42640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f43bc0af400 con 0x7f43bc0b4560 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c3c42640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc0ae830 con 0x7f43bc06c580 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c19de640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f43bc15e5d0 0x7f43bc0b5b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38154/0 (socket says 172.21.15.120:38154) 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c19de640 1 -- 172.21.15.120:0/1982201101 learned_addr learned my addr 172.21.15.120:0/1982201101 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c21df640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc06c580 0x7f43bc06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c11dd640 1 --2- 172.21.15.120:0/1982201101 >> v2:172.21.15.203:3300/0 conn(0x7f43bc0b4560 0x7f43bc0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699580216 0 0) 0x7f43b8001110 con 0x7f43bc15e5d0 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43a8003520 con 0x7f43bc15e5d0 2024-03-31T16:36:20.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 629964360 0 0) 0x7f43a8003520 con 0x7f43bc15e5d0 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc06c580 msgr2=0x7f43bc06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc06c580 0x7f43bc06ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 >> v2:172.21.15.203:3300/0 conn(0x7f43bc0b4560 msgr2=0x7f43bc0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 --2- 172.21.15.120:0/1982201101 >> v2:172.21.15.203:3300/0 conn(0x7f43bc0b4560 0x7f43bc0af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc0aead0 con 0x7f43bc15e5d0 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7f43b8001840 con 0x7f43bc15e5d0 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 >> v1:172.21.15.120:6789/0 conn(0x7f43bc15e5d0 legacy=0x7f43bc0b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.834+0000 7f43c09dc640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43a80039b0 0x7f43a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c09dc640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc06c580 0x7f43a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c09dc640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a8004d40 0x7f43a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0af400 con 0x7f43a80039b0 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0ae830 con 0x7f43a8004d40 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43a800b9c0 con 0x7f43bc06c580 2024-03-31T16:36:20.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c19de640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43a80039b0 0x7f43a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c21df640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a8004d40 0x7f43a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c11dd640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc06c580 0x7f43a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c19de640 1 -- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc06c580 msgr2=0x7f43a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c19de640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc06c580 0x7f43a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c19de640 1 -- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a8004d40 msgr2=0x7f43a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c19de640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a8004d40 0x7f43a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c19de640 1 -- 172.21.15.120:0/1982201101 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a8003520 con 0x7f43a80039b0 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.835+0000 7f43c21df640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a8004d40 0x7f43a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c19de640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43a80039b0 0x7f43a8003dd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c410 tx=0x7f43a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd16686c9fedcc40 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b800c0e0 con 0x7f43a80039b0 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b8030070 con 0x7f43a80039b0 2024-03-31T16:36:20.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c09dc640 1 -- 172.21.15.120:0/1982201101 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b80058d0 con 0x7f43a80039b0 2024-03-31T16:36:20.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c3c42640 1 -- 172.21.15.120:0/1982201101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43a80039b0 msgr2=0x7f43a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c3c42640 1 --2- 172.21.15.120:0/1982201101 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43a80039b0 0x7f43a8003dd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c410 tx=0x7f43a8005830 comp rx=0 tx=0).stop 2024-03-31T16:36:20.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c21df640 1 -- 172.21.15.120:0/1982201101 reap_dead start 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c3c42640 1 -- 172.21.15.120:0/1982201101 shutdown_connections 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c3c42640 1 -- 172.21.15.120:0/1982201101 >> 172.21.15.120:0/1982201101 conn(0x7f43bc0720d0 msgr2=0x7f43bc0724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c3c42640 1 -- 172.21.15.120:0/1982201101 shutdown_connections 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.836+0000 7f43c3c42640 1 -- 172.21.15.120:0/1982201101 wait complete. 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c3c42640 1 Processor -- start 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c3c42640 1 -- start start 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c3c42640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a80039b0 0x7f43bc15d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c3c42640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc15a6b0 0x7f43bc15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c3c42640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43bc144b30 0x7f43bc1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c3c42640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0afdd0 con 0x7f43bc144b30 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c3c42640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc0af090 con 0x7f43a80039b0 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c3c42640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43bc0aff50 con 0x7f43bc15a6b0 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c21df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43bc144b30 0x7f43bc1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c21df640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43bc144b30 0x7f43bc1474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54736/0 (socket says 172.21.15.120:54736) 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c21df640 1 -- 172.21.15.120:0/1666461705 learned_addr learned my addr 172.21.15.120:0/1666461705 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c19de640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a80039b0 0x7f43bc15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.838+0000 7f43c11dd640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc15a6b0 0x7f43bc15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c21df640 1 -- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc15a6b0 msgr2=0x7f43bc15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c21df640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc15a6b0 0x7f43bc15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c21df640 1 -- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a80039b0 msgr2=0x7f43bc15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c21df640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a80039b0 0x7f43bc15d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c21df640 1 -- 172.21.15.120:0/1666461705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc15c530 con 0x7f43bc144b30 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c11dd640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc15a6b0 0x7f43bc15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c21df640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43bc144b30 0x7f43bc1474f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f43bc067620 tx=0x7f43b4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43b27fc640 1 -- 172.21.15.120:0/1666461705 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b401a030 con 0x7f43bc144b30 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43b27fc640 1 -- 172.21.15.120:0/1666461705 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b4010d80 con 0x7f43bc144b30 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43bc15c7f0 con 0x7f43bc144b30 2024-03-31T16:36:20.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43b27fc640 1 -- 172.21.15.120:0/1666461705 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4003bd0 con 0x7f43bc144b30 2024-03-31T16:36:20.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.839+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43bc15cdb0 con 0x7f43bc144b30 2024-03-31T16:36:20.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.840+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43bc0685c0 con 0x7f43bc144b30 2024-03-31T16:36:20.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.840+0000 7f43b27fc640 1 -- 172.21.15.120:0/1666461705 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43b4005d10 con 0x7f43bc144b30 2024-03-31T16:36:20.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.841+0000 7f43b27fc640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c8f0 0x7f43a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:20.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.841+0000 7f43b27fc640 1 -- 172.21.15.120:0/1666461705 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f43b408bdc0 con 0x7f43bc144b30 2024-03-31T16:36:20.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.841+0000 7f43c19de640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c8f0 0x7f43a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:20.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.841+0000 7f43c19de640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c8f0 0x7f43a006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c3e0 tx=0x7f43b8007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:20.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:20.845+0000 7f43b27fc640 1 -- 172.21.15.120:0/1666461705 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f43b4025020 con 0x7f43bc144b30 2024-03-31T16:36:21.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.019+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f43bc068cd0 con 0x7f43bc144b30 2024-03-31T16:36:21.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.805+0000 7f43b27fc640 1 -- 172.21.15.120:0/1666461705 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f43b405a5d0 con 0x7f43bc144b30 2024-03-31T16:36:21.809 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.807+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c8f0 msgr2=0x7f43a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.807+0000 7f43c3c42640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c8f0 0x7f43a006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c3e0 tx=0x7f43b8007000 comp rx=0 tx=0).stop 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.807+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43bc144b30 msgr2=0x7f43bc1474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.807+0000 7f43c3c42640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43bc144b30 0x7f43bc1474f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f43bc067620 tx=0x7f43b4010590 comp rx=0 tx=0).stop 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.808+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 shutdown_connections 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.808+0000 7f43c3c42640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c8f0 0x7f43a006edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.808+0000 7f43c3c42640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43bc144b30 0x7f43bc1474f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.808+0000 7f43c3c42640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43bc15a6b0 0x7f43bc15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.808+0000 7f43c3c42640 1 --2- 172.21.15.120:0/1666461705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a80039b0 0x7f43bc15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.808+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 >> 172.21.15.120:0/1666461705 conn(0x7f43bc0720d0 msgr2=0x7f43bc06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:21.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.808+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 shutdown_connections 2024-03-31T16:36:21.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.808+0000 7f43c3c42640 1 -- 172.21.15.120:0/1666461705 wait complete. 2024-03-31T16:36:21.829 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-31T16:36:21.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.938+0000 7fee70ed6640 1 Processor -- start 2024-03-31T16:36:21.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.938+0000 7fee70ed6640 1 -- start start 2024-03-31T16:36:21.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.938+0000 7fee70ed6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fee6c0b4a30 0x7fee6c0b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:21.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee70ed6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c15ede0 con 0x7fee6c0b4650 2024-03-31T16:36:21.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee70ed6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c141d80 con 0x7fee6c158580 2024-03-31T16:36:21.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee70ed6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fee6c141b30 con 0x7fee6c0b4a30 2024-03-31T16:36:21.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee63fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fee6c0b4a30 0x7fee6c0b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:21.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee6a59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fee6c0b4650 0x7fee6c06c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38166/0 (socket says 172.21.15.120:38166) 2024-03-31T16:36:21.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee6a59c640 1 -- 172.21.15.120:0/1881420648 learned_addr learned my addr 172.21.15.120:0/1881420648 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:21.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee63fff640 1 -- 172.21.15.120:0/1881420648 >> v1:172.21.15.203:6789/0 conn(0x7fee6c158580 legacy=0x7fee6c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:21.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee63fff640 1 -- 172.21.15.120:0/1881420648 >> v1:172.21.15.120:6789/0 conn(0x7fee6c0b4650 legacy=0x7fee6c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:21.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.939+0000 7fee63fff640 1 -- 172.21.15.120:0/1881420648 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c142060 con 0x7fee6c0b4a30 2024-03-31T16:36:21.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee63fff640 1 --2- 172.21.15.120:0/1881420648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4a30 0x7fee6c0b5c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee540097a0 tx=0x7fee5402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa31919b2fda7c39 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:21.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee69d9b640 1 -- 172.21.15.120:0/1881420648 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54035020 con 0x7fee6c0b4a30 2024-03-31T16:36:21.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee69d9b640 1 -- 172.21.15.120:0/1881420648 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee54031830 con 0x7fee6c0b4a30 2024-03-31T16:36:21.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee69d9b640 1 -- 172.21.15.120:0/1881420648 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54031c00 con 0x7fee6c0b4a30 2024-03-31T16:36:21.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee70ed6640 1 -- 172.21.15.120:0/1881420648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4a30 msgr2=0x7fee6c0b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:21.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee70ed6640 1 --2- 172.21.15.120:0/1881420648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4a30 0x7fee6c0b5c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee540097a0 tx=0x7fee5402b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:21.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee70ed6640 1 -- 172.21.15.120:0/1881420648 shutdown_connections 2024-03-31T16:36:21.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee70ed6640 1 --2- 172.21.15.120:0/1881420648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4a30 0x7fee6c0b5c10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:21.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee70ed6640 1 -- 172.21.15.120:0/1881420648 >> 172.21.15.120:0/1881420648 conn(0x7fee6c067670 msgr2=0x7fee6c067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:21.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee70ed6640 1 -- 172.21.15.120:0/1881420648 shutdown_connections 2024-03-31T16:36:21.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.940+0000 7fee70ed6640 1 -- 172.21.15.120:0/1881420648 wait complete. 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.942+0000 7fee70ed6640 1 Processor -- start 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.942+0000 7fee70ed6640 1 -- start start 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.942+0000 7fee70ed6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4650 0x7fee6c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.942+0000 7fee70ed6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee6c0b4a30 0x7fee6c0d2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.942+0000 7fee70ed6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee6c158580 0x7fee6c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.942+0000 7fee70ed6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c142900 con 0x7fee6c0b4650 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.942+0000 7fee70ed6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c142620 con 0x7fee6c158580 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.942+0000 7fee70ed6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c0b6150 con 0x7fee6c0b4a30 2024-03-31T16:36:21.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4650 0x7fee6c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4650 0x7fee6c15d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54748/0 (socket says 172.21.15.120:54748) 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 -- 172.21.15.120:0/725750029 learned_addr learned my addr 172.21.15.120:0/725750029 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 -- 172.21.15.120:0/725750029 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee6c0b4a30 msgr2=0x7fee6c0d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee6c0b4a30 0x7fee6c0d2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 -- 172.21.15.120:0/725750029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee6c158580 msgr2=0x7fee6c06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee6c158580 0x7fee6c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 -- 172.21.15.120:0/725750029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c1f50e0 con 0x7fee6c0b4650 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee6a59c640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4650 0x7fee6c15d900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c3f0 tx=0x7fee5c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee62ffd640 1 -- 172.21.15.120:0/725750029 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c017070 con 0x7fee6c0b4650 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee62ffd640 1 -- 172.21.15.120:0/725750029 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5c005ce0 con 0x7fee6c0b4650 2024-03-31T16:36:21.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c15e470 con 0x7fee6c0b4650 2024-03-31T16:36:21.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee62ffd640 1 -- 172.21.15.120:0/725750029 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c007310 con 0x7fee6c0b4650 2024-03-31T16:36:21.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.943+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c1f56a0 con 0x7fee6c0b4650 2024-03-31T16:36:21.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.944+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6c074f30 con 0x7fee6c0b4650 2024-03-31T16:36:21.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.945+0000 7fee62ffd640 1 -- 172.21.15.120:0/725750029 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee5c01a070 con 0x7fee6c0b4650 2024-03-31T16:36:21.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.945+0000 7fee62ffd640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fee4c06c8f0 0x7fee4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:21.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.945+0000 7fee62ffd640 1 -- 172.21.15.120:0/725750029 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7fee5c08acd0 con 0x7fee6c0b4650 2024-03-31T16:36:21.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.945+0000 7fee63fff640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fee4c06c8f0 0x7fee4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:21.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.945+0000 7fee63fff640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fee4c06c8f0 0x7fee4c06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fee54036000 tx=0x7fee54030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:21.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:21.950+0000 7fee62ffd640 1 -- 172.21.15.120:0/725750029 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fee5c0592e0 con 0x7fee6c0b4650 2024-03-31T16:36:22.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.124+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fee6c070270 con 0x7fee6c0b4650 2024-03-31T16:36:22.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.814+0000 7fee62ffd640 1 -- 172.21.15.120:0/725750029 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7fee5c058be0 con 0x7fee6c0b4650 2024-03-31T16:36:22.818 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-03-31T16:36:22.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fee4c06c8f0 msgr2=0x7fee4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:22.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fee4c06c8f0 0x7fee4c06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fee54036000 tx=0x7fee54030000 comp rx=0 tx=0).stop 2024-03-31T16:36:22.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4650 msgr2=0x7fee6c15d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:22.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4650 0x7fee6c15d900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00c3f0 tx=0x7fee5c00c8b0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 shutdown_connections 2024-03-31T16:36:22.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fee4c06c8f0 0x7fee4c06edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee6c158580 0x7fee6c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee6c0b4a30 0x7fee6c0d2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 --2- 172.21.15.120:0/725750029 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fee6c0b4650 0x7fee6c15d900 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 >> 172.21.15.120:0/725750029 conn(0x7fee6c067670 msgr2=0x7fee6c0b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:22.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 shutdown_connections 2024-03-31T16:36:22.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.816+0000 7fee70ed6640 1 -- 172.21.15.120:0/725750029 wait complete. 2024-03-31T16:36:22.843 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-31T16:36:22.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.943+0000 7f44906dc640 1 Processor -- start 2024-03-31T16:36:22.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.943+0000 7f44906dc640 1 -- start start 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f44906dc640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f44881590c0 0x7f448815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f44906dc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f448806c580 0x7f448806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f44906dc640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448815fe10 con 0x7f4488162440 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f44906dc640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f448806e5b0 con 0x7f44881590c0 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f44906dc640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4488067900 con 0x7f448806c580 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f448ec79640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f4488162440 0x7f44881628c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38176/0 (socket says 172.21.15.120:38176) 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f448ec79640 1 -- 172.21.15.120:0/95220749 learned_addr learned my addr 172.21.15.120:0/95220749 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f448e478640 1 --2- 172.21.15.120:0/95220749 >> v2:172.21.15.203:3300/0 conn(0x7f44881590c0 0x7f448815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f448dc77640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f448806c580 0x7f448806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.944+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922163508 0 0) 0x7f4480001110 con 0x7f4488162440 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4474003520 con 0x7f4488162440 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2785462930 0 0) 0x7f4474003520 con 0x7f4488162440 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f448806c580 msgr2=0x7f448806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f448806c580 0x7f448806ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 >> v2:172.21.15.203:3300/0 conn(0x7f44881590c0 msgr2=0x7f448815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 --2- 172.21.15.120:0/95220749 >> v2:172.21.15.203:3300/0 conn(0x7f44881590c0 0x7f448815f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44880b47d0 con 0x7f4488162440 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7f4480001840 con 0x7f4488162440 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 >> v1:172.21.15.120:6789/0 conn(0x7f4488162440 legacy=0x7f44881628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f448806c580 0x7f44740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f4474004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4474004d40 0x7f44740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f448806e5b0 con 0x7f4474003f30 2024-03-31T16:36:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4488067900 con 0x7f4474004d40 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f447400b9c0 con 0x7f448806c580 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448dc77640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f4474004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448e478640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f448806c580 0x7f44740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448ec79640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4474004d40 0x7f44740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448dc77640 1 -- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f448806c580 msgr2=0x7f44740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448dc77640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f448806c580 0x7f44740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448dc77640 1 -- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4474004d40 msgr2=0x7f44740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448dc77640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4474004d40 0x7f44740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.945+0000 7f448dc77640 1 -- 172.21.15.120:0/95220749 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4474003520 con 0x7f4474003f30 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.946+0000 7f448dc77640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f4474004800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4478009a90 tx=0x7f4474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6a832ba3ecdf40 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.946+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478039070 con 0x7f4474003f30 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.946+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447802c6b0 con 0x7f4474003f30 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.946+0000 7f448d476640 1 -- 172.21.15.120:0/95220749 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478009690 con 0x7f4474003f30 2024-03-31T16:36:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.947+0000 7f44906dc640 1 -- 172.21.15.120:0/95220749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 msgr2=0x7f4474004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.947+0000 7f44906dc640 1 --2- 172.21.15.120:0/95220749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f4474004800 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4478009a90 tx=0x7f4474005830 comp rx=0 tx=0).stop 2024-03-31T16:36:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.947+0000 7f448ec79640 1 -- 172.21.15.120:0/95220749 reap_dead start 2024-03-31T16:36:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.947+0000 7f44906dc640 1 -- 172.21.15.120:0/95220749 shutdown_connections 2024-03-31T16:36:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.947+0000 7f44906dc640 1 -- 172.21.15.120:0/95220749 >> 172.21.15.120:0/95220749 conn(0x7f4488071e60 msgr2=0x7f4488072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.947+0000 7f44906dc640 1 -- 172.21.15.120:0/95220749 shutdown_connections 2024-03-31T16:36:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.947+0000 7f44906dc640 1 -- 172.21.15.120:0/95220749 wait complete. 2024-03-31T16:36:22.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.948+0000 7f44906dc640 1 Processor -- start 2024-03-31T16:36:22.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.948+0000 7f44906dc640 1 -- start start 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f44906dc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f44881e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f44906dc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4488145360 0x7f44880aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f44906dc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44880af330 0x7f448815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f44906dc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f448806e240 con 0x7f4474003f30 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f44906dc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f448806df60 con 0x7f4488145360 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f44906dc640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f44880b4380 con 0x7f44880af330 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f44881e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f44881e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54754/0 (socket says 172.21.15.120:54754) 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 -- 172.21.15.120:0/4138951524 learned_addr learned my addr 172.21.15.120:0/4138951524 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448ec79640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44880af330 0x7f448815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448dc77640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4488145360 0x7f44880aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 -- 172.21.15.120:0/4138951524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44880af330 msgr2=0x7f448815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:22.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44880af330 0x7f448815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 -- 172.21.15.120:0/4138951524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4488145360 msgr2=0x7f44880aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4488145360 0x7f44880aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 -- 172.21.15.120:0/4138951524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44881e8ea0 con 0x7f4474003f30 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f448e478640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f44881e9f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4484011e60 tx=0x7f448400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f447effd640 1 -- 172.21.15.120:0/4138951524 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484015630 con 0x7f4474003f30 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f447effd640 1 -- 172.21.15.120:0/4138951524 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44840157d0 con 0x7f4474003f30 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44881e9180 con 0x7f4474003f30 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f447effd640 1 -- 172.21.15.120:0/4138951524 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484015ba0 con 0x7f4474003f30 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.949+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44881e9740 con 0x7f4474003f30 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.950+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44880685c0 con 0x7f4474003f30 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.951+0000 7f447effd640 1 -- 172.21.15.120:0/4138951524 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f448401d400 con 0x7f4474003f30 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.951+0000 7f447effd640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f446c06c920 0x7f446c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:22.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.951+0000 7f447effd640 1 -- 172.21.15.120:0/4138951524 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f448408ccf0 con 0x7f4474003f30 2024-03-31T16:36:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.951+0000 7f448dc77640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f446c06c920 0x7f446c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.952+0000 7f448dc77640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f446c06c920 0x7f446c06ede0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4478036000 tx=0x7f4478030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:22.956+0000 7f447effd640 1 -- 172.21.15.120:0/4138951524 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4484091070 con 0x7f4474003f30 2024-03-31T16:36:23.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.166+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4488067590 con 0x7f4474003f30 2024-03-31T16:36:23.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.815+0000 7f447effd640 1 -- 172.21.15.120:0/4138951524 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f4484019030 con 0x7f4474003f30 2024-03-31T16:36:23.819 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 4 and data pool 5 2024-03-31T16:36:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f446c06c920 msgr2=0x7f446c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f446c06c920 0x7f446c06ede0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4478036000 tx=0x7f4478030000 comp rx=0 tx=0).stop 2024-03-31T16:36:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 msgr2=0x7f44881e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:23.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f44881e9f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4484011e60 tx=0x7f448400f580 comp rx=0 tx=0).stop 2024-03-31T16:36:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 shutdown_connections 2024-03-31T16:36:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f446c06c920 0x7f446c06ede0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f44880af330 0x7f448815dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4488145360 0x7f44880aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 --2- 172.21.15.120:0/4138951524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4474003f30 0x7f44881e9f40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.818+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 >> 172.21.15.120:0/4138951524 conn(0x7f4488071e60 msgr2=0x7f44880b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.820+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 shutdown_connections 2024-03-31T16:36:23.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.820+0000 7f44906dc640 1 -- 172.21.15.120:0/4138951524 wait complete. 2024-03-31T16:36:23.847 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:23.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.946+0000 7fbe7938d640 1 Processor -- start 2024-03-31T16:36:23.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.946+0000 7fbe7938d640 1 -- start start 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe7938d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe7415f6e0 0x7fbe740d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe7938d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe740cf6c0 con 0x7fbe740d0e70 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe7938d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe740cf9a0 con 0x7fbe740cf050 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe7938d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe740cfc80 con 0x7fbe7415f6e0 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe72ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbe740d0e70 0x7fbe740d1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:38186/0 (socket says 172.21.15.120:38186) 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe72ffd640 1 -- 172.21.15.120:0/1599937775 learned_addr learned my addr 172.21.15.120:0/1599937775 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe737fe640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe7415f6e0 0x7fbe740d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764828501 0 0) 0x7fbe740cf6c0 con 0x7fbe740d0e70 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe5c003520 con 0x7fbe740d0e70 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.947+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 695170015 0 0) 0x7fbe5c003520 con 0x7fbe740d0e70 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe7415f6e0 msgr2=0x7fbe740d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:23.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe7415f6e0 0x7fbe740d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 >> v1:172.21.15.203:6789/0 conn(0x7fbe740cf050 legacy=0x7fbe740d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe740cff60 con 0x7fbe740d0e70 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7fbe6c001670 con 0x7fbe740d0e70 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 >> v1:172.21.15.120:6789/0 conn(0x7fbe740d0e70 legacy=0x7fbe740d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe7415f6e0 0x7fbe5c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe5c004d40 0x7fbe5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740cfc80 con 0x7fbe5c003f20 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c00ba20 con 0x7fbe5c004d40 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5c00bc20 con 0x7fbe7415f6e0 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe727fc640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe72ffd640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe7415f6e0 0x7fbe5c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe737fe640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe5c004d40 0x7fbe5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe727fc640 1 -- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe7415f6e0 msgr2=0x7fbe5c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:23.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe727fc640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe7415f6e0 0x7fbe5c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe727fc640 1 -- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe5c004d40 msgr2=0x7fbe5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe727fc640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe5c004d40 0x7fbe5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.948+0000 7fbe727fc640 1 -- 172.21.15.120:0/1599937775 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c003520 con 0x7fbe5c003f20 2024-03-31T16:36:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe727fc640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe5c004800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbe68001f60 tx=0x7fbe5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727b5e88390aeaa2 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68001b30 con 0x7fbe5c003f20 2024-03-31T16:36:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6802d660 con 0x7fbe5c003f20 2024-03-31T16:36:23.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe71ffb640 1 -- 172.21.15.120:0/1599937775 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6802da50 con 0x7fbe5c003f20 2024-03-31T16:36:23.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe7938d640 1 -- 172.21.15.120:0/1599937775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 msgr2=0x7fbe5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe7938d640 1 --2- 172.21.15.120:0/1599937775 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe5c004800 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbe68001f60 tx=0x7fbe5c005830 comp rx=0 tx=0).stop 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe737fe640 1 -- 172.21.15.120:0/1599937775 reap_dead start 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe7938d640 1 -- 172.21.15.120:0/1599937775 shutdown_connections 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.949+0000 7fbe7938d640 1 -- 172.21.15.120:0/1599937775 >> 172.21.15.120:0/1599937775 conn(0x7fbe7408bfb0 msgr2=0x7fbe740d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.950+0000 7fbe7938d640 1 -- 172.21.15.120:0/1599937775 shutdown_connections 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.950+0000 7fbe7938d640 1 -- 172.21.15.120:0/1599937775 wait complete. 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.951+0000 7fbe7938d640 1 Processor -- start 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.951+0000 7fbe7938d640 1 -- start start 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.951+0000 7fbe7938d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe74149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.951+0000 7fbe7938d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe74153b10 0x7fbe740c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.951+0000 7fbe7938d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe740c94b0 0x7fbe740c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.951+0000 7fbe7938d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7415e910 con 0x7fbe5c003f20 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.951+0000 7fbe7938d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7415fb70 con 0x7fbe74153b10 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.951+0000 7fbe7938d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7415ea90 con 0x7fbe740c94b0 2024-03-31T16:36:23.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe74149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe74149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54776/0 (socket says 172.21.15.120:54776) 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 -- 172.21.15.120:0/3038316464 learned_addr learned my addr 172.21.15.120:0/3038316464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe737fe640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe740c94b0 0x7fbe740c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe727fc640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe74153b10 0x7fbe740c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 -- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe740c94b0 msgr2=0x7fbe740c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe740c94b0 0x7fbe740c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 -- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe74153b10 msgr2=0x7fbe740c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe74153b10 0x7fbe740c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 -- 172.21.15.120:0/3038316464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe74154080 con 0x7fbe5c003f20 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe737fe640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe740c94b0 0x7fbe740c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe727fc640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe74153b10 0x7fbe740c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe72ffd640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe74149620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0072f0 tx=0x7fbe6c0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe5b7fe640 1 -- 172.21.15.120:0/3038316464 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c001630 con 0x7fbe5c003f20 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe5b7fe640 1 -- 172.21.15.120:0/3038316464 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6c018070 con 0x7fbe5c003f20 2024-03-31T16:36:23.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe74157980 con 0x7fbe5c003f20 2024-03-31T16:36:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe5b7fe640 1 -- 172.21.15.120:0/3038316464 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00fc00 con 0x7fbe5c003f20 2024-03-31T16:36:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.952+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe74157f40 con 0x7fbe5c003f20 2024-03-31T16:36:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.953+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe74068cd0 con 0x7fbe5c003f20 2024-03-31T16:36:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.954+0000 7fbe5b7fe640 1 -- 172.21.15.120:0/3038316464 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe6c01d460 con 0x7fbe5c003f20 2024-03-31T16:36:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.954+0000 7fbe5b7fe640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe6006c920 0x7fbe6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:23.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.954+0000 7fbe727fc640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe6006c920 0x7fbe6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.954+0000 7fbe5b7fe640 1 -- 172.21.15.120:0/3038316464 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbe6c08bb70 con 0x7fbe5c003f20 2024-03-31T16:36:23.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.954+0000 7fbe727fc640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe6006c920 0x7fbe6006ede0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe68036000 tx=0x7fbe68031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:23.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:23.959+0000 7fbe5b7fe640 1 -- 172.21.15.120:0/3038316464 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbe6c059fa0 con 0x7fbe5c003f20 2024-03-31T16:36:24.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.132+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe7408e580 con 0x7fbe5c003f20 2024-03-31T16:36:24.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.133+0000 7fbe5b7fe640 1 -- 172.21.15.120:0/3038316464 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16694 (secure 0 0 0) 0x7fbe6c0598a0 con 0x7fbe5c003f20 2024-03-31T16:36:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:24.138 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":31,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:23.168069+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:36:21.024330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-31T16:36:22.128594+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe6006c920 msgr2=0x7fbe6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe6006c920 0x7fbe6006ede0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe68036000 tx=0x7fbe68031000 comp rx=0 tx=0).stop 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 msgr2=0x7fbe74149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe74149620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0072f0 tx=0x7fbe6c0077b0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 shutdown_connections 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe6006c920 0x7fbe6006ede0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe740c94b0 0x7fbe740c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe74153b10 0x7fbe740c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 --2- 172.21.15.120:0/3038316464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbe5c003f20 0x7fbe74149620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 >> 172.21.15.120:0/3038316464 conn(0x7fbe7408bfb0 msgr2=0x7fbe74159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:24.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 shutdown_connections 2024-03-31T16:36:24.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.135+0000 7fbe7938d640 1 -- 172.21.15.120:0/3038316464 wait complete. 2024-03-31T16:36:24.151 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:24.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.247+0000 7f365b8d6640 1 Processor -- start 2024-03-31T16:36:24.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.247+0000 7f365b8d6640 1 -- start start 2024-03-31T16:36:24.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f365b8d6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654155930 0x7f36540d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f365b8d6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f36540d07c0 0x7f36540aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f365b8d6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36540b40b0 con 0x7f3654155550 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f365b8d6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f36540b4390 con 0x7f36540d07c0 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f365b8d6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36540b4670 con 0x7f3654155930 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f3659e73640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f36540d07c0 0x7f36540aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f3659e73640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f36540d07c0 0x7f36540aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54782/0 (socket says 172.21.15.120:54782) 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f3659e73640 1 -- 172.21.15.120:0/3683843605 learned_addr learned my addr 172.21.15.120:0/3683843605 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f3658e71640 1 --2- 172.21.15.120:0/3683843605 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654155930 0x7f36540d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f3659e73640 1 -- 172.21.15.120:0/3683843605 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654155930 msgr2=0x7f36540d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f3659e73640 1 --2- 172.21.15.120:0/3683843605 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654155930 0x7f36540d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f3659e73640 1 -- 172.21.15.120:0/3683843605 >> v1:172.21.15.203:6789/0 conn(0x7f3654155550 legacy=0x7f365415f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:24.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.248+0000 7f3659e73640 1 -- 172.21.15.120:0/3683843605 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36540b4950 con 0x7f36540d07c0 2024-03-31T16:36:24.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.249+0000 7f3659e73640 1 --2- 172.21.15.120:0/3683843605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36540d07c0 0x7f36540aede0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f364c009e50 tx=0x7f364c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d2a1b3e1a546e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.249+0000 7f364bfff640 1 -- 172.21.15.120:0/3683843605 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c02ca70 con 0x7f36540d07c0 2024-03-31T16:36:24.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.249+0000 7f364bfff640 1 -- 172.21.15.120:0/3683843605 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c02cc10 con 0x7f36540d07c0 2024-03-31T16:36:24.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.249+0000 7f364bfff640 1 -- 172.21.15.120:0/3683843605 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c0343f0 con 0x7f36540d07c0 2024-03-31T16:36:24.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.250+0000 7f365b8d6640 1 -- 172.21.15.120:0/3683843605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36540d07c0 msgr2=0x7f36540aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.255 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.250+0000 7f365b8d6640 1 --2- 172.21.15.120:0/3683843605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36540d07c0 0x7f36540aede0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f364c009e50 tx=0x7f364c02bed0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.250+0000 7f365b8d6640 1 -- 172.21.15.120:0/3683843605 shutdown_connections 2024-03-31T16:36:24.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.250+0000 7f365b8d6640 1 --2- 172.21.15.120:0/3683843605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f36540d07c0 0x7f36540aede0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.250+0000 7f365b8d6640 1 --2- 172.21.15.120:0/3683843605 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3654155930 0x7f36540d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.250+0000 7f365b8d6640 1 -- 172.21.15.120:0/3683843605 >> 172.21.15.120:0/3683843605 conn(0x7f365406b750 msgr2=0x7f365406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:24.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.250+0000 7f365b8d6640 1 -- 172.21.15.120:0/3683843605 shutdown_connections 2024-03-31T16:36:24.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.250+0000 7f365b8d6640 1 -- 172.21.15.120:0/3683843605 wait complete. 2024-03-31T16:36:24.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.251+0000 7f365b8d6640 1 Processor -- start 2024-03-31T16:36:24.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.251+0000 7f365b8d6640 1 -- start start 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f365b8d6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36540d07c0 0x7f3654154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f365b8d6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3654155550 0x7f365415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f365b8d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654155930 0x7f365415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f365b8d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f365415bba0 con 0x7f3654155930 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f365b8d6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f365415ba20 con 0x7f3654155550 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f365b8d6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36540b3cf0 con 0x7f36540d07c0 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654155930 0x7f365415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654155930 0x7f365415a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54792/0 (socket says 172.21.15.120:54792) 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 -- 172.21.15.120:0/4257284464 learned_addr learned my addr 172.21.15.120:0/4257284464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3658e71640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3654155550 0x7f365415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659672640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36540d07c0 0x7f3654154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 -- 172.21.15.120:0/4257284464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36540d07c0 msgr2=0x7f3654154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36540d07c0 0x7f3654154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 -- 172.21.15.120:0/4257284464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3654155550 msgr2=0x7f365415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3654155550 0x7f365415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 -- 172.21.15.120:0/4257284464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365415c9a0 con 0x7f3654155930 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.252+0000 7f3659e73640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654155930 0x7f365415a700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f364c009e50 tx=0x7f364c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.253+0000 7f3649ffb640 1 -- 172.21.15.120:0/4257284464 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c043020 con 0x7f3654155930 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.253+0000 7f3649ffb640 1 -- 172.21.15.120:0/4257284464 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c03e450 con 0x7f3654155930 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.253+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36540b0cf0 con 0x7f3654155930 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.253+0000 7f3649ffb640 1 -- 172.21.15.120:0/4257284464 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c009510 con 0x7f3654155930 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.253+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3654154ac0 con 0x7f3654155930 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.254+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36540685c0 con 0x7f3654155930 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.254+0000 7f3649ffb640 1 -- 172.21.15.120:0/4257284464 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f364c046020 con 0x7f3654155930 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.255+0000 7f3649ffb640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f363806c8f0 0x7f363806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.255+0000 7f3659672640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f363806c8f0 0x7f363806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.255+0000 7f3649ffb640 1 -- 172.21.15.120:0/4257284464 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f364c0ae240 con 0x7f3654155930 2024-03-31T16:36:24.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.255+0000 7f3659672640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f363806c8f0 0x7f363806edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f36540b2930 tx=0x7f3650007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.259+0000 7f3649ffb640 1 -- 172.21.15.120:0/4257284464 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f364c04d030 con 0x7f3654155930 2024-03-31T16:36:24.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.433+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36540b3ad0 con 0x7f3654155930 2024-03-31T16:36:24.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.435+0000 7f3649ffb640 1 -- 172.21.15.120:0/4257284464 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16694 (secure 0 0 0) 0x7f364c07c020 con 0x7f3654155930 2024-03-31T16:36:24.439 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:24.439 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":31,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:23.168069+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:36:21.024330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-31T16:36:22.128594+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:24.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f363806c8f0 msgr2=0x7f363806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f363806c8f0 0x7f363806edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f36540b2930 tx=0x7f3650007e30 comp rx=0 tx=0).stop 2024-03-31T16:36:24.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654155930 msgr2=0x7f365415a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654155930 0x7f365415a700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f364c009e50 tx=0x7f364c004a40 comp rx=0 tx=0).stop 2024-03-31T16:36:24.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 shutdown_connections 2024-03-31T16:36:24.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f363806c8f0 0x7f363806edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3654155930 0x7f365415a700 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3654155550 0x7f365415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 --2- 172.21.15.120:0/4257284464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36540d07c0 0x7f3654154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 >> 172.21.15.120:0/4257284464 conn(0x7f365406b750 msgr2=0x7f36540ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:24.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 shutdown_connections 2024-03-31T16:36:24.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.437+0000 7f365b8d6640 1 -- 172.21.15.120:0/4257284464 wait complete. 2024-03-31T16:36:24.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-31T16:36:24.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.551+0000 7f434a077640 1 Processor -- start 2024-03-31T16:36:24.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.551+0000 7f434a077640 1 -- start start 2024-03-31T16:36:24.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f434a077640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4344155550 0x7f4344155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f434a077640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43440b40b0 con 0x7f434415f800 2024-03-31T16:36:24.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f434a077640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43440b4390 con 0x7f43440d0990 2024-03-31T16:36:24.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f434a077640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f43440b4670 con 0x7f4344155550 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f4342ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f434415f800 0x7f43440d0280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33680/0 (socket says 172.21.15.120:33680) 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f4342ffd640 1 -- 172.21.15.120:0/3024774739 learned_addr learned my addr 172.21.15.120:0/3024774739 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299434699 0 0) 0x7f43440b40b0 con 0x7f434415f800 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f432c005730 con 0x7f434415f800 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.552+0000 7f43437fe640 1 --2- 172.21.15.120:0/3024774739 >> v2:172.21.15.203:3300/0 conn(0x7f4344155550 0x7f4344155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219158751 0 0) 0x7f432c005730 con 0x7f434415f800 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 >> v2:172.21.15.203:3300/0 conn(0x7f4344155550 msgr2=0x7f4344155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 --2- 172.21.15.120:0/3024774739 >> v2:172.21.15.203:3300/0 conn(0x7f4344155550 0x7f4344155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 >> v1:172.21.15.203:6789/0 conn(0x7f43440d0990 legacy=0x7f43440aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43440b4950 con 0x7f434415f800 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7f4338001690 con 0x7f434415f800 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 >> v1:172.21.15.120:6789/0 conn(0x7f434415f800 legacy=0x7f43440d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c005bc0 0x7f432c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f432c006a10 0x7f432c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f432c0074f0 0x7f432c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f43440b4670 con 0x7f432c006a10 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f432c00e3c0 con 0x7f432c0074f0 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f432c00e5c0 con 0x7f432c005bc0 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f4342ffd640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f432c006a10 0x7f432c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f43437fe640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c005bc0 0x7f432c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f4343fff640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f432c0074f0 0x7f432c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f4342ffd640 1 -- 172.21.15.120:0/3024774739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c005bc0 msgr2=0x7f432c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f4342ffd640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c005bc0 0x7f432c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f4342ffd640 1 -- 172.21.15.120:0/3024774739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f432c0074f0 msgr2=0x7f432c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f4342ffd640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f432c0074f0 0x7f432c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f4342ffd640 1 -- 172.21.15.120:0/3024774739 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432c005730 con 0x7f432c006a10 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.553+0000 7f4343fff640 1 -- 172.21.15.120:0/3024774739 reap_dead start 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.554+0000 7f4342ffd640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f432c006a10 0x7f432c006e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f43440ad5a0 tx=0x7f432c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f489d90339fe59b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.554+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338007d10 con 0x7f432c006a10 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.554+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4338030070 con 0x7f432c006a10 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.554+0000 7f43427fc640 1 -- 172.21.15.120:0/3024774739 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338005d10 con 0x7f432c006a10 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.554+0000 7f434a077640 1 -- 172.21.15.120:0/3024774739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f432c006a10 msgr2=0x7f432c006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.554+0000 7f434a077640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f432c006a10 0x7f432c006e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f43440ad5a0 tx=0x7f432c007a40 comp rx=0 tx=0).stop 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.555+0000 7f434a077640 1 -- 172.21.15.120:0/3024774739 shutdown_connections 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.555+0000 7f434a077640 1 --2- 172.21.15.120:0/3024774739 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f432c006a10 0x7f432c006e90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.555+0000 7f434a077640 1 -- 172.21.15.120:0/3024774739 >> 172.21.15.120:0/3024774739 conn(0x7f434406b750 msgr2=0x7f434406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.555+0000 7f434a077640 1 -- 172.21.15.120:0/3024774739 shutdown_connections 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.555+0000 7f434a077640 1 -- 172.21.15.120:0/3024774739 wait complete. 2024-03-31T16:36:24.562 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.556+0000 7f434a077640 1 Processor -- start 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.556+0000 7f434a077640 1 -- start start 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f434a077640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c006a10 0x7f43440add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f434a077640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344153610 0x7f4344152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f434a077640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43441f43d0 0x7f434415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f434a077640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f434415ba20 con 0x7f4344153610 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f434a077640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f434415fc80 con 0x7f43441f43d0 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f434a077640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f434415bba0 con 0x7f432c006a10 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344153610 0x7f4344152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.565 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344153610 0x7f4344152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37602/0 (socket says 172.21.15.120:37602) 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 -- 172.21.15.120:0/2592165773 learned_addr learned my addr 172.21.15.120:0/2592165773 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f43437fe640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c006a10 0x7f43440add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 -- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c006a10 msgr2=0x7f43440add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4343fff640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43441f43d0 0x7f434415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c006a10 0x7f43440add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 -- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43441f43d0 msgr2=0x7f434415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43441f43d0 0x7f434415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 -- 172.21.15.120:0/2592165773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43441f4d60 con 0x7f4344153610 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4343fff640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43441f43d0 0x7f434415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f4342ffd640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344153610 0x7f4344152d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f433800c300 tx=0x7f43440b4b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f432bfff640 1 -- 172.21.15.120:0/2592165773 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338045070 con 0x7f4344153610 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f432bfff640 1 -- 172.21.15.120:0/2592165773 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43380049f0 con 0x7f4344153610 2024-03-31T16:36:24.566 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43441f5040 con 0x7f4344153610 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f432bfff640 1 -- 172.21.15.120:0/2592165773 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338001c50 con 0x7f4344153610 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.557+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43440cd8a0 con 0x7f4344153610 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.558+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43440685c0 con 0x7f4344153610 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.559+0000 7f432bfff640 1 -- 172.21.15.120:0/2592165773 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4338007070 con 0x7f4344153610 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.559+0000 7f432bfff640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f433006c8f0 0x7f433006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.559+0000 7f43437fe640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f433006c8f0 0x7f433006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.559+0000 7f432bfff640 1 -- 172.21.15.120:0/2592165773 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f43380ac8b0 con 0x7f4344153610 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.559+0000 7f43437fe640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f433006c8f0 0x7f433006edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4334006fd0 tx=0x7f4334008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.567 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.563+0000 7f432bfff640 1 -- 172.21.15.120:0/2592165773 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f433807a690 con 0x7f4344153610 2024-03-31T16:36:24.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.774+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f43440b3ad0 con 0x7f4344153610 2024-03-31T16:36:24.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.831+0000 7f432bfff640 1 -- 172.21.15.120:0/2592165773 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f433807e990 con 0x7f4344153610 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.833+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f433006c8f0 msgr2=0x7f433006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.833+0000 7f434a077640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f433006c8f0 0x7f433006edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4334006fd0 tx=0x7f4334008040 comp rx=0 tx=0).stop 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.833+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344153610 msgr2=0x7f4344152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.833+0000 7f434a077640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344153610 0x7f4344152d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f433800c300 tx=0x7f43440b4b20 comp rx=0 tx=0).stop 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.834+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 shutdown_connections 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.834+0000 7f434a077640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f433006c8f0 0x7f433006edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.834+0000 7f434a077640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43441f43d0 0x7f434415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.834+0000 7f434a077640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4344153610 0x7f4344152d80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.834+0000 7f434a077640 1 --2- 172.21.15.120:0/2592165773 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f432c006a10 0x7f43440add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.834+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 >> 172.21.15.120:0/2592165773 conn(0x7f434406b750 msgr2=0x7f434406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:24.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.834+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 shutdown_connections 2024-03-31T16:36:24.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.834+0000 7f434a077640 1 -- 172.21.15.120:0/2592165773 wait complete. 2024-03-31T16:36:24.848 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-31T16:36:24.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-31T16:36:24.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.949+0000 7fc16dec8640 1 Processor -- start 2024-03-31T16:36:24.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.949+0000 7fc16dec8640 1 -- start start 2024-03-31T16:36:24.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc16dec8640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc16815e860 0x7fc16806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc16dec8640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16806dfa0 con 0x7fc16806da30 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc16dec8640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16806e240 con 0x7fc1680d4ae0 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc16dec8640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc1680cf220 con 0x7fc16815e860 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc15effd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc16806da30 0x7fc1680d43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33690/0 (socket says 172.21.15.120:33690) 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc15effd640 1 -- 172.21.15.120:0/1855701916 learned_addr learned my addr 172.21.15.120:0/1855701916 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2727674709 0 0) 0x7fc16806dfa0 con 0x7fc16806da30 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc154003520 con 0x7fc16806da30 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc1677fe640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc16815e860 0x7fc16806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1988081946 0 0) 0x7fc154003520 con 0x7fc16806da30 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc16815e860 msgr2=0x7fc16806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.950+0000 7fc166ffd640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc16815e860 0x7fc16806d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 >> v1:172.21.15.203:6789/0 conn(0x7fc1680d4ae0 legacy=0x7fc1680cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16806e520 con 0x7fc16806da30 2024-03-31T16:36:24.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7fc150001690 con 0x7fc16806da30 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 >> v1:172.21.15.120:6789/0 conn(0x7fc16806da30 legacy=0x7fc1680d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc16815e860 0x7fc1540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc154003f60 0x7fc154004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc154004d40 0x7fc1540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc1680cf220 con 0x7fc154004d40 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc15400baa0 con 0x7fc154003f60 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc15400bca0 con 0x7fc16815e860 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc167fff640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc154004d40 0x7fc1540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc1677fe640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc16815e860 0x7fc1540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc15effd640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc154003f60 0x7fc154004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc167fff640 1 -- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc16815e860 msgr2=0x7fc1540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc167fff640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc16815e860 0x7fc1540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc167fff640 1 -- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc154003f60 msgr2=0x7fc154004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc167fff640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc154003f60 0x7fc154004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.951+0000 7fc167fff640 1 -- 172.21.15.120:0/1855701916 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc154003520 con 0x7fc154004d40 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc167fff640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc154004d40 0x7fc1540051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc160001720 tx=0x7fc154005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573b409f8933acae server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160001370 con 0x7fc154004d40 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1600052d0 con 0x7fc154004d40 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc166ffd640 1 -- 172.21.15.120:0/1855701916 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160003830 con 0x7fc154004d40 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc16dec8640 1 -- 172.21.15.120:0/1855701916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc154004d40 msgr2=0x7fc1540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc16dec8640 1 --2- 172.21.15.120:0/1855701916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc154004d40 0x7fc1540051c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc160001720 tx=0x7fc154005830 comp rx=0 tx=0).stop 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc167fff640 1 -- 172.21.15.120:0/1855701916 reap_dead start 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc16dec8640 1 -- 172.21.15.120:0/1855701916 shutdown_connections 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.952+0000 7fc16dec8640 1 -- 172.21.15.120:0/1855701916 >> 172.21.15.120:0/1855701916 conn(0x7fc16809d7d0 msgr2=0x7fc16808bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:24.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.953+0000 7fc16dec8640 1 -- 172.21.15.120:0/1855701916 shutdown_connections 2024-03-31T16:36:24.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.953+0000 7fc16dec8640 1 -- 172.21.15.120:0/1855701916 wait complete. 2024-03-31T16:36:24.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.954+0000 7fc16dec8640 1 Processor -- start 2024-03-31T16:36:24.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.954+0000 7fc16dec8640 1 -- start start 2024-03-31T16:36:24.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc16dec8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc16815eea0 0x7fc1680c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc16dec8640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc1680ce010 0x7fc1680cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc16dec8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16815f280 0x7fc16815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc16dec8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc1680cef30 con 0x7fc16815f280 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc16dec8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc1680cedb0 con 0x7fc16815eea0 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc16dec8640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc16806d4f0 con 0x7fc1680ce010 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16815f280 0x7fc16815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16815f280 0x7fc16815f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37618/0 (socket says 172.21.15.120:37618) 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 -- 172.21.15.120:0/3542247633 learned_addr learned my addr 172.21.15.120:0/3542247633 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc1677fe640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc16815eea0 0x7fc1680c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc15effd640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc1680ce010 0x7fc1680cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 -- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc1680ce010 msgr2=0x7fc1680cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc1680ce010 0x7fc1680cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 -- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc16815eea0 msgr2=0x7fc1680c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc16815eea0 0x7fc1680c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 -- 172.21.15.120:0/3542247633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1680c9c60 con 0x7fc16815f280 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc1677fe640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc16815eea0 0x7fc1680c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc15effd640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc1680ce010 0x7fc1680cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc167fff640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16815f280 0x7fc16815f700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc160005040 tx=0x7fc160001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc164ff9640 1 -- 172.21.15.120:0/3542247633 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160001370 con 0x7fc16815f280 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc164ff9640 1 -- 172.21.15.120:0/3542247633 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc160042070 con 0x7fc16815f280 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc164ff9640 1 -- 172.21.15.120:0/3542247633 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160007a30 con 0x7fc16815f280 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1680c9f40 con 0x7fc16815f280 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.955+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1680ca500 con 0x7fc16815f280 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.957+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1680685c0 con 0x7fc16815f280 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.957+0000 7fc164ff9640 1 -- 172.21.15.120:0/3542247633 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc16003b040 con 0x7fc16815f280 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.957+0000 7fc164ff9640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc14806c920 0x7fc14806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.957+0000 7fc164ff9640 1 -- 172.21.15.120:0/3542247633 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc1600acef0 con 0x7fc16815f280 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.957+0000 7fc1677fe640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc14806c920 0x7fc14806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:24.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.958+0000 7fc1677fe640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc14806c920 0x7fc14806ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc158007440 tx=0x7fc15800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:24.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:24.961+0000 7fc164ff9640 1 -- 172.21.15.120:0/3542247633 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc16007b290 con 0x7fc16815f280 2024-03-31T16:36:25.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.176+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc1680ba2a0 con 0x7fc16815f280 2024-03-31T16:36:25.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.835+0000 7fc164ff9640 1 -- 172.21.15.120:0/3542247633 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fc16007ab90 con 0x7fc16815f280 2024-03-31T16:36:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc14806c920 msgr2=0x7fc14806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc14806c920 0x7fc14806ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc158007440 tx=0x7fc15800b040 comp rx=0 tx=0).stop 2024-03-31T16:36:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16815f280 msgr2=0x7fc16815f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16815f280 0x7fc16815f700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc160005040 tx=0x7fc160001120 comp rx=0 tx=0).stop 2024-03-31T16:36:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 shutdown_connections 2024-03-31T16:36:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc14806c920 0x7fc14806ede0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc16815f280 0x7fc16815f700 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc1680ce010 0x7fc1680cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 --2- 172.21.15.120:0/3542247633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc16815eea0 0x7fc1680c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 >> 172.21.15.120:0/3542247633 conn(0x7fc16809d7d0 msgr2=0x7fc1680b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 shutdown_connections 2024-03-31T16:36:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.838+0000 7fc16dec8640 1 -- 172.21.15.120:0/3542247633 wait complete. 2024-03-31T16:36:25.853 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-31T16:36:25.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:36:25.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.950+0000 7f486cfa8640 1 Processor -- start 2024-03-31T16:36:25.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.950+0000 7f486cfa8640 1 -- start start 2024-03-31T16:36:25.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f486cfa8640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f486815da60 0x7f48680cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:25.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f486cfa8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f486815fe90 0x7f48680d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:25.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f486cfa8640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486815d060 con 0x7f486815f900 2024-03-31T16:36:25.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f486cfa8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f486815d340 con 0x7f486815fe90 2024-03-31T16:36:25.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f486cfa8640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f486815d620 con 0x7f486815da60 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f4866d9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f486815fe90 0x7f48680d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f4866d9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f486815fe90 0x7f48680d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37626/0 (socket says 172.21.15.120:37626) 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f4866d9d640 1 -- 172.21.15.120:0/2182139761 learned_addr learned my addr 172.21.15.120:0/2182139761 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f4866d9d640 1 -- 172.21.15.120:0/2182139761 >> v2:172.21.15.203:3300/0 conn(0x7f486815da60 msgr2=0x7f48680cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f4866d9d640 1 --2- 172.21.15.120:0/2182139761 >> v2:172.21.15.203:3300/0 conn(0x7f486815da60 0x7f48680cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f4866d9d640 1 -- 172.21.15.120:0/2182139761 >> v1:172.21.15.203:6789/0 conn(0x7f486815f900 legacy=0x7f486815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.951+0000 7f4866d9d640 1 -- 172.21.15.120:0/2182139761 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48680c74b0 con 0x7f486815fe90 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.952+0000 7f4866d9d640 1 --2- 172.21.15.120:0/2182139761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815fe90 0x7f48680d0370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f486806f390 tx=0x7f486002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f28044ffbc79754 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.952+0000 7f4865d9b640 1 -- 172.21.15.120:0/2182139761 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486002ca80 con 0x7f486815fe90 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.952+0000 7f4865d9b640 1 -- 172.21.15.120:0/2182139761 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486002cc20 con 0x7f486815fe90 2024-03-31T16:36:25.957 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.952+0000 7f4865d9b640 1 -- 172.21.15.120:0/2182139761 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48600343f0 con 0x7f486815fe90 2024-03-31T16:36:25.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.953+0000 7f486cfa8640 1 -- 172.21.15.120:0/2182139761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815fe90 msgr2=0x7f48680d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:25.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.953+0000 7f486cfa8640 1 --2- 172.21.15.120:0/2182139761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815fe90 0x7f48680d0370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f486806f390 tx=0x7f486002bee0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.953+0000 7f486cfa8640 1 -- 172.21.15.120:0/2182139761 shutdown_connections 2024-03-31T16:36:25.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.953+0000 7f486cfa8640 1 --2- 172.21.15.120:0/2182139761 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815fe90 0x7f48680d0370 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.953+0000 7f486cfa8640 1 --2- 172.21.15.120:0/2182139761 >> v2:172.21.15.203:3300/0 conn(0x7f486815da60 0x7f48680cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.953+0000 7f486cfa8640 1 -- 172.21.15.120:0/2182139761 >> 172.21.15.120:0/2182139761 conn(0x7f48680b3e90 msgr2=0x7f48680b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:25.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.953+0000 7f486cfa8640 1 -- 172.21.15.120:0/2182139761 shutdown_connections 2024-03-31T16:36:25.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.953+0000 7f486cfa8640 1 -- 172.21.15.120:0/2182139761 wait complete. 2024-03-31T16:36:25.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.954+0000 7f486cfa8640 1 Processor -- start 2024-03-31T16:36:25.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.954+0000 7f486cfa8640 1 -- start start 2024-03-31T16:36:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486cfa8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815da60 0x7f4868152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486cfa8640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f486815f900 0x7f486806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486cfa8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f486815fe90 0x7f48680b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486cfa8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f48680cece0 con 0x7f486815da60 2024-03-31T16:36:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486cfa8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f48680ceb60 con 0x7f486815fe90 2024-03-31T16:36:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486cfa8640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f48680cee60 con 0x7f486815f900 2024-03-31T16:36:25.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815da60 0x7f4868152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815da60 0x7f4868152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37634/0 (socket says 172.21.15.120:37634) 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486659c640 1 -- 172.21.15.120:0/3974816085 learned_addr learned my addr 172.21.15.120:0/3974816085 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f4866d9d640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f486815fe90 0x7f48680b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f485ffff640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f486815f900 0x7f486806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486659c640 1 -- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f486815f900 msgr2=0x7f486806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486659c640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f486815f900 0x7f486806dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486659c640 1 -- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f486815fe90 msgr2=0x7f48680b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486659c640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f486815fe90 0x7f48680b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f486659c640 1 -- 172.21.15.120:0/3974816085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4868156d10 con 0x7f486815da60 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.955+0000 7f485ffff640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f486815f900 0x7f486806dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.956+0000 7f486659c640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815da60 0x7f4868152f90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f485800c410 tx=0x7f485800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.956+0000 7f485effd640 1 -- 172.21.15.120:0/3974816085 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858017070 con 0x7f486815da60 2024-03-31T16:36:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.956+0000 7f485effd640 1 -- 172.21.15.120:0/3974816085 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48580035f0 con 0x7f486815da60 2024-03-31T16:36:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.956+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4868156ff0 con 0x7f486815da60 2024-03-31T16:36:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.956+0000 7f485effd640 1 -- 172.21.15.120:0/3974816085 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858003a20 con 0x7f486815da60 2024-03-31T16:36:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.956+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48681575b0 con 0x7f486815da60 2024-03-31T16:36:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.957+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4868068cd0 con 0x7f486815da60 2024-03-31T16:36:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.957+0000 7f485effd640 1 -- 172.21.15.120:0/3974816085 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f485801a070 con 0x7f486815da60 2024-03-31T16:36:25.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.958+0000 7f485effd640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f484806c8f0 0x7f484806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:25.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.958+0000 7f485effd640 1 -- 172.21.15.120:0/3974816085 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f485808aec0 con 0x7f486815da60 2024-03-31T16:36:25.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.958+0000 7f485ffff640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f484806c8f0 0x7f484806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:25.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.958+0000 7f485ffff640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f484806c8f0 0x7f484806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48681585b0 tx=0x7f4850008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:25.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:25.962+0000 7f485effd640 1 -- 172.21.15.120:0/3974816085 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4858058d30 con 0x7f486815da60 2024-03-31T16:36:26.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.173+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f486815cb30 con 0x7f486815da60 2024-03-31T16:36:26.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.174+0000 7f485effd640 1 -- 172.21.15.120:0/3974816085 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f485805d030 con 0x7f486815da60 2024-03-31T16:36:26.178 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:26.178 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/4016494046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4016494046},{"type":"v1","addr":"172.21.15.203:6834","nonce":4016494046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1319253278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":1319253278},{"type":"v1","addr":"172.21.15.203:6835","nonce":1319253278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1766153586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1766153586},{"type":"v1","addr":"172.21.15.120:6836","nonce":1766153586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:36:23.168388+0000","modified":"2024-03-31T16:36:25.178205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/2154626843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2154626843},{"type":"v1","addr":"172.21.15.120:6837","nonce":2154626843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-03-31T16:36:26.179 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 14 2024-03-31T16:36:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f484806c8f0 msgr2=0x7f484806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f484806c8f0 0x7f484806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48681585b0 tx=0x7f4850008040 comp rx=0 tx=0).stop 2024-03-31T16:36:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815da60 msgr2=0x7f4868152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815da60 0x7f4868152f90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f485800c410 tx=0x7f485800c8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 shutdown_connections 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f484806c8f0 0x7f484806edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f486815fe90 0x7f48680b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f486815f900 0x7f486806dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 --2- 172.21.15.120:0/3974816085 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f486815da60 0x7f4868152f90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 >> 172.21.15.120:0/3974816085 conn(0x7f48680b3e90 msgr2=0x7f48680cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 shutdown_connections 2024-03-31T16:36:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.176+0000 7f486cfa8640 1 -- 172.21.15.120:0/3974816085 wait complete. 2024-03-31T16:36:26.191 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-31T16:36:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.287+0000 7fa61dd11640 1 Processor -- start 2024-03-31T16:36:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.287+0000 7fa61dd11640 1 -- start start 2024-03-31T16:36:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.287+0000 7fa61dd11640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa61815e7b0 0x7fa6180b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.287+0000 7fa61dd11640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180d1d70 0x7fa6180c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.287+0000 7fa61dd11640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6180d01a0 con 0x7fa6180c7640 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.287+0000 7fa61dd11640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fa6180d1240 con 0x7fa61815e7b0 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.287+0000 7fa61dd11640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa6180d0480 con 0x7fa6180d1d70 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa6177fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa61815e7b0 0x7fa6180b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa617fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa6180c7640 0x7fa618071000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33704/0 (socket says 172.21.15.120:33704) 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa617fff640 1 -- 172.21.15.120:0/1928224828 learned_addr learned my addr 172.21.15.120:0/1928224828 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa616ffd640 1 --2- 172.21.15.120:0/1928224828 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180d1d70 0x7fa6180c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa6177fe640 1 -- 172.21.15.120:0/1928224828 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180d1d70 msgr2=0x7fa6180c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa6177fe640 1 --2- 172.21.15.120:0/1928224828 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180d1d70 0x7fa6180c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa6177fe640 1 -- 172.21.15.120:0/1928224828 >> v1:172.21.15.120:6789/0 conn(0x7fa6180c7640 legacy=0x7fa618071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa6167fc640 1 -- 172.21.15.120:0/1928224828 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132038646 0 0) 0x7fa6180d01a0 con 0x7fa6180c7640 2024-03-31T16:36:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.288+0000 7fa6177fe640 1 -- 172.21.15.120:0/1928224828 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6180d0760 con 0x7fa61815e7b0 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa6177fe640 1 --2- 172.21.15.120:0/1928224828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa6180b4980 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa6080097a0 tx=0x7fa60802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42160de7e37ec5cd server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa6167fc640 1 -- 172.21.15.120:0/1928224828 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608035020 con 0x7fa61815e7b0 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa6167fc640 1 -- 172.21.15.120:0/1928224828 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa608031830 con 0x7fa61815e7b0 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa6167fc640 1 -- 172.21.15.120:0/1928224828 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608031c00 con 0x7fa61815e7b0 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa61dd11640 1 -- 172.21.15.120:0/1928224828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 msgr2=0x7fa6180b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa61dd11640 1 --2- 172.21.15.120:0/1928224828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa6180b4980 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa6080097a0 tx=0x7fa60802b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa61dd11640 1 -- 172.21.15.120:0/1928224828 shutdown_connections 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa61dd11640 1 --2- 172.21.15.120:0/1928224828 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180d1d70 0x7fa6180c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa61dd11640 1 --2- 172.21.15.120:0/1928224828 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa6180b4980 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa61dd11640 1 -- 172.21.15.120:0/1928224828 >> 172.21.15.120:0/1928224828 conn(0x7fa6180b3e90 msgr2=0x7fa6180b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa61dd11640 1 -- 172.21.15.120:0/1928224828 shutdown_connections 2024-03-31T16:36:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.289+0000 7fa61dd11640 1 -- 172.21.15.120:0/1928224828 wait complete. 2024-03-31T16:36:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.291+0000 7fa61dd11640 1 Processor -- start 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.291+0000 7fa61dd11640 1 -- start start 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.291+0000 7fa61dd11640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180c7640 0x7fa618144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.291+0000 7fa61dd11640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6180d1d70 0x7fa6180cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.291+0000 7fa61dd11640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa618154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.291+0000 7fa61dd11640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa6180cfe30 con 0x7fa61815e7b0 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.291+0000 7fa61dd11640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6180d0d20 con 0x7fa6180d1d70 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.291+0000 7fa61dd11640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa61806da40 con 0x7fa6180c7640 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa618154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa618154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37656/0 (socket says 172.21.15.120:37656) 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 -- 172.21.15.120:0/2391747001 learned_addr learned my addr 172.21.15.120:0/2391747001 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa616ffd640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6180d1d70 0x7fa6180cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa6177fe640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180c7640 0x7fa618144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 -- 172.21.15.120:0/2391747001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180c7640 msgr2=0x7fa618144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180c7640 0x7fa618144f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 -- 172.21.15.120:0/2391747001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6180d1d70 msgr2=0x7fa6180cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6180d1d70 0x7fa6180cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 -- 172.21.15.120:0/2391747001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6180cb2d0 con 0x7fa61815e7b0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa617fff640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa618154790 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c700 tx=0x7fa61000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa5fffff640 1 -- 172.21.15.120:0/2391747001 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610018070 con 0x7fa61815e7b0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa5fffff640 1 -- 172.21.15.120:0/2391747001 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61000ce10 con 0x7fa61815e7b0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6180cb570 con 0x7fa61815e7b0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa5fffff640 1 -- 172.21.15.120:0/2391747001 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61000a880 con 0x7fa61815e7b0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.292+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6180cbb30 con 0x7fa61815e7b0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.293+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6180cc950 con 0x7fa61815e7b0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.294+0000 7fa5fffff640 1 -- 172.21.15.120:0/2391747001 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa61001b070 con 0x7fa61815e7b0 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.294+0000 7fa5fffff640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa60406c8f0 0x7fa60406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.294+0000 7fa5fffff640 1 -- 172.21.15.120:0/2391747001 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa61008aff0 con 0x7fa61815e7b0 2024-03-31T16:36:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.294+0000 7fa6177fe640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa60406c8f0 0x7fa60406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.295+0000 7fa6177fe640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa60406c8f0 0x7fa60406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa608036000 tx=0x7fa60803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.299+0000 7fa5fffff640 1 -- 172.21.15.120:0/2391747001 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa6180cc950 con 0x7fa61815e7b0 2024-03-31T16:36:26.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.482+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa618159770 con 0x7fa61815e7b0 2024-03-31T16:36:26.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.483+0000 7fa5fffff640 1 -- 172.21.15.120:0/2391747001 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7fa6100594b0 con 0x7fa61815e7b0 2024-03-31T16:36:26.488 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:26.488 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:24.828471+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:36:21.024330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-31T16:36:22.128594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa60406c8f0 msgr2=0x7fa60406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa60406c8f0 0x7fa60406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa608036000 tx=0x7fa60803c040 comp rx=0 tx=0).stop 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 msgr2=0x7fa618154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa618154790 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c700 tx=0x7fa61000cbc0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 shutdown_connections 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa60406c8f0 0x7fa60406edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa61815e7b0 0x7fa618154790 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6180d1d70 0x7fa6180cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 --2- 172.21.15.120:0/2391747001 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6180c7640 0x7fa618144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.485+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 >> 172.21.15.120:0/2391747001 conn(0x7fa6180b3e90 msgr2=0x7fa6180cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:26.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.486+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 shutdown_connections 2024-03-31T16:36:26.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.486+0000 7fa61dd11640 1 -- 172.21.15.120:0/2391747001 wait complete. 2024-03-31T16:36:26.501 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-31T16:36:26.501 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:36:26.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.597+0000 7f181d9cd640 1 Processor -- start 2024-03-31T16:36:26.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.598+0000 7f181d9cd640 1 -- start start 2024-03-31T16:36:26.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.598+0000 7f181d9cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b260 0x7f18180b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.598+0000 7f181d9cd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18180b06b0 0x7f18180aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.598+0000 7f181d9cd640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181815ff50 con 0x7f181815b640 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.598+0000 7f181d9cd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f181815f340 con 0x7f18180b06b0 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.598+0000 7f181d9cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f181815f620 con 0x7f181815b260 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.598+0000 7f18177fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18180b06b0 0x7f18180aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.599+0000 7f18177fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18180b06b0 0x7f18180aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37668/0 (socket says 172.21.15.120:37668) 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.599+0000 7f18177fe640 1 -- 172.21.15.120:0/1623460917 learned_addr learned my addr 172.21.15.120:0/1623460917 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.599+0000 7f1816ffd640 1 --2- 172.21.15.120:0/1623460917 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b260 0x7f18180b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.599+0000 7f18177fe640 1 -- 172.21.15.120:0/1623460917 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b260 msgr2=0x7f18180b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.599+0000 7f18177fe640 1 --2- 172.21.15.120:0/1623460917 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b260 0x7f18180b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.599+0000 7f18177fe640 1 -- 172.21.15.120:0/1623460917 >> v1:172.21.15.203:6789/0 conn(0x7f181815b640 legacy=0x7f18180affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.599+0000 7f18177fe640 1 -- 172.21.15.120:0/1623460917 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181815f900 con 0x7f18180b06b0 2024-03-31T16:36:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.599+0000 7f18177fe640 1 --2- 172.21.15.120:0/1623460917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18180b06b0 0x7f18180aeb60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1810009e50 tx=0x7f181002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e659fad3a1607a0e server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f18167fc640 1 -- 172.21.15.120:0/1623460917 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181002ca70 con 0x7f18180b06b0 2024-03-31T16:36:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f18167fc640 1 -- 172.21.15.120:0/1623460917 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181002cc10 con 0x7f18180b06b0 2024-03-31T16:36:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f18167fc640 1 -- 172.21.15.120:0/1623460917 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18100343f0 con 0x7f18180b06b0 2024-03-31T16:36:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f181d9cd640 1 -- 172.21.15.120:0/1623460917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18180b06b0 msgr2=0x7f18180aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f181d9cd640 1 --2- 172.21.15.120:0/1623460917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18180b06b0 0x7f18180aeb60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1810009e50 tx=0x7f181002bed0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f181d9cd640 1 -- 172.21.15.120:0/1623460917 shutdown_connections 2024-03-31T16:36:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f181d9cd640 1 --2- 172.21.15.120:0/1623460917 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18180b06b0 0x7f18180aeb60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f181d9cd640 1 --2- 172.21.15.120:0/1623460917 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b260 0x7f18180b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f181d9cd640 1 -- 172.21.15.120:0/1623460917 >> 172.21.15.120:0/1623460917 conn(0x7f18180b65a0 msgr2=0x7f18180b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f181d9cd640 1 -- 172.21.15.120:0/1623460917 shutdown_connections 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.600+0000 7f181d9cd640 1 -- 172.21.15.120:0/1623460917 wait complete. 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.601+0000 7f181d9cd640 1 Processor -- start 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f181d9cd640 1 -- start start 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f181d9cd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18180b06b0 0x7f181815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f181d9cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181815b260 0x7f18181f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f181d9cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b640 0x7f18181ee280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f181d9cd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f181806e770 con 0x7f181815b260 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f181d9cd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f181815f010 con 0x7f18180b06b0 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f181d9cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f18180b45f0 con 0x7f181815b640 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f180ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181815b260 0x7f18181f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f180ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181815b260 0x7f18181f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37678/0 (socket says 172.21.15.120:37678) 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.602+0000 7f180ffff640 1 -- 172.21.15.120:0/3709127673 learned_addr learned my addr 172.21.15.120:0/3709127673 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f1816ffd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18180b06b0 0x7f181815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f18177fe640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b640 0x7f18181ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f180ffff640 1 -- 172.21.15.120:0/3709127673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b640 msgr2=0x7f18181ee280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f180ffff640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b640 0x7f18181ee280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f180ffff640 1 -- 172.21.15.120:0/3709127673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18180b06b0 msgr2=0x7f181815ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f180ffff640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18180b06b0 0x7f181815ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f180ffff640 1 -- 172.21.15.120:0/3709127673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18181f86f0 con 0x7f181815b260 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f180ffff640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181815b260 0x7f18181f7cc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f180000b3c0 tx=0x7f180000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f1814ff9640 1 -- 172.21.15.120:0/3709127673 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800011830 con 0x7f181815b260 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f1814ff9640 1 -- 172.21.15.120:0/3709127673 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1800016070 con 0x7f181815b260 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f1814ff9640 1 -- 172.21.15.120:0/3709127673 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800011c50 con 0x7f181815b260 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18181f89d0 con 0x7f181815b260 2024-03-31T16:36:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.603+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18180cc080 con 0x7f181815b260 2024-03-31T16:36:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.604+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1818068cd0 con 0x7f181815b260 2024-03-31T16:36:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.604+0000 7f1814ff9640 1 -- 172.21.15.120:0/3709127673 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f180001b460 con 0x7f181815b260 2024-03-31T16:36:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.605+0000 7f1814ff9640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f17f806c8f0 0x7f17f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.605+0000 7f1816ffd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f17f806c8f0 0x7f17f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.605+0000 7f1814ff9640 1 -- 172.21.15.120:0/3709127673 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f180008b6f0 con 0x7f181815b260 2024-03-31T16:36:26.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.605+0000 7f1816ffd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f17f806c8f0 0x7f17f806edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1808006fd0 tx=0x7f1808008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.609+0000 7f1814ff9640 1 -- 172.21.15.120:0/3709127673 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1800020020 con 0x7f181815b260 2024-03-31T16:36:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.786+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1818159c40 con 0x7f17f806c8f0 2024-03-31T16:36:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.798+0000 7f1814ff9640 1 -- 172.21.15.120:0/3709127673 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251879 (secure 0 0 0) 0x7f1818159c40 con 0x7f17f806c8f0 2024-03-31T16:36:26.805 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.800+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f17f806c8f0 msgr2=0x7f17f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.800+0000 7f181d9cd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f17f806c8f0 0x7f17f806edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1808006fd0 tx=0x7f1808008040 comp rx=0 tx=0).stop 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.800+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181815b260 msgr2=0x7f18181f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181815b260 0x7f18181f7cc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f180000b3c0 tx=0x7f180000b880 comp rx=0 tx=0).stop 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 shutdown_connections 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f17f806c8f0 0x7f17f806edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f181815b640 0x7f18181ee280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f181815b260 0x7f18181f7cc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 --2- 172.21.15.120:0/3709127673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18180b06b0 0x7f181815ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 >> 172.21.15.120:0/3709127673 conn(0x7f18180b65a0 msgr2=0x7f1818157320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 shutdown_connections 2024-03-31T16:36:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.801+0000 7f181d9cd640 1 -- 172.21.15.120:0/3709127673 wait complete. 2024-03-31T16:36:26.815 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-03-31T16:36:25.867743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219968,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754752,"statfs":{"total":773094113280,"available":772868866048,"internally_reserved":0,"allocated":3874816,"data_stored":2200928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.058442"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843693+0000","last_change":"2024-03-31T16:36:23.841757+0000","last_active":"2024-03-31T16:36:23.843693+0000","last_peered":"2024-03-31T16:36:23.843693+0000","last_clean":"2024-03-31T16:36:23.843693+0000","last_became_active":"2024-03-31T16:36:23.841491+0000","last_became_peered":"2024-03-31T16:36:23.841491+0000","last_unstale":"2024-03-31T16:36:23.843693+0000","last_undegraded":"2024-03-31T16:36:23.843693+0000","last_fullsized":"2024-03-31T16:36:23.843693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:35.523636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.835563+0000","last_change":"2024-03-31T16:36:23.831671+0000","last_active":"2024-03-31T16:36:23.835563+0000","last_peered":"2024-03-31T16:36:23.835563+0000","last_clean":"2024-03-31T16:36:23.835563+0000","last_became_active":"2024-03-31T16:36:23.831377+0000","last_became_peered":"2024-03-31T16:36:23.831377+0000","last_unstale":"2024-03-31T16:36:23.835563+0000","last_undegraded":"2024-03-31T16:36:23.835563+0000","last_fullsized":"2024-03-31T16:36:23.835563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:09:02.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851458+0000","last_change":"2024-03-31T16:36:23.846672+0000","last_active":"2024-03-31T16:36:23.851458+0000","last_peered":"2024-03-31T16:36:23.851458+0000","last_clean":"2024-03-31T16:36:23.851458+0000","last_became_active":"2024-03-31T16:36:23.846378+0000","last_became_peered":"2024-03-31T16:36:23.846378+0000","last_unstale":"2024-03-31T16:36:23.851458+0000","last_undegraded":"2024-03-31T16:36:23.851458+0000","last_fullsized":"2024-03-31T16:36:23.851458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:51.820689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844821+0000","last_change":"2024-03-31T16:36:23.841463+0000","last_active":"2024-03-31T16:36:23.844821+0000","last_peered":"2024-03-31T16:36:23.844821+0000","last_clean":"2024-03-31T16:36:23.844821+0000","last_became_active":"2024-03-31T16:36:23.841141+0000","last_became_peered":"2024-03-31T16:36:23.841141+0000","last_unstale":"2024-03-31T16:36:23.844821+0000","last_undegraded":"2024-03-31T16:36:23.844821+0000","last_fullsized":"2024-03-31T16:36:23.844821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:29.030713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843492+0000","last_change":"2024-03-31T16:36:23.835288+0000","last_active":"2024-03-31T16:36:23.843492+0000","last_peered":"2024-03-31T16:36:23.843492+0000","last_clean":"2024-03-31T16:36:23.843492+0000","last_became_active":"2024-03-31T16:36:23.835028+0000","last_became_peered":"2024-03-31T16:36:23.835028+0000","last_unstale":"2024-03-31T16:36:23.843492+0000","last_undegraded":"2024-03-31T16:36:23.843492+0000","last_fullsized":"2024-03-31T16:36:23.843492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:15:52.541264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.835462+0000","last_change":"2024-03-31T16:36:23.831288+0000","last_active":"2024-03-31T16:36:23.835462+0000","last_peered":"2024-03-31T16:36:23.835462+0000","last_clean":"2024-03-31T16:36:23.835462+0000","last_became_active":"2024-03-31T16:36:23.830987+0000","last_became_peered":"2024-03-31T16:36:23.830987+0000","last_unstale":"2024-03-31T16:36:23.835462+0000","last_undegraded":"2024-03-31T16:36:23.835462+0000","last_fullsized":"2024-03-31T16:36:23.835462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:40:51.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843916+0000","last_change":"2024-03-31T16:36:23.839092+0000","last_active":"2024-03-31T16:36:23.843916+0000","last_peered":"2024-03-31T16:36:23.843916+0000","last_clean":"2024-03-31T16:36:23.843916+0000","last_became_active":"2024-03-31T16:36:23.838832+0000","last_became_peered":"2024-03-31T16:36:23.838832+0000","last_unstale":"2024-03-31T16:36:23.843916+0000","last_undegraded":"2024-03-31T16:36:23.843916+0000","last_fullsized":"2024-03-31T16:36:23.843916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:51.725570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842729+0000","last_change":"2024-03-31T16:36:23.836840+0000","last_active":"2024-03-31T16:36:23.842729+0000","last_peered":"2024-03-31T16:36:23.842729+0000","last_clean":"2024-03-31T16:36:23.842729+0000","last_became_active":"2024-03-31T16:36:23.835954+0000","last_became_peered":"2024-03-31T16:36:23.835954+0000","last_unstale":"2024-03-31T16:36:23.842729+0000","last_undegraded":"2024-03-31T16:36:23.842729+0000","last_fullsized":"2024-03-31T16:36:23.842729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:56:22.845670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841592+0000","last_change":"2024-03-31T16:36:23.838560+0000","last_active":"2024-03-31T16:36:23.841592+0000","last_peered":"2024-03-31T16:36:23.841592+0000","last_clean":"2024-03-31T16:36:23.841592+0000","last_became_active":"2024-03-31T16:36:23.838289+0000","last_became_peered":"2024-03-31T16:36:23.838289+0000","last_unstale":"2024-03-31T16:36:23.841592+0000","last_undegraded":"2024-03-31T16:36:23.841592+0000","last_fullsized":"2024-03-31T16:36:23.841592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848676+0000","last_change":"2024-03-31T16:36:23.844556+0000","last_active":"2024-03-31T16:36:23.848676+0000","last_peered":"2024-03-31T16:36:23.848676+0000","last_clean":"2024-03-31T16:36:23.848676+0000","last_became_active":"2024-03-31T16:36:23.843151+0000","last_became_peered":"2024-03-31T16:36:23.843151+0000","last_unstale":"2024-03-31T16:36:23.848676+0000","last_undegraded":"2024-03-31T16:36:23.848676+0000","last_fullsized":"2024-03-31T16:36:23.848676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:56:22.845670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844068+0000","last_change":"2024-03-31T16:36:23.840593+0000","last_active":"2024-03-31T16:36:23.844068+0000","last_peered":"2024-03-31T16:36:23.844068+0000","last_clean":"2024-03-31T16:36:23.844068+0000","last_became_active":"2024-03-31T16:36:23.840314+0000","last_became_peered":"2024-03-31T16:36:23.840314+0000","last_unstale":"2024-03-31T16:36:23.844068+0000","last_undegraded":"2024-03-31T16:36:23.844068+0000","last_fullsized":"2024-03-31T16:36:23.844068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:21:23.168930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.840292+0000","last_change":"2024-03-31T16:36:23.837068+0000","last_active":"2024-03-31T16:36:23.840292+0000","last_peered":"2024-03-31T16:36:23.840292+0000","last_clean":"2024-03-31T16:36:23.840292+0000","last_became_active":"2024-03-31T16:36:23.836786+0000","last_became_peered":"2024-03-31T16:36:23.836786+0000","last_unstale":"2024-03-31T16:36:23.840292+0000","last_undegraded":"2024-03-31T16:36:23.840292+0000","last_fullsized":"2024-03-31T16:36:23.840292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:31:07.285772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.846087+0000","last_change":"2024-03-31T16:36:23.843361+0000","last_active":"2024-03-31T16:36:23.846087+0000","last_peered":"2024-03-31T16:36:23.846087+0000","last_clean":"2024-03-31T16:36:23.846087+0000","last_became_active":"2024-03-31T16:36:23.842008+0000","last_became_peered":"2024-03-31T16:36:23.842008+0000","last_unstale":"2024-03-31T16:36:23.846087+0000","last_undegraded":"2024-03-31T16:36:23.846087+0000","last_fullsized":"2024-03-31T16:36:23.846087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:53:18.202584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848840+0000","last_change":"2024-03-31T16:36:23.841244+0000","last_active":"2024-03-31T16:36:23.848840+0000","last_peered":"2024-03-31T16:36:23.848840+0000","last_clean":"2024-03-31T16:36:23.848840+0000","last_became_active":"2024-03-31T16:36:23.840960+0000","last_became_peered":"2024-03-31T16:36:23.840960+0000","last_unstale":"2024-03-31T16:36:23.848840+0000","last_undegraded":"2024-03-31T16:36:23.848840+0000","last_fullsized":"2024-03-31T16:36:23.848840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:49:40.034045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841122+0000","last_change":"2024-03-31T16:36:23.838910+0000","last_active":"2024-03-31T16:36:23.841122+0000","last_peered":"2024-03-31T16:36:23.841122+0000","last_clean":"2024-03-31T16:36:23.841122+0000","last_became_active":"2024-03-31T16:36:23.838645+0000","last_became_peered":"2024-03-31T16:36:23.838645+0000","last_unstale":"2024-03-31T16:36:23.841122+0000","last_undegraded":"2024-03-31T16:36:23.841122+0000","last_fullsized":"2024-03-31T16:36:23.841122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:40:51.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844134+0000","last_change":"2024-03-31T16:36:23.842320+0000","last_active":"2024-03-31T16:36:23.844134+0000","last_peered":"2024-03-31T16:36:23.844134+0000","last_clean":"2024-03-31T16:36:23.844134+0000","last_became_active":"2024-03-31T16:36:23.842036+0000","last_became_peered":"2024-03-31T16:36:23.842036+0000","last_unstale":"2024-03-31T16:36:23.844134+0000","last_undegraded":"2024-03-31T16:36:23.844134+0000","last_fullsized":"2024-03-31T16:36:23.844134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:40:51.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843901+0000","last_change":"2024-03-31T16:36:23.839080+0000","last_active":"2024-03-31T16:36:23.843901+0000","last_peered":"2024-03-31T16:36:23.843901+0000","last_clean":"2024-03-31T16:36:23.843901+0000","last_became_active":"2024-03-31T16:36:23.838820+0000","last_became_peered":"2024-03-31T16:36:23.838820+0000","last_unstale":"2024-03-31T16:36:23.843901+0000","last_undegraded":"2024-03-31T16:36:23.843901+0000","last_fullsized":"2024-03-31T16:36:23.843901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848884+0000","last_change":"2024-03-31T16:36:23.845276+0000","last_active":"2024-03-31T16:36:23.848884+0000","last_peered":"2024-03-31T16:36:23.848884+0000","last_clean":"2024-03-31T16:36:23.848884+0000","last_became_active":"2024-03-31T16:36:23.844816+0000","last_became_peered":"2024-03-31T16:36:23.844816+0000","last_unstale":"2024-03-31T16:36:23.848884+0000","last_undegraded":"2024-03-31T16:36:23.848884+0000","last_fullsized":"2024-03-31T16:36:23.848884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:49.525305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.847560+0000","last_change":"2024-03-31T16:36:23.841027+0000","last_active":"2024-03-31T16:36:23.847560+0000","last_peered":"2024-03-31T16:36:23.847560+0000","last_clean":"2024-03-31T16:36:23.847560+0000","last_became_active":"2024-03-31T16:36:23.840771+0000","last_became_peered":"2024-03-31T16:36:23.840771+0000","last_unstale":"2024-03-31T16:36:23.847560+0000","last_undegraded":"2024-03-31T16:36:23.847560+0000","last_fullsized":"2024-03-31T16:36:23.847560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:40:06.482507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.839572+0000","last_change":"2024-03-31T16:36:23.832399+0000","last_active":"2024-03-31T16:36:23.839572+0000","last_peered":"2024-03-31T16:36:23.839572+0000","last_clean":"2024-03-31T16:36:23.839572+0000","last_became_active":"2024-03-31T16:36:23.832123+0000","last_became_peered":"2024-03-31T16:36:23.832123+0000","last_unstale":"2024-03-31T16:36:23.839572+0000","last_undegraded":"2024-03-31T16:36:23.839572+0000","last_fullsized":"2024-03-31T16:36:23.839572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:57.336668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838941+0000","last_change":"2024-03-31T16:36:23.834849+0000","last_active":"2024-03-31T16:36:23.838941+0000","last_peered":"2024-03-31T16:36:23.838941+0000","last_clean":"2024-03-31T16:36:23.838941+0000","last_became_active":"2024-03-31T16:36:23.834519+0000","last_became_peered":"2024-03-31T16:36:23.834519+0000","last_unstale":"2024-03-31T16:36:23.838941+0000","last_undegraded":"2024-03-31T16:36:23.838941+0000","last_fullsized":"2024-03-31T16:36:23.838941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:44:30.994346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838783+0000","last_change":"2024-03-31T16:36:23.836361+0000","last_active":"2024-03-31T16:36:23.838783+0000","last_peered":"2024-03-31T16:36:23.838783+0000","last_clean":"2024-03-31T16:36:23.838783+0000","last_became_active":"2024-03-31T16:36:23.835604+0000","last_became_peered":"2024-03-31T16:36:23.835604+0000","last_unstale":"2024-03-31T16:36:23.838783+0000","last_undegraded":"2024-03-31T16:36:23.838783+0000","last_fullsized":"2024-03-31T16:36:23.838783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:48.492958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.837995+0000","last_change":"2024-03-31T16:36:23.835420+0000","last_active":"2024-03-31T16:36:23.837995+0000","last_peered":"2024-03-31T16:36:23.837995+0000","last_clean":"2024-03-31T16:36:23.837995+0000","last_became_active":"2024-03-31T16:36:23.835141+0000","last_became_peered":"2024-03-31T16:36:23.835141+0000","last_unstale":"2024-03-31T16:36:23.837995+0000","last_undegraded":"2024-03-31T16:36:23.837995+0000","last_fullsized":"2024-03-31T16:36:23.837995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:56:22.845670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838148+0000","last_change":"2024-03-31T16:36:23.833949+0000","last_active":"2024-03-31T16:36:23.838148+0000","last_peered":"2024-03-31T16:36:23.838148+0000","last_clean":"2024-03-31T16:36:23.838148+0000","last_became_active":"2024-03-31T16:36:23.833423+0000","last_became_peered":"2024-03-31T16:36:23.833423+0000","last_unstale":"2024-03-31T16:36:23.838148+0000","last_undegraded":"2024-03-31T16:36:23.838148+0000","last_fullsized":"2024-03-31T16:36:23.838148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:21:23.168930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848712+0000","last_change":"2024-03-31T16:36:23.844866+0000","last_active":"2024-03-31T16:36:23.848712+0000","last_peered":"2024-03-31T16:36:23.848712+0000","last_clean":"2024-03-31T16:36:23.848712+0000","last_became_active":"2024-03-31T16:36:23.842947+0000","last_became_peered":"2024-03-31T16:36:23.842947+0000","last_unstale":"2024-03-31T16:36:23.848712+0000","last_undegraded":"2024-03-31T16:36:23.848712+0000","last_fullsized":"2024-03-31T16:36:23.848712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:48.492958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841555+0000","last_change":"2024-03-31T16:36:23.836073+0000","last_active":"2024-03-31T16:36:23.841555+0000","last_peered":"2024-03-31T16:36:23.841555+0000","last_clean":"2024-03-31T16:36:23.841555+0000","last_became_active":"2024-03-31T16:36:23.835818+0000","last_became_peered":"2024-03-31T16:36:23.835818+0000","last_unstale":"2024-03-31T16:36:23.841555+0000","last_undegraded":"2024-03-31T16:36:23.841555+0000","last_fullsized":"2024-03-31T16:36:23.841555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:13:01.572970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849867+0000","last_change":"2024-03-31T16:36:23.845879+0000","last_active":"2024-03-31T16:36:23.849867+0000","last_peered":"2024-03-31T16:36:23.849867+0000","last_clean":"2024-03-31T16:36:23.849867+0000","last_became_active":"2024-03-31T16:36:23.845630+0000","last_became_peered":"2024-03-31T16:36:23.845630+0000","last_unstale":"2024-03-31T16:36:23.849867+0000","last_undegraded":"2024-03-31T16:36:23.849867+0000","last_fullsized":"2024-03-31T16:36:23.849867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:51.725570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.837874+0000","last_change":"2024-03-31T16:36:23.831929+0000","last_active":"2024-03-31T16:36:23.837874+0000","last_peered":"2024-03-31T16:36:23.837874+0000","last_clean":"2024-03-31T16:36:23.837874+0000","last_became_active":"2024-03-31T16:36:23.831647+0000","last_became_peered":"2024-03-31T16:36:23.831647+0000","last_unstale":"2024-03-31T16:36:23.837874+0000","last_undegraded":"2024-03-31T16:36:23.837874+0000","last_fullsized":"2024-03-31T16:36:23.837874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:51.725570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838979+0000","last_change":"2024-03-31T16:36:23.835848+0000","last_active":"2024-03-31T16:36:23.838979+0000","last_peered":"2024-03-31T16:36:23.838979+0000","last_clean":"2024-03-31T16:36:23.838979+0000","last_became_active":"2024-03-31T16:36:23.835582+0000","last_became_peered":"2024-03-31T16:36:23.835582+0000","last_unstale":"2024-03-31T16:36:23.838979+0000","last_undegraded":"2024-03-31T16:36:23.838979+0000","last_fullsized":"2024-03-31T16:36:23.838979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:56:22.845670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842873+0000","last_change":"2024-03-31T16:36:23.838642+0000","last_active":"2024-03-31T16:36:23.842873+0000","last_peered":"2024-03-31T16:36:23.842873+0000","last_clean":"2024-03-31T16:36:23.842873+0000","last_became_active":"2024-03-31T16:36:23.838315+0000","last_became_peered":"2024-03-31T16:36:23.838315+0000","last_unstale":"2024-03-31T16:36:23.842873+0000","last_undegraded":"2024-03-31T16:36:23.842873+0000","last_fullsized":"2024-03-31T16:36:23.842873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:48.492958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848868+0000","last_change":"2024-03-31T16:36:23.844794+0000","last_active":"2024-03-31T16:36:23.848868+0000","last_peered":"2024-03-31T16:36:23.848868+0000","last_clean":"2024-03-31T16:36:23.848868+0000","last_became_active":"2024-03-31T16:36:23.844468+0000","last_became_peered":"2024-03-31T16:36:23.844468+0000","last_unstale":"2024-03-31T16:36:23.848868+0000","last_undegraded":"2024-03-31T16:36:23.848868+0000","last_fullsized":"2024-03-31T16:36:23.848868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:29.030713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844116+0000","last_change":"2024-03-31T16:36:23.840851+0000","last_active":"2024-03-31T16:36:23.844116+0000","last_peered":"2024-03-31T16:36:23.844116+0000","last_clean":"2024-03-31T16:36:23.844116+0000","last_became_active":"2024-03-31T16:36:23.840512+0000","last_became_peered":"2024-03-31T16:36:23.840512+0000","last_unstale":"2024-03-31T16:36:23.844116+0000","last_undegraded":"2024-03-31T16:36:23.844116+0000","last_fullsized":"2024-03-31T16:36:23.844116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:31:07.285772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838043+0000","last_change":"2024-03-31T16:36:23.836408+0000","last_active":"2024-03-31T16:36:23.838043+0000","last_peered":"2024-03-31T16:36:23.838043+0000","last_clean":"2024-03-31T16:36:23.838043+0000","last_became_active":"2024-03-31T16:36:23.836145+0000","last_became_peered":"2024-03-31T16:36:23.836145+0000","last_unstale":"2024-03-31T16:36:23.838043+0000","last_undegraded":"2024-03-31T16:36:23.838043+0000","last_fullsized":"2024-03-31T16:36:23.838043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:48.492958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842077+0000","last_change":"2024-03-31T16:36:22.833601+0000","last_active":"2024-03-31T16:36:23.842077+0000","last_peered":"2024-03-31T16:36:23.842077+0000","last_clean":"2024-03-31T16:36:23.842077+0000","last_became_active":"2024-03-31T16:36:22.833336+0000","last_became_peered":"2024-03-31T16:36:22.833336+0000","last_unstale":"2024-03-31T16:36:23.842077+0000","last_undegraded":"2024-03-31T16:36:23.842077+0000","last_fullsized":"2024-03-31T16:36:23.842077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:03:58.123187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848437+0000","last_change":"2024-03-31T16:36:23.842649+0000","last_active":"2024-03-31T16:36:23.848437+0000","last_peered":"2024-03-31T16:36:23.848437+0000","last_clean":"2024-03-31T16:36:23.848437+0000","last_became_active":"2024-03-31T16:36:23.842317+0000","last_became_peered":"2024-03-31T16:36:23.842317+0000","last_unstale":"2024-03-31T16:36:23.848437+0000","last_undegraded":"2024-03-31T16:36:23.848437+0000","last_fullsized":"2024-03-31T16:36:23.848437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:44:30.994346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841794+0000","last_change":"2024-03-31T16:36:22.841319+0000","last_active":"2024-03-31T16:36:23.841794+0000","last_peered":"2024-03-31T16:36:23.841794+0000","last_clean":"2024-03-31T16:36:23.841794+0000","last_became_active":"2024-03-31T16:36:22.840902+0000","last_became_peered":"2024-03-31T16:36:22.840902+0000","last_unstale":"2024-03-31T16:36:23.841794+0000","last_undegraded":"2024-03-31T16:36:23.841794+0000","last_fullsized":"2024-03-31T16:36:23.841794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:04:22.471640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841640+0000","last_change":"2024-03-31T16:36:23.836777+0000","last_active":"2024-03-31T16:36:23.841640+0000","last_peered":"2024-03-31T16:36:23.841640+0000","last_clean":"2024-03-31T16:36:23.841640+0000","last_became_active":"2024-03-31T16:36:23.836521+0000","last_became_peered":"2024-03-31T16:36:23.836521+0000","last_unstale":"2024-03-31T16:36:23.841640+0000","last_undegraded":"2024-03-31T16:36:23.841640+0000","last_fullsized":"2024-03-31T16:36:23.841640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:19.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.847505+0000","last_change":"2024-03-31T16:36:22.837401+0000","last_active":"2024-03-31T16:36:23.847505+0000","last_peered":"2024-03-31T16:36:23.847505+0000","last_clean":"2024-03-31T16:36:23.847505+0000","last_became_active":"2024-03-31T16:36:22.837097+0000","last_became_peered":"2024-03-31T16:36:22.837097+0000","last_unstale":"2024-03-31T16:36:23.847505+0000","last_undegraded":"2024-03-31T16:36:23.847505+0000","last_fullsized":"2024-03-31T16:36:23.847505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:18.008059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849891+0000","last_change":"2024-03-31T16:36:23.845970+0000","last_active":"2024-03-31T16:36:23.849891+0000","last_peered":"2024-03-31T16:36:23.849891+0000","last_clean":"2024-03-31T16:36:23.849891+0000","last_became_active":"2024-03-31T16:36:23.845614+0000","last_became_peered":"2024-03-31T16:36:23.845614+0000","last_unstale":"2024-03-31T16:36:23.849891+0000","last_undegraded":"2024-03-31T16:36:23.849891+0000","last_fullsized":"2024-03-31T16:36:23.849891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:12:24.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843138+0000","last_change":"2024-03-31T16:36:22.831209+0000","last_active":"2024-03-31T16:36:23.843138+0000","last_peered":"2024-03-31T16:36:23.843138+0000","last_clean":"2024-03-31T16:36:23.843138+0000","last_became_active":"2024-03-31T16:36:22.830965+0000","last_became_peered":"2024-03-31T16:36:22.830965+0000","last_unstale":"2024-03-31T16:36:23.843138+0000","last_undegraded":"2024-03-31T16:36:23.843138+0000","last_fullsized":"2024-03-31T16:36:23.843138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:08:31.842551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844011+0000","last_change":"2024-03-31T16:36:23.839787+0000","last_active":"2024-03-31T16:36:23.844011+0000","last_peered":"2024-03-31T16:36:23.844011+0000","last_clean":"2024-03-31T16:36:23.844011+0000","last_became_active":"2024-03-31T16:36:23.839538+0000","last_became_peered":"2024-03-31T16:36:23.839538+0000","last_unstale":"2024-03-31T16:36:23.844011+0000","last_undegraded":"2024-03-31T16:36:23.844011+0000","last_fullsized":"2024-03-31T16:36:23.844011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:12:24.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842021+0000","last_change":"2024-03-31T16:36:22.839238+0000","last_active":"2024-03-31T16:36:23.842021+0000","last_peered":"2024-03-31T16:36:23.842021+0000","last_clean":"2024-03-31T16:36:23.842021+0000","last_became_active":"2024-03-31T16:36:22.838973+0000","last_became_peered":"2024-03-31T16:36:22.838973+0000","last_unstale":"2024-03-31T16:36:23.842021+0000","last_undegraded":"2024-03-31T16:36:23.842021+0000","last_fullsized":"2024-03-31T16:36:23.842021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:07:00.927777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838186+0000","last_change":"2024-03-31T16:36:23.834834+0000","last_active":"2024-03-31T16:36:23.838186+0000","last_peered":"2024-03-31T16:36:23.838186+0000","last_clean":"2024-03-31T16:36:23.838186+0000","last_became_active":"2024-03-31T16:36:23.834554+0000","last_became_peered":"2024-03-31T16:36:23.834554+0000","last_unstale":"2024-03-31T16:36:23.838186+0000","last_undegraded":"2024-03-31T16:36:23.838186+0000","last_fullsized":"2024-03-31T16:36:23.838186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:51:29.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841982+0000","last_change":"2024-03-31T16:36:22.839379+0000","last_active":"2024-03-31T16:36:23.841982+0000","last_peered":"2024-03-31T16:36:23.841982+0000","last_clean":"2024-03-31T16:36:23.841982+0000","last_became_active":"2024-03-31T16:36:22.839048+0000","last_became_peered":"2024-03-31T16:36:22.839048+0000","last_unstale":"2024-03-31T16:36:23.841982+0000","last_undegraded":"2024-03-31T16:36:23.841982+0000","last_fullsized":"2024-03-31T16:36:23.841982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:29.111460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841663+0000","last_change":"2024-03-31T16:36:23.839629+0000","last_active":"2024-03-31T16:36:23.841663+0000","last_peered":"2024-03-31T16:36:23.841663+0000","last_clean":"2024-03-31T16:36:23.841663+0000","last_became_active":"2024-03-31T16:36:23.838875+0000","last_became_peered":"2024-03-31T16:36:23.838875+0000","last_unstale":"2024-03-31T16:36:23.841663+0000","last_undegraded":"2024-03-31T16:36:23.841663+0000","last_fullsized":"2024-03-31T16:36:23.841663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:51.725570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.824067+0000","last_change":"2024-03-31T16:36:22.834611+0000","last_active":"2024-03-31T16:36:23.824067+0000","last_peered":"2024-03-31T16:36:23.824067+0000","last_clean":"2024-03-31T16:36:23.824067+0000","last_became_active":"2024-03-31T16:36:22.834329+0000","last_became_peered":"2024-03-31T16:36:22.834329+0000","last_unstale":"2024-03-31T16:36:23.824067+0000","last_undegraded":"2024-03-31T16:36:23.824067+0000","last_fullsized":"2024-03-31T16:36:23.824067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:51:28.061010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849800+0000","last_change":"2024-03-31T16:36:23.844918+0000","last_active":"2024-03-31T16:36:23.849800+0000","last_peered":"2024-03-31T16:36:23.849800+0000","last_clean":"2024-03-31T16:36:23.849800+0000","last_became_active":"2024-03-31T16:36:23.844534+0000","last_became_peered":"2024-03-31T16:36:23.844534+0000","last_unstale":"2024-03-31T16:36:23.849800+0000","last_undegraded":"2024-03-31T16:36:23.849800+0000","last_fullsized":"2024-03-31T16:36:23.849800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:19.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823117+0000","last_change":"2024-03-31T16:36:22.834331+0000","last_active":"2024-03-31T16:36:23.823117+0000","last_peered":"2024-03-31T16:36:23.823117+0000","last_clean":"2024-03-31T16:36:23.823117+0000","last_became_active":"2024-03-31T16:36:22.834063+0000","last_became_peered":"2024-03-31T16:36:22.834063+0000","last_unstale":"2024-03-31T16:36:23.823117+0000","last_undegraded":"2024-03-31T16:36:23.823117+0000","last_fullsized":"2024-03-31T16:36:23.823117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:12.967125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.837815+0000","last_change":"2024-03-31T16:36:23.830814+0000","last_active":"2024-03-31T16:36:23.837815+0000","last_peered":"2024-03-31T16:36:23.837815+0000","last_clean":"2024-03-31T16:36:23.837815+0000","last_became_active":"2024-03-31T16:36:23.830475+0000","last_became_peered":"2024-03-31T16:36:23.830475+0000","last_unstale":"2024-03-31T16:36:23.837815+0000","last_undegraded":"2024-03-31T16:36:23.837815+0000","last_fullsized":"2024-03-31T16:36:23.837815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823417+0000","last_change":"2024-03-31T16:36:22.841405+0000","last_active":"2024-03-31T16:36:23.823417+0000","last_peered":"2024-03-31T16:36:23.823417+0000","last_clean":"2024-03-31T16:36:23.823417+0000","last_became_active":"2024-03-31T16:36:22.841094+0000","last_became_peered":"2024-03-31T16:36:22.841094+0000","last_unstale":"2024-03-31T16:36:23.823417+0000","last_undegraded":"2024-03-31T16:36:23.823417+0000","last_fullsized":"2024-03-31T16:36:23.823417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:12:23.937159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841864+0000","last_change":"2024-03-31T16:36:23.838995+0000","last_active":"2024-03-31T16:36:23.841864+0000","last_peered":"2024-03-31T16:36:23.841864+0000","last_clean":"2024-03-31T16:36:23.841864+0000","last_became_active":"2024-03-31T16:36:23.838738+0000","last_became_peered":"2024-03-31T16:36:23.838738+0000","last_unstale":"2024-03-31T16:36:23.841864+0000","last_undegraded":"2024-03-31T16:36:23.841864+0000","last_fullsized":"2024-03-31T16:36:23.841864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:38:07.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.821443+0000","last_change":"2024-03-31T16:36:22.829735+0000","last_active":"2024-03-31T16:36:23.821443+0000","last_peered":"2024-03-31T16:36:23.821443+0000","last_clean":"2024-03-31T16:36:23.821443+0000","last_became_active":"2024-03-31T16:36:22.829502+0000","last_became_peered":"2024-03-31T16:36:22.829502+0000","last_unstale":"2024-03-31T16:36:23.821443+0000","last_undegraded":"2024-03-31T16:36:23.821443+0000","last_fullsized":"2024-03-31T16:36:23.821443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:28.028289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841658+0000","last_change":"2024-03-31T16:36:23.836135+0000","last_active":"2024-03-31T16:36:23.841658+0000","last_peered":"2024-03-31T16:36:23.841658+0000","last_clean":"2024-03-31T16:36:23.841658+0000","last_became_active":"2024-03-31T16:36:23.835882+0000","last_became_peered":"2024-03-31T16:36:23.835882+0000","last_unstale":"2024-03-31T16:36:23.841658+0000","last_undegraded":"2024-03-31T16:36:23.841658+0000","last_fullsized":"2024-03-31T16:36:23.841658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:00:36.748087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842083+0000","last_change":"2024-03-31T16:36:22.841390+0000","last_active":"2024-03-31T16:36:23.842083+0000","last_peered":"2024-03-31T16:36:23.842083+0000","last_clean":"2024-03-31T16:36:23.842083+0000","last_became_active":"2024-03-31T16:36:22.841001+0000","last_became_peered":"2024-03-31T16:36:22.841001+0000","last_unstale":"2024-03-31T16:36:23.842083+0000","last_undegraded":"2024-03-31T16:36:23.842083+0000","last_fullsized":"2024-03-31T16:36:23.842083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:47.490534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851473+0000","last_change":"2024-03-31T16:36:23.846701+0000","last_active":"2024-03-31T16:36:23.851473+0000","last_peered":"2024-03-31T16:36:23.851473+0000","last_clean":"2024-03-31T16:36:23.851473+0000","last_became_active":"2024-03-31T16:36:23.846420+0000","last_became_peered":"2024-03-31T16:36:23.846420+0000","last_unstale":"2024-03-31T16:36:23.851473+0000","last_undegraded":"2024-03-31T16:36:23.851473+0000","last_fullsized":"2024-03-31T16:36:23.851473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:13:01.572970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851919+0000","last_change":"2024-03-31T16:36:22.836980+0000","last_active":"2024-03-31T16:36:23.851919+0000","last_peered":"2024-03-31T16:36:23.851919+0000","last_clean":"2024-03-31T16:36:23.851919+0000","last_became_active":"2024-03-31T16:36:22.836689+0000","last_became_peered":"2024-03-31T16:36:22.836689+0000","last_unstale":"2024-03-31T16:36:23.851919+0000","last_undegraded":"2024-03-31T16:36:23.851919+0000","last_fullsized":"2024-03-31T16:36:23.851919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:31:06.283348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849903+0000","last_change":"2024-03-31T16:36:23.845825+0000","last_active":"2024-03-31T16:36:23.849903+0000","last_peered":"2024-03-31T16:36:23.849903+0000","last_clean":"2024-03-31T16:36:23.849903+0000","last_became_active":"2024-03-31T16:36:23.845576+0000","last_became_peered":"2024-03-31T16:36:23.845576+0000","last_unstale":"2024-03-31T16:36:23.849903+0000","last_undegraded":"2024-03-31T16:36:23.849903+0000","last_fullsized":"2024-03-31T16:36:23.849903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841534+0000","last_change":"2024-03-31T16:36:22.835088+0000","last_active":"2024-03-31T16:36:23.841534+0000","last_peered":"2024-03-31T16:36:23.841534+0000","last_clean":"2024-03-31T16:36:23.841534+0000","last_became_active":"2024-03-31T16:36:22.834783+0000","last_became_peered":"2024-03-31T16:36:22.834783+0000","last_unstale":"2024-03-31T16:36:23.841534+0000","last_undegraded":"2024-03-31T16:36:23.841534+0000","last_fullsized":"2024-03-31T16:36:23.841534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:14:32.483271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.839130+0000","last_change":"2024-03-31T16:36:23.833239+0000","last_active":"2024-03-31T16:36:23.839130+0000","last_peered":"2024-03-31T16:36:23.839130+0000","last_clean":"2024-03-31T16:36:23.839130+0000","last_became_active":"2024-03-31T16:36:23.832791+0000","last_became_peered":"2024-03-31T16:36:23.832791+0000","last_unstale":"2024-03-31T16:36:23.839130+0000","last_undegraded":"2024-03-31T16:36:23.839130+0000","last_fullsized":"2024-03-31T16:36:23.839130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:51.820689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823126+0000","last_change":"2024-03-31T16:36:22.834884+0000","last_active":"2024-03-31T16:36:23.823126+0000","last_peered":"2024-03-31T16:36:23.823126+0000","last_clean":"2024-03-31T16:36:23.823126+0000","last_became_active":"2024-03-31T16:36:22.833985+0000","last_became_peered":"2024-03-31T16:36:22.833985+0000","last_unstale":"2024-03-31T16:36:23.823126+0000","last_undegraded":"2024-03-31T16:36:23.823126+0000","last_fullsized":"2024-03-31T16:36:23.823126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:14:32.483271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844078+0000","last_change":"2024-03-31T16:36:23.841228+0000","last_active":"2024-03-31T16:36:23.844078+0000","last_peered":"2024-03-31T16:36:23.844078+0000","last_clean":"2024-03-31T16:36:23.844078+0000","last_became_active":"2024-03-31T16:36:23.840969+0000","last_became_peered":"2024-03-31T16:36:23.840969+0000","last_unstale":"2024-03-31T16:36:23.844078+0000","last_undegraded":"2024-03-31T16:36:23.844078+0000","last_fullsized":"2024-03-31T16:36:23.844078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:51:29.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823932+0000","last_change":"2024-03-31T16:36:22.841598+0000","last_active":"2024-03-31T16:36:23.823932+0000","last_peered":"2024-03-31T16:36:23.823932+0000","last_clean":"2024-03-31T16:36:23.823932+0000","last_became_active":"2024-03-31T16:36:22.841187+0000","last_became_peered":"2024-03-31T16:36:22.841187+0000","last_unstale":"2024-03-31T16:36:23.823932+0000","last_undegraded":"2024-03-31T16:36:23.823932+0000","last_fullsized":"2024-03-31T16:36:23.823932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:21:22.166507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848431+0000","last_change":"2024-03-31T16:36:23.842635+0000","last_active":"2024-03-31T16:36:23.848431+0000","last_peered":"2024-03-31T16:36:23.848431+0000","last_clean":"2024-03-31T16:36:23.848431+0000","last_became_active":"2024-03-31T16:36:23.842299+0000","last_became_peered":"2024-03-31T16:36:23.842299+0000","last_unstale":"2024-03-31T16:36:23.848431+0000","last_undegraded":"2024-03-31T16:36:23.848431+0000","last_fullsized":"2024-03-31T16:36:23.848431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:04:23.474063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.846117+0000","last_change":"2024-03-31T16:36:22.837012+0000","last_active":"2024-03-31T16:36:23.846117+0000","last_peered":"2024-03-31T16:36:23.846117+0000","last_clean":"2024-03-31T16:36:23.846117+0000","last_became_active":"2024-03-31T16:36:22.836736+0000","last_became_peered":"2024-03-31T16:36:22.836736+0000","last_unstale":"2024-03-31T16:36:23.846117+0000","last_undegraded":"2024-03-31T16:36:23.846117+0000","last_fullsized":"2024-03-31T16:36:23.846117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:50.723146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.830799+0000","last_change":"2024-03-31T16:36:23.826725+0000","last_active":"2024-03-31T16:36:23.830799+0000","last_peered":"2024-03-31T16:36:23.830799+0000","last_clean":"2024-03-31T16:36:23.830799+0000","last_became_active":"2024-03-31T16:36:23.826420+0000","last_became_peered":"2024-03-31T16:36:23.826420+0000","last_unstale":"2024-03-31T16:36:23.830799+0000","last_undegraded":"2024-03-31T16:36:23.830799+0000","last_fullsized":"2024-03-31T16:36:23.830799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:04:23.474063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849902+0000","last_change":"2024-03-31T16:36:22.839342+0000","last_active":"2024-03-31T16:36:23.849902+0000","last_peered":"2024-03-31T16:36:23.849902+0000","last_clean":"2024-03-31T16:36:23.849902+0000","last_became_active":"2024-03-31T16:36:22.839053+0000","last_became_peered":"2024-03-31T16:36:22.839053+0000","last_unstale":"2024-03-31T16:36:23.849902+0000","last_undegraded":"2024-03-31T16:36:23.849902+0000","last_fullsized":"2024-03-31T16:36:23.849902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:13.234390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838189+0000","last_change":"2024-03-31T16:36:23.832223+0000","last_active":"2024-03-31T16:36:23.838189+0000","last_peered":"2024-03-31T16:36:23.838189+0000","last_clean":"2024-03-31T16:36:23.838189+0000","last_became_active":"2024-03-31T16:36:23.831139+0000","last_became_peered":"2024-03-31T16:36:23.831139+0000","last_unstale":"2024-03-31T16:36:23.838189+0000","last_undegraded":"2024-03-31T16:36:23.838189+0000","last_fullsized":"2024-03-31T16:36:23.838189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:12:24.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.840508+0000","last_change":"2024-03-31T16:36:22.835128+0000","last_active":"2024-03-31T16:36:23.840508+0000","last_peered":"2024-03-31T16:36:23.840508+0000","last_clean":"2024-03-31T16:36:23.840508+0000","last_became_active":"2024-03-31T16:36:22.834796+0000","last_became_peered":"2024-03-31T16:36:22.834796+0000","last_unstale":"2024-03-31T16:36:23.840508+0000","last_undegraded":"2024-03-31T16:36:23.840508+0000","last_fullsized":"2024-03-31T16:36:23.840508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:53:17.200161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844718+0000","last_change":"2024-03-31T16:36:23.840576+0000","last_active":"2024-03-31T16:36:23.844718+0000","last_peered":"2024-03-31T16:36:23.844718+0000","last_clean":"2024-03-31T16:36:23.844718+0000","last_became_active":"2024-03-31T16:36:23.840261+0000","last_became_peered":"2024-03-31T16:36:23.840261+0000","last_unstale":"2024-03-31T16:36:23.844718+0000","last_undegraded":"2024-03-31T16:36:23.844718+0000","last_fullsized":"2024-03-31T16:36:23.844718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:44:30.994346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841457+0000","last_change":"2024-03-31T16:36:22.832438+0000","last_active":"2024-03-31T16:36:23.841457+0000","last_peered":"2024-03-31T16:36:23.841457+0000","last_clean":"2024-03-31T16:36:23.841457+0000","last_became_active":"2024-03-31T16:36:22.832144+0000","last_became_peered":"2024-03-31T16:36:22.832144+0000","last_unstale":"2024-03-31T16:36:23.841457+0000","last_undegraded":"2024-03-31T16:36:23.841457+0000","last_fullsized":"2024-03-31T16:36:23.841457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:10:29.825587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843117+0000","last_change":"2024-03-31T16:36:23.836203+0000","last_active":"2024-03-31T16:36:23.843117+0000","last_peered":"2024-03-31T16:36:23.843117+0000","last_clean":"2024-03-31T16:36:23.843117+0000","last_became_active":"2024-03-31T16:36:23.835956+0000","last_became_peered":"2024-03-31T16:36:23.835956+0000","last_unstale":"2024-03-31T16:36:23.843117+0000","last_undegraded":"2024-03-31T16:36:23.843117+0000","last_fullsized":"2024-03-31T16:36:23.843117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:19:04.943798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823649+0000","last_change":"2024-03-31T16:36:22.836868+0000","last_active":"2024-03-31T16:36:23.823649+0000","last_peered":"2024-03-31T16:36:23.823649+0000","last_clean":"2024-03-31T16:36:23.823649+0000","last_became_active":"2024-03-31T16:36:22.836538+0000","last_became_peered":"2024-03-31T16:36:22.836538+0000","last_unstale":"2024-03-31T16:36:23.823649+0000","last_undegraded":"2024-03-31T16:36:23.823649+0000","last_fullsized":"2024-03-31T16:36:23.823649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:03:58.123187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844040+0000","last_change":"2024-03-31T16:36:23.842704+0000","last_active":"2024-03-31T16:36:23.844040+0000","last_peered":"2024-03-31T16:36:23.844040+0000","last_clean":"2024-03-31T16:36:23.844040+0000","last_became_active":"2024-03-31T16:36:23.842428+0000","last_became_peered":"2024-03-31T16:36:23.842428+0000","last_unstale":"2024-03-31T16:36:23.844040+0000","last_undegraded":"2024-03-31T16:36:23.844040+0000","last_fullsized":"2024-03-31T16:36:23.844040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:10:30.828010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.846580+0000","last_change":"2024-03-31T16:36:22.830634+0000","last_active":"2024-03-31T16:36:23.846580+0000","last_peered":"2024-03-31T16:36:23.846580+0000","last_clean":"2024-03-31T16:36:23.846580+0000","last_became_active":"2024-03-31T16:36:22.830383+0000","last_became_peered":"2024-03-31T16:36:22.830383+0000","last_unstale":"2024-03-31T16:36:23.846580+0000","last_undegraded":"2024-03-31T16:36:23.846580+0000","last_fullsized":"2024-03-31T16:36:23.846580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:34.521212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844046+0000","last_change":"2024-03-31T16:36:23.839791+0000","last_active":"2024-03-31T16:36:23.844046+0000","last_peered":"2024-03-31T16:36:23.844046+0000","last_clean":"2024-03-31T16:36:23.844046+0000","last_became_active":"2024-03-31T16:36:23.837774+0000","last_became_peered":"2024-03-31T16:36:23.837774+0000","last_unstale":"2024-03-31T16:36:23.844046+0000","last_undegraded":"2024-03-31T16:36:23.844046+0000","last_fullsized":"2024-03-31T16:36:23.844046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:37:04.484647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.829193+0000","last_change":"2024-03-31T16:36:22.836965+0000","last_active":"2024-03-31T16:36:23.829193+0000","last_peered":"2024-03-31T16:36:23.829193+0000","last_clean":"2024-03-31T16:36:23.829193+0000","last_became_active":"2024-03-31T16:36:22.836731+0000","last_became_peered":"2024-03-31T16:36:22.836731+0000","last_unstale":"2024-03-31T16:36:23.829193+0000","last_undegraded":"2024-03-31T16:36:23.829193+0000","last_fullsized":"2024-03-31T16:36:23.829193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:07:00.927777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843146+0000","last_change":"2024-03-31T16:36:23.834860+0000","last_active":"2024-03-31T16:36:23.843146+0000","last_peered":"2024-03-31T16:36:23.843146+0000","last_clean":"2024-03-31T16:36:23.843146+0000","last_became_active":"2024-03-31T16:36:23.834608+0000","last_became_peered":"2024-03-31T16:36:23.834608+0000","last_unstale":"2024-03-31T16:36:23.843146+0000","last_undegraded":"2024-03-31T16:36:23.843146+0000","last_fullsized":"2024-03-31T16:36:23.843146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:01:29.081356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.824643+0000","last_change":"2024-03-31T16:36:22.832368+0000","last_active":"2024-03-31T16:36:23.824643+0000","last_peered":"2024-03-31T16:36:23.824643+0000","last_clean":"2024-03-31T16:36:23.824643+0000","last_became_active":"2024-03-31T16:36:22.832066+0000","last_became_peered":"2024-03-31T16:36:22.832066+0000","last_unstale":"2024-03-31T16:36:23.824643+0000","last_undegraded":"2024-03-31T16:36:23.824643+0000","last_fullsized":"2024-03-31T16:36:23.824643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:34.521212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843892+0000","last_change":"2024-03-31T16:36:23.838651+0000","last_active":"2024-03-31T16:36:23.843892+0000","last_peered":"2024-03-31T16:36:23.843892+0000","last_clean":"2024-03-31T16:36:23.843892+0000","last_became_active":"2024-03-31T16:36:23.838383+0000","last_became_peered":"2024-03-31T16:36:23.838383+0000","last_unstale":"2024-03-31T16:36:23.843892+0000","last_undegraded":"2024-03-31T16:36:23.843892+0000","last_fullsized":"2024-03-31T16:36:23.843892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:19.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.824444+0000","last_change":"2024-03-31T16:36:22.841226+0000","last_active":"2024-03-31T16:36:23.824444+0000","last_peered":"2024-03-31T16:36:23.824444+0000","last_clean":"2024-03-31T16:36:23.824444+0000","last_became_active":"2024-03-31T16:36:22.840937+0000","last_became_peered":"2024-03-31T16:36:22.840937+0000","last_unstale":"2024-03-31T16:36:23.824444+0000","last_undegraded":"2024-03-31T16:36:23.824444+0000","last_fullsized":"2024-03-31T16:36:23.824444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:18.008059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.839543+0000","last_change":"2024-03-31T16:36:23.832575+0000","last_active":"2024-03-31T16:36:23.839543+0000","last_peered":"2024-03-31T16:36:23.839543+0000","last_clean":"2024-03-31T16:36:23.839543+0000","last_became_active":"2024-03-31T16:36:23.832310+0000","last_became_peered":"2024-03-31T16:36:23.832310+0000","last_unstale":"2024-03-31T16:36:23.839543+0000","last_undegraded":"2024-03-31T16:36:23.839543+0000","last_fullsized":"2024-03-31T16:36:23.839543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:12:28.883226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851893+0000","last_change":"2024-03-31T16:36:22.834380+0000","last_active":"2024-03-31T16:36:23.851893+0000","last_peered":"2024-03-31T16:36:23.851893+0000","last_clean":"2024-03-31T16:36:23.851893+0000","last_became_active":"2024-03-31T16:36:22.834022+0000","last_became_peered":"2024-03-31T16:36:22.834022+0000","last_unstale":"2024-03-31T16:36:23.851893+0000","last_undegraded":"2024-03-31T16:36:23.851893+0000","last_fullsized":"2024-03-31T16:36:23.851893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:04:22.471640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851444+0000","last_change":"2024-03-31T16:36:23.846662+0000","last_active":"2024-03-31T16:36:23.851444+0000","last_peered":"2024-03-31T16:36:23.851444+0000","last_clean":"2024-03-31T16:36:23.851444+0000","last_became_active":"2024-03-31T16:36:23.846301+0000","last_became_peered":"2024-03-31T16:36:23.846301+0000","last_unstale":"2024-03-31T16:36:23.851444+0000","last_undegraded":"2024-03-31T16:36:23.851444+0000","last_fullsized":"2024-03-31T16:36:23.851444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:09:02.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.821311+0000","last_change":"2024-03-31T16:36:22.832561+0000","last_active":"2024-03-31T16:36:23.821311+0000","last_peered":"2024-03-31T16:36:23.821311+0000","last_clean":"2024-03-31T16:36:23.821311+0000","last_became_active":"2024-03-31T16:36:22.832303+0000","last_became_peered":"2024-03-31T16:36:22.832303+0000","last_unstale":"2024-03-31T16:36:23.821311+0000","last_undegraded":"2024-03-31T16:36:23.821311+0000","last_fullsized":"2024-03-31T16:36:23.821311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:44:29.991922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849739+0000","last_change":"2024-03-31T16:36:23.846675+0000","last_active":"2024-03-31T16:36:23.849739+0000","last_peered":"2024-03-31T16:36:23.849739+0000","last_clean":"2024-03-31T16:36:23.849739+0000","last_became_active":"2024-03-31T16:36:23.846394+0000","last_became_peered":"2024-03-31T16:36:23.846394+0000","last_unstale":"2024-03-31T16:36:23.849739+0000","last_undegraded":"2024-03-31T16:36:23.849739+0000","last_fullsized":"2024-03-31T16:36:23.849739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.822558+0000","last_change":"2024-03-31T16:36:22.833130+0000","last_active":"2024-03-31T16:36:23.822558+0000","last_peered":"2024-03-31T16:36:23.822558+0000","last_clean":"2024-03-31T16:36:23.822558+0000","last_became_active":"2024-03-31T16:36:22.832813+0000","last_became_peered":"2024-03-31T16:36:22.832813+0000","last_unstale":"2024-03-31T16:36:23.822558+0000","last_undegraded":"2024-03-31T16:36:23.822558+0000","last_fullsized":"2024-03-31T16:36:23.822558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:07:00.927777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843885+0000","last_change":"2024-03-31T16:36:23.842423+0000","last_active":"2024-03-31T16:36:23.843885+0000","last_peered":"2024-03-31T16:36:23.843885+0000","last_clean":"2024-03-31T16:36:23.843885+0000","last_became_active":"2024-03-31T16:36:23.842020+0000","last_became_peered":"2024-03-31T16:36:23.842020+0000","last_unstale":"2024-03-31T16:36:23.843885+0000","last_undegraded":"2024-03-31T16:36:23.843885+0000","last_fullsized":"2024-03-31T16:36:23.843885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:14.236814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.820971+0000","last_change":"2024-03-31T16:36:22.830077+0000","last_active":"2024-03-31T16:36:23.820971+0000","last_peered":"2024-03-31T16:36:23.820971+0000","last_clean":"2024-03-31T16:36:23.820971+0000","last_became_active":"2024-03-31T16:36:22.829811+0000","last_became_peered":"2024-03-31T16:36:22.829811+0000","last_unstale":"2024-03-31T16:36:23.820971+0000","last_undegraded":"2024-03-31T16:36:23.820971+0000","last_fullsized":"2024-03-31T16:36:23.820971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:13.234390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841206+0000","last_change":"2024-03-31T16:36:23.838979+0000","last_active":"2024-03-31T16:36:23.841206+0000","last_peered":"2024-03-31T16:36:23.841206+0000","last_clean":"2024-03-31T16:36:23.841206+0000","last_became_active":"2024-03-31T16:36:23.838724+0000","last_became_peered":"2024-03-31T16:36:23.838724+0000","last_unstale":"2024-03-31T16:36:23.841206+0000","last_undegraded":"2024-03-31T16:36:23.841206+0000","last_fullsized":"2024-03-31T16:36:23.841206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:19.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823274+0000","last_change":"2024-03-31T16:36:22.834786+0000","last_active":"2024-03-31T16:36:23.823274+0000","last_peered":"2024-03-31T16:36:23.823274+0000","last_clean":"2024-03-31T16:36:23.823274+0000","last_became_active":"2024-03-31T16:36:22.834544+0000","last_became_peered":"2024-03-31T16:36:22.834544+0000","last_unstale":"2024-03-31T16:36:23.823274+0000","last_undegraded":"2024-03-31T16:36:23.823274+0000","last_fullsized":"2024-03-31T16:36:23.823274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:34.521212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841633+0000","last_change":"2024-03-31T16:36:23.838920+0000","last_active":"2024-03-31T16:36:23.841633+0000","last_peered":"2024-03-31T16:36:23.841633+0000","last_clean":"2024-03-31T16:36:23.841633+0000","last_became_active":"2024-03-31T16:36:23.838632+0000","last_became_peered":"2024-03-31T16:36:23.838632+0000","last_unstale":"2024-03-31T16:36:23.841633+0000","last_undegraded":"2024-03-31T16:36:23.841633+0000","last_fullsized":"2024-03-31T16:36:23.841633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:06:57.897091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.824768+0000","last_change":"2024-03-31T16:36:22.833565+0000","last_active":"2024-03-31T16:36:23.824768+0000","last_peered":"2024-03-31T16:36:23.824768+0000","last_clean":"2024-03-31T16:36:23.824768+0000","last_became_active":"2024-03-31T16:36:22.833281+0000","last_became_peered":"2024-03-31T16:36:22.833281+0000","last_unstale":"2024-03-31T16:36:23.824768+0000","last_undegraded":"2024-03-31T16:36:23.824768+0000","last_fullsized":"2024-03-31T16:36:23.824768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:13.234390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.839219+0000","last_change":"2024-03-31T16:36:23.835225+0000","last_active":"2024-03-31T16:36:23.839219+0000","last_peered":"2024-03-31T16:36:23.839219+0000","last_clean":"2024-03-31T16:36:23.839219+0000","last_became_active":"2024-03-31T16:36:23.834993+0000","last_became_peered":"2024-03-31T16:36:23.834993+0000","last_unstale":"2024-03-31T16:36:23.839219+0000","last_undegraded":"2024-03-31T16:36:23.839219+0000","last_fullsized":"2024-03-31T16:36:23.839219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:29.030713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.822963+0000","last_change":"2024-03-31T16:36:22.841301+0000","last_active":"2024-03-31T16:36:23.822963+0000","last_peered":"2024-03-31T16:36:23.822963+0000","last_clean":"2024-03-31T16:36:23.822963+0000","last_became_active":"2024-03-31T16:36:22.841019+0000","last_became_peered":"2024-03-31T16:36:22.841019+0000","last_unstale":"2024-03-31T16:36:23.822963+0000","last_undegraded":"2024-03-31T16:36:23.822963+0000","last_fullsized":"2024-03-31T16:36:23.822963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:09.380679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842784+0000","last_change":"2024-03-31T16:36:23.836388+0000","last_active":"2024-03-31T16:36:23.842784+0000","last_peered":"2024-03-31T16:36:23.842784+0000","last_clean":"2024-03-31T16:36:23.842784+0000","last_became_active":"2024-03-31T16:36:23.836016+0000","last_became_peered":"2024-03-31T16:36:23.836016+0000","last_unstale":"2024-03-31T16:36:23.842784+0000","last_undegraded":"2024-03-31T16:36:23.842784+0000","last_fullsized":"2024-03-31T16:36:23.842784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:29.030713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.832227+0000","last_change":"2024-03-31T16:36:22.836270+0000","last_active":"2024-03-31T16:36:23.832227+0000","last_peered":"2024-03-31T16:36:23.832227+0000","last_clean":"2024-03-31T16:36:23.832227+0000","last_became_active":"2024-03-31T16:36:22.835964+0000","last_became_peered":"2024-03-31T16:36:22.835964+0000","last_unstale":"2024-03-31T16:36:23.832227+0000","last_undegraded":"2024-03-31T16:36:23.832227+0000","last_fullsized":"2024-03-31T16:36:23.832227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:14:32.483271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.829103+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:36:23.829103+0000","last_peered":"2024-03-31T16:36:23.829103+0000","last_clean":"2024-03-31T16:36:23.829103+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:36:23.829103+0000","last_undegraded":"2024-03-31T16:36:23.829103+0000","last_fullsized":"2024-03-31T16:36:23.829103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:36:26.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-31T16:36:26.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.954+0000 7fbedf2b1640 1 Processor -- start 2024-03-31T16:36:26.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.954+0000 7fbedf2b1640 1 -- start start 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedf2b1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbed80c7810 0x7fbed80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedf2b1640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbed80d1d70 0x7fbed806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedf2b1640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed80d01a0 con 0x7fbed815e7b0 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedf2b1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fbed80d1240 con 0x7fbed80c7810 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedf2b1640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbed80d0480 con 0x7fbed80d1d70 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedc84c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbed80c7810 0x7fbed80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedc84c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbed80c7810 0x7fbed80b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37688/0 (socket says 172.21.15.120:37688) 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedc84c640 1 -- 172.21.15.120:0/1379855847 learned_addr learned my addr 172.21.15.120:0/1379855847 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.955+0000 7fbedd84e640 1 --2- 172.21.15.120:0/1379855847 >> v2:172.21.15.203:3300/0 conn(0x7fbed80d1d70 0x7fbed806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.956+0000 7fbedc84c640 1 -- 172.21.15.120:0/1379855847 >> v2:172.21.15.203:3300/0 conn(0x7fbed80d1d70 msgr2=0x7fbed806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.956+0000 7fbedc84c640 1 --2- 172.21.15.120:0/1379855847 >> v2:172.21.15.203:3300/0 conn(0x7fbed80d1d70 0x7fbed806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.956+0000 7fbedc84c640 1 -- 172.21.15.120:0/1379855847 >> v1:172.21.15.203:6789/0 conn(0x7fbed815e7b0 legacy=0x7fbed80c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.956+0000 7fbedc84c640 1 -- 172.21.15.120:0/1379855847 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed80d0760 con 0x7fbed80c7810 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.956+0000 7fbedc84c640 1 --2- 172.21.15.120:0/1379855847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed80b4980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbed8070950 tx=0x7fbed402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f330a27faf3a02f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbecffff640 1 -- 172.21.15.120:0/1379855847 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4034070 con 0x7fbed80c7810 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbecffff640 1 -- 172.21.15.120:0/1379855847 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed4030860 con 0x7fbed80c7810 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbecffff640 1 -- 172.21.15.120:0/1379855847 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed4030c30 con 0x7fbed80c7810 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1379855847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 msgr2=0x7fbed80b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1379855847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed80b4980 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbed8070950 tx=0x7fbed402b9a0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1379855847 shutdown_connections 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1379855847 >> v2:172.21.15.203:3300/0 conn(0x7fbed80d1d70 0x7fbed806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1379855847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed80b4980 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1379855847 >> 172.21.15.120:0/1379855847 conn(0x7fbed80b3e90 msgr2=0x7fbed80b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1379855847 shutdown_connections 2024-03-31T16:36:26.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.957+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1379855847 wait complete. 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.959+0000 7fbedf2b1640 1 Processor -- start 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.959+0000 7fbedf2b1640 1 -- start start 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedf2b1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed8145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedf2b1640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbed80d1d70 0x7fbed815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedf2b1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbed815e7b0 0x7fbed815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedf2b1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80cfe30 con 0x7fbed80c7810 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedf2b1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80d0d20 con 0x7fbed815e7b0 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedf2b1640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbed806cf70 con 0x7fbed80d1d70 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed8145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed8145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37696/0 (socket says 172.21.15.120:37696) 2024-03-31T16:36:26.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 -- 172.21.15.120:0/1215257182 learned_addr learned my addr 172.21.15.120:0/1215257182 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedc84c640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbed80d1d70 0x7fbed815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd84e640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbed815e7b0 0x7fbed815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 -- 172.21.15.120:0/1215257182 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbed80d1d70 msgr2=0x7fbed815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbed80d1d70 0x7fbed815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 -- 172.21.15.120:0/1215257182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbed815e7b0 msgr2=0x7fbed815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbed815e7b0 0x7fbed815dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 -- 172.21.15.120:0/1215257182 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed815f880 con 0x7fbed80c7810 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedd04d640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed8145b70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c3c0 tx=0x7fbec800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbecdffb640 1 -- 172.21.15.120:0/1215257182 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec80052d0 con 0x7fbed80c7810 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbecdffb640 1 -- 172.21.15.120:0/1215257182 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec8005490 con 0x7fbed80c7810 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed8160120 con 0x7fbed80c7810 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.960+0000 7fbecdffb640 1 -- 172.21.15.120:0/1215257182 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8007260 con 0x7fbed80c7810 2024-03-31T16:36:26.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.961+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed81606e0 con 0x7fbed80c7810 2024-03-31T16:36:26.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.962+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed8068cd0 con 0x7fbed80c7810 2024-03-31T16:36:26.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.962+0000 7fbecdffb640 1 -- 172.21.15.120:0/1215257182 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbec8007400 con 0x7fbed80c7810 2024-03-31T16:36:26.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.962+0000 7fbecdffb640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbebc06c8f0 0x7fbebc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:26.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.962+0000 7fbecdffb640 1 -- 172.21.15.120:0/1215257182 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbec808b050 con 0x7fbed80c7810 2024-03-31T16:36:26.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.962+0000 7fbedc84c640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbebc06c8f0 0x7fbebc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:26.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.963+0000 7fbedc84c640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbebc06c8f0 0x7fbebc06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbed4036000 tx=0x7fbed403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:26.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:26.967+0000 7fbecdffb640 1 -- 172.21.15.120:0/1215257182 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbec8059480 con 0x7fbed80c7810 2024-03-31T16:36:27.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.140+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbed80c71a0 con 0x7fbebc06c8f0 2024-03-31T16:36:27.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.146+0000 7fbecdffb640 1 -- 172.21.15.120:0/1215257182 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251879 (secure 0 0 0) 0x7fbed80c71a0 con 0x7fbebc06c8f0 2024-03-31T16:36:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:27.153 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbebc06c8f0 msgr2=0x7fbebc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbebc06c8f0 0x7fbebc06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbed4036000 tx=0x7fbed403b040 comp rx=0 tx=0).stop 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 msgr2=0x7fbed8145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed8145b70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c3c0 tx=0x7fbec800c880 comp rx=0 tx=0).stop 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 shutdown_connections 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbebc06c8f0 0x7fbebc06edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbed815e7b0 0x7fbed815dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbed80d1d70 0x7fbed815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 --2- 172.21.15.120:0/1215257182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbed80c7810 0x7fbed8145b70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 >> 172.21.15.120:0/1215257182 conn(0x7fbed80b3e90 msgr2=0x7fbed806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 shutdown_connections 2024-03-31T16:36:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.149+0000 7fbedf2b1640 1 -- 172.21.15.120:0/1215257182 wait complete. 2024-03-31T16:36:27.163 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-03-31T16:36:25.867743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219968,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754752,"statfs":{"total":773094113280,"available":772868866048,"internally_reserved":0,"allocated":3874816,"data_stored":2200928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.058442"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843693+0000","last_change":"2024-03-31T16:36:23.841757+0000","last_active":"2024-03-31T16:36:23.843693+0000","last_peered":"2024-03-31T16:36:23.843693+0000","last_clean":"2024-03-31T16:36:23.843693+0000","last_became_active":"2024-03-31T16:36:23.841491+0000","last_became_peered":"2024-03-31T16:36:23.841491+0000","last_unstale":"2024-03-31T16:36:23.843693+0000","last_undegraded":"2024-03-31T16:36:23.843693+0000","last_fullsized":"2024-03-31T16:36:23.843693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:35.523636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.835563+0000","last_change":"2024-03-31T16:36:23.831671+0000","last_active":"2024-03-31T16:36:23.835563+0000","last_peered":"2024-03-31T16:36:23.835563+0000","last_clean":"2024-03-31T16:36:23.835563+0000","last_became_active":"2024-03-31T16:36:23.831377+0000","last_became_peered":"2024-03-31T16:36:23.831377+0000","last_unstale":"2024-03-31T16:36:23.835563+0000","last_undegraded":"2024-03-31T16:36:23.835563+0000","last_fullsized":"2024-03-31T16:36:23.835563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:09:02.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851458+0000","last_change":"2024-03-31T16:36:23.846672+0000","last_active":"2024-03-31T16:36:23.851458+0000","last_peered":"2024-03-31T16:36:23.851458+0000","last_clean":"2024-03-31T16:36:23.851458+0000","last_became_active":"2024-03-31T16:36:23.846378+0000","last_became_peered":"2024-03-31T16:36:23.846378+0000","last_unstale":"2024-03-31T16:36:23.851458+0000","last_undegraded":"2024-03-31T16:36:23.851458+0000","last_fullsized":"2024-03-31T16:36:23.851458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:51.820689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844821+0000","last_change":"2024-03-31T16:36:23.841463+0000","last_active":"2024-03-31T16:36:23.844821+0000","last_peered":"2024-03-31T16:36:23.844821+0000","last_clean":"2024-03-31T16:36:23.844821+0000","last_became_active":"2024-03-31T16:36:23.841141+0000","last_became_peered":"2024-03-31T16:36:23.841141+0000","last_unstale":"2024-03-31T16:36:23.844821+0000","last_undegraded":"2024-03-31T16:36:23.844821+0000","last_fullsized":"2024-03-31T16:36:23.844821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:29.030713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843492+0000","last_change":"2024-03-31T16:36:23.835288+0000","last_active":"2024-03-31T16:36:23.843492+0000","last_peered":"2024-03-31T16:36:23.843492+0000","last_clean":"2024-03-31T16:36:23.843492+0000","last_became_active":"2024-03-31T16:36:23.835028+0000","last_became_peered":"2024-03-31T16:36:23.835028+0000","last_unstale":"2024-03-31T16:36:23.843492+0000","last_undegraded":"2024-03-31T16:36:23.843492+0000","last_fullsized":"2024-03-31T16:36:23.843492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:15:52.541264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.835462+0000","last_change":"2024-03-31T16:36:23.831288+0000","last_active":"2024-03-31T16:36:23.835462+0000","last_peered":"2024-03-31T16:36:23.835462+0000","last_clean":"2024-03-31T16:36:23.835462+0000","last_became_active":"2024-03-31T16:36:23.830987+0000","last_became_peered":"2024-03-31T16:36:23.830987+0000","last_unstale":"2024-03-31T16:36:23.835462+0000","last_undegraded":"2024-03-31T16:36:23.835462+0000","last_fullsized":"2024-03-31T16:36:23.835462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:40:51.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843916+0000","last_change":"2024-03-31T16:36:23.839092+0000","last_active":"2024-03-31T16:36:23.843916+0000","last_peered":"2024-03-31T16:36:23.843916+0000","last_clean":"2024-03-31T16:36:23.843916+0000","last_became_active":"2024-03-31T16:36:23.838832+0000","last_became_peered":"2024-03-31T16:36:23.838832+0000","last_unstale":"2024-03-31T16:36:23.843916+0000","last_undegraded":"2024-03-31T16:36:23.843916+0000","last_fullsized":"2024-03-31T16:36:23.843916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:51.725570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842729+0000","last_change":"2024-03-31T16:36:23.836840+0000","last_active":"2024-03-31T16:36:23.842729+0000","last_peered":"2024-03-31T16:36:23.842729+0000","last_clean":"2024-03-31T16:36:23.842729+0000","last_became_active":"2024-03-31T16:36:23.835954+0000","last_became_peered":"2024-03-31T16:36:23.835954+0000","last_unstale":"2024-03-31T16:36:23.842729+0000","last_undegraded":"2024-03-31T16:36:23.842729+0000","last_fullsized":"2024-03-31T16:36:23.842729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:56:22.845670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841592+0000","last_change":"2024-03-31T16:36:23.838560+0000","last_active":"2024-03-31T16:36:23.841592+0000","last_peered":"2024-03-31T16:36:23.841592+0000","last_clean":"2024-03-31T16:36:23.841592+0000","last_became_active":"2024-03-31T16:36:23.838289+0000","last_became_peered":"2024-03-31T16:36:23.838289+0000","last_unstale":"2024-03-31T16:36:23.841592+0000","last_undegraded":"2024-03-31T16:36:23.841592+0000","last_fullsized":"2024-03-31T16:36:23.841592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848676+0000","last_change":"2024-03-31T16:36:23.844556+0000","last_active":"2024-03-31T16:36:23.848676+0000","last_peered":"2024-03-31T16:36:23.848676+0000","last_clean":"2024-03-31T16:36:23.848676+0000","last_became_active":"2024-03-31T16:36:23.843151+0000","last_became_peered":"2024-03-31T16:36:23.843151+0000","last_unstale":"2024-03-31T16:36:23.848676+0000","last_undegraded":"2024-03-31T16:36:23.848676+0000","last_fullsized":"2024-03-31T16:36:23.848676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:56:22.845670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844068+0000","last_change":"2024-03-31T16:36:23.840593+0000","last_active":"2024-03-31T16:36:23.844068+0000","last_peered":"2024-03-31T16:36:23.844068+0000","last_clean":"2024-03-31T16:36:23.844068+0000","last_became_active":"2024-03-31T16:36:23.840314+0000","last_became_peered":"2024-03-31T16:36:23.840314+0000","last_unstale":"2024-03-31T16:36:23.844068+0000","last_undegraded":"2024-03-31T16:36:23.844068+0000","last_fullsized":"2024-03-31T16:36:23.844068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:21:23.168930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.840292+0000","last_change":"2024-03-31T16:36:23.837068+0000","last_active":"2024-03-31T16:36:23.840292+0000","last_peered":"2024-03-31T16:36:23.840292+0000","last_clean":"2024-03-31T16:36:23.840292+0000","last_became_active":"2024-03-31T16:36:23.836786+0000","last_became_peered":"2024-03-31T16:36:23.836786+0000","last_unstale":"2024-03-31T16:36:23.840292+0000","last_undegraded":"2024-03-31T16:36:23.840292+0000","last_fullsized":"2024-03-31T16:36:23.840292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:31:07.285772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.846087+0000","last_change":"2024-03-31T16:36:23.843361+0000","last_active":"2024-03-31T16:36:23.846087+0000","last_peered":"2024-03-31T16:36:23.846087+0000","last_clean":"2024-03-31T16:36:23.846087+0000","last_became_active":"2024-03-31T16:36:23.842008+0000","last_became_peered":"2024-03-31T16:36:23.842008+0000","last_unstale":"2024-03-31T16:36:23.846087+0000","last_undegraded":"2024-03-31T16:36:23.846087+0000","last_fullsized":"2024-03-31T16:36:23.846087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:53:18.202584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848840+0000","last_change":"2024-03-31T16:36:23.841244+0000","last_active":"2024-03-31T16:36:23.848840+0000","last_peered":"2024-03-31T16:36:23.848840+0000","last_clean":"2024-03-31T16:36:23.848840+0000","last_became_active":"2024-03-31T16:36:23.840960+0000","last_became_peered":"2024-03-31T16:36:23.840960+0000","last_unstale":"2024-03-31T16:36:23.848840+0000","last_undegraded":"2024-03-31T16:36:23.848840+0000","last_fullsized":"2024-03-31T16:36:23.848840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:49:40.034045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841122+0000","last_change":"2024-03-31T16:36:23.838910+0000","last_active":"2024-03-31T16:36:23.841122+0000","last_peered":"2024-03-31T16:36:23.841122+0000","last_clean":"2024-03-31T16:36:23.841122+0000","last_became_active":"2024-03-31T16:36:23.838645+0000","last_became_peered":"2024-03-31T16:36:23.838645+0000","last_unstale":"2024-03-31T16:36:23.841122+0000","last_undegraded":"2024-03-31T16:36:23.841122+0000","last_fullsized":"2024-03-31T16:36:23.841122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:40:51.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844134+0000","last_change":"2024-03-31T16:36:23.842320+0000","last_active":"2024-03-31T16:36:23.844134+0000","last_peered":"2024-03-31T16:36:23.844134+0000","last_clean":"2024-03-31T16:36:23.844134+0000","last_became_active":"2024-03-31T16:36:23.842036+0000","last_became_peered":"2024-03-31T16:36:23.842036+0000","last_unstale":"2024-03-31T16:36:23.844134+0000","last_undegraded":"2024-03-31T16:36:23.844134+0000","last_fullsized":"2024-03-31T16:36:23.844134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T21:40:51.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843901+0000","last_change":"2024-03-31T16:36:23.839080+0000","last_active":"2024-03-31T16:36:23.843901+0000","last_peered":"2024-03-31T16:36:23.843901+0000","last_clean":"2024-03-31T16:36:23.843901+0000","last_became_active":"2024-03-31T16:36:23.838820+0000","last_became_peered":"2024-03-31T16:36:23.838820+0000","last_unstale":"2024-03-31T16:36:23.843901+0000","last_undegraded":"2024-03-31T16:36:23.843901+0000","last_fullsized":"2024-03-31T16:36:23.843901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848884+0000","last_change":"2024-03-31T16:36:23.845276+0000","last_active":"2024-03-31T16:36:23.848884+0000","last_peered":"2024-03-31T16:36:23.848884+0000","last_clean":"2024-03-31T16:36:23.848884+0000","last_became_active":"2024-03-31T16:36:23.844816+0000","last_became_peered":"2024-03-31T16:36:23.844816+0000","last_unstale":"2024-03-31T16:36:23.848884+0000","last_undegraded":"2024-03-31T16:36:23.848884+0000","last_fullsized":"2024-03-31T16:36:23.848884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:38:49.525305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.847560+0000","last_change":"2024-03-31T16:36:23.841027+0000","last_active":"2024-03-31T16:36:23.847560+0000","last_peered":"2024-03-31T16:36:23.847560+0000","last_clean":"2024-03-31T16:36:23.847560+0000","last_became_active":"2024-03-31T16:36:23.840771+0000","last_became_peered":"2024-03-31T16:36:23.840771+0000","last_unstale":"2024-03-31T16:36:23.847560+0000","last_undegraded":"2024-03-31T16:36:23.847560+0000","last_fullsized":"2024-03-31T16:36:23.847560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:40:06.482507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.839572+0000","last_change":"2024-03-31T16:36:23.832399+0000","last_active":"2024-03-31T16:36:23.839572+0000","last_peered":"2024-03-31T16:36:23.839572+0000","last_clean":"2024-03-31T16:36:23.839572+0000","last_became_active":"2024-03-31T16:36:23.832123+0000","last_became_peered":"2024-03-31T16:36:23.832123+0000","last_unstale":"2024-03-31T16:36:23.839572+0000","last_undegraded":"2024-03-31T16:36:23.839572+0000","last_fullsized":"2024-03-31T16:36:23.839572+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:27:57.336668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838941+0000","last_change":"2024-03-31T16:36:23.834849+0000","last_active":"2024-03-31T16:36:23.838941+0000","last_peered":"2024-03-31T16:36:23.838941+0000","last_clean":"2024-03-31T16:36:23.838941+0000","last_became_active":"2024-03-31T16:36:23.834519+0000","last_became_peered":"2024-03-31T16:36:23.834519+0000","last_unstale":"2024-03-31T16:36:23.838941+0000","last_undegraded":"2024-03-31T16:36:23.838941+0000","last_fullsized":"2024-03-31T16:36:23.838941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:44:30.994346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838783+0000","last_change":"2024-03-31T16:36:23.836361+0000","last_active":"2024-03-31T16:36:23.838783+0000","last_peered":"2024-03-31T16:36:23.838783+0000","last_clean":"2024-03-31T16:36:23.838783+0000","last_became_active":"2024-03-31T16:36:23.835604+0000","last_became_peered":"2024-03-31T16:36:23.835604+0000","last_unstale":"2024-03-31T16:36:23.838783+0000","last_undegraded":"2024-03-31T16:36:23.838783+0000","last_fullsized":"2024-03-31T16:36:23.838783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:48.492958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.837995+0000","last_change":"2024-03-31T16:36:23.835420+0000","last_active":"2024-03-31T16:36:23.837995+0000","last_peered":"2024-03-31T16:36:23.837995+0000","last_clean":"2024-03-31T16:36:23.837995+0000","last_became_active":"2024-03-31T16:36:23.835141+0000","last_became_peered":"2024-03-31T16:36:23.835141+0000","last_unstale":"2024-03-31T16:36:23.837995+0000","last_undegraded":"2024-03-31T16:36:23.837995+0000","last_fullsized":"2024-03-31T16:36:23.837995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:56:22.845670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838148+0000","last_change":"2024-03-31T16:36:23.833949+0000","last_active":"2024-03-31T16:36:23.838148+0000","last_peered":"2024-03-31T16:36:23.838148+0000","last_clean":"2024-03-31T16:36:23.838148+0000","last_became_active":"2024-03-31T16:36:23.833423+0000","last_became_peered":"2024-03-31T16:36:23.833423+0000","last_unstale":"2024-03-31T16:36:23.838148+0000","last_undegraded":"2024-03-31T16:36:23.838148+0000","last_fullsized":"2024-03-31T16:36:23.838148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:21:23.168930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848712+0000","last_change":"2024-03-31T16:36:23.844866+0000","last_active":"2024-03-31T16:36:23.848712+0000","last_peered":"2024-03-31T16:36:23.848712+0000","last_clean":"2024-03-31T16:36:23.848712+0000","last_became_active":"2024-03-31T16:36:23.842947+0000","last_became_peered":"2024-03-31T16:36:23.842947+0000","last_unstale":"2024-03-31T16:36:23.848712+0000","last_undegraded":"2024-03-31T16:36:23.848712+0000","last_fullsized":"2024-03-31T16:36:23.848712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:48.492958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841555+0000","last_change":"2024-03-31T16:36:23.836073+0000","last_active":"2024-03-31T16:36:23.841555+0000","last_peered":"2024-03-31T16:36:23.841555+0000","last_clean":"2024-03-31T16:36:23.841555+0000","last_became_active":"2024-03-31T16:36:23.835818+0000","last_became_peered":"2024-03-31T16:36:23.835818+0000","last_unstale":"2024-03-31T16:36:23.841555+0000","last_undegraded":"2024-03-31T16:36:23.841555+0000","last_fullsized":"2024-03-31T16:36:23.841555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:13:01.572970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849867+0000","last_change":"2024-03-31T16:36:23.845879+0000","last_active":"2024-03-31T16:36:23.849867+0000","last_peered":"2024-03-31T16:36:23.849867+0000","last_clean":"2024-03-31T16:36:23.849867+0000","last_became_active":"2024-03-31T16:36:23.845630+0000","last_became_peered":"2024-03-31T16:36:23.845630+0000","last_unstale":"2024-03-31T16:36:23.849867+0000","last_undegraded":"2024-03-31T16:36:23.849867+0000","last_fullsized":"2024-03-31T16:36:23.849867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:51.725570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.837874+0000","last_change":"2024-03-31T16:36:23.831929+0000","last_active":"2024-03-31T16:36:23.837874+0000","last_peered":"2024-03-31T16:36:23.837874+0000","last_clean":"2024-03-31T16:36:23.837874+0000","last_became_active":"2024-03-31T16:36:23.831647+0000","last_became_peered":"2024-03-31T16:36:23.831647+0000","last_unstale":"2024-03-31T16:36:23.837874+0000","last_undegraded":"2024-03-31T16:36:23.837874+0000","last_fullsized":"2024-03-31T16:36:23.837874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:51.725570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838979+0000","last_change":"2024-03-31T16:36:23.835848+0000","last_active":"2024-03-31T16:36:23.838979+0000","last_peered":"2024-03-31T16:36:23.838979+0000","last_clean":"2024-03-31T16:36:23.838979+0000","last_became_active":"2024-03-31T16:36:23.835582+0000","last_became_peered":"2024-03-31T16:36:23.835582+0000","last_unstale":"2024-03-31T16:36:23.838979+0000","last_undegraded":"2024-03-31T16:36:23.838979+0000","last_fullsized":"2024-03-31T16:36:23.838979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:56:22.845670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842873+0000","last_change":"2024-03-31T16:36:23.838642+0000","last_active":"2024-03-31T16:36:23.842873+0000","last_peered":"2024-03-31T16:36:23.842873+0000","last_clean":"2024-03-31T16:36:23.842873+0000","last_became_active":"2024-03-31T16:36:23.838315+0000","last_became_peered":"2024-03-31T16:36:23.838315+0000","last_unstale":"2024-03-31T16:36:23.842873+0000","last_undegraded":"2024-03-31T16:36:23.842873+0000","last_fullsized":"2024-03-31T16:36:23.842873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:48.492958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848868+0000","last_change":"2024-03-31T16:36:23.844794+0000","last_active":"2024-03-31T16:36:23.848868+0000","last_peered":"2024-03-31T16:36:23.848868+0000","last_clean":"2024-03-31T16:36:23.848868+0000","last_became_active":"2024-03-31T16:36:23.844468+0000","last_became_peered":"2024-03-31T16:36:23.844468+0000","last_unstale":"2024-03-31T16:36:23.848868+0000","last_undegraded":"2024-03-31T16:36:23.848868+0000","last_fullsized":"2024-03-31T16:36:23.848868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:29.030713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844116+0000","last_change":"2024-03-31T16:36:23.840851+0000","last_active":"2024-03-31T16:36:23.844116+0000","last_peered":"2024-03-31T16:36:23.844116+0000","last_clean":"2024-03-31T16:36:23.844116+0000","last_became_active":"2024-03-31T16:36:23.840512+0000","last_became_peered":"2024-03-31T16:36:23.840512+0000","last_unstale":"2024-03-31T16:36:23.844116+0000","last_undegraded":"2024-03-31T16:36:23.844116+0000","last_fullsized":"2024-03-31T16:36:23.844116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:31:07.285772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838043+0000","last_change":"2024-03-31T16:36:23.836408+0000","last_active":"2024-03-31T16:36:23.838043+0000","last_peered":"2024-03-31T16:36:23.838043+0000","last_clean":"2024-03-31T16:36:23.838043+0000","last_became_active":"2024-03-31T16:36:23.836145+0000","last_became_peered":"2024-03-31T16:36:23.836145+0000","last_unstale":"2024-03-31T16:36:23.838043+0000","last_undegraded":"2024-03-31T16:36:23.838043+0000","last_fullsized":"2024-03-31T16:36:23.838043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:48.492958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842077+0000","last_change":"2024-03-31T16:36:22.833601+0000","last_active":"2024-03-31T16:36:23.842077+0000","last_peered":"2024-03-31T16:36:23.842077+0000","last_clean":"2024-03-31T16:36:23.842077+0000","last_became_active":"2024-03-31T16:36:22.833336+0000","last_became_peered":"2024-03-31T16:36:22.833336+0000","last_unstale":"2024-03-31T16:36:23.842077+0000","last_undegraded":"2024-03-31T16:36:23.842077+0000","last_fullsized":"2024-03-31T16:36:23.842077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:03:58.123187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848437+0000","last_change":"2024-03-31T16:36:23.842649+0000","last_active":"2024-03-31T16:36:23.848437+0000","last_peered":"2024-03-31T16:36:23.848437+0000","last_clean":"2024-03-31T16:36:23.848437+0000","last_became_active":"2024-03-31T16:36:23.842317+0000","last_became_peered":"2024-03-31T16:36:23.842317+0000","last_unstale":"2024-03-31T16:36:23.848437+0000","last_undegraded":"2024-03-31T16:36:23.848437+0000","last_fullsized":"2024-03-31T16:36:23.848437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:44:30.994346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841794+0000","last_change":"2024-03-31T16:36:22.841319+0000","last_active":"2024-03-31T16:36:23.841794+0000","last_peered":"2024-03-31T16:36:23.841794+0000","last_clean":"2024-03-31T16:36:23.841794+0000","last_became_active":"2024-03-31T16:36:22.840902+0000","last_became_peered":"2024-03-31T16:36:22.840902+0000","last_unstale":"2024-03-31T16:36:23.841794+0000","last_undegraded":"2024-03-31T16:36:23.841794+0000","last_fullsized":"2024-03-31T16:36:23.841794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:04:22.471640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841640+0000","last_change":"2024-03-31T16:36:23.836777+0000","last_active":"2024-03-31T16:36:23.841640+0000","last_peered":"2024-03-31T16:36:23.841640+0000","last_clean":"2024-03-31T16:36:23.841640+0000","last_became_active":"2024-03-31T16:36:23.836521+0000","last_became_peered":"2024-03-31T16:36:23.836521+0000","last_unstale":"2024-03-31T16:36:23.841640+0000","last_undegraded":"2024-03-31T16:36:23.841640+0000","last_fullsized":"2024-03-31T16:36:23.841640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:19.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.847505+0000","last_change":"2024-03-31T16:36:22.837401+0000","last_active":"2024-03-31T16:36:23.847505+0000","last_peered":"2024-03-31T16:36:23.847505+0000","last_clean":"2024-03-31T16:36:23.847505+0000","last_became_active":"2024-03-31T16:36:22.837097+0000","last_became_peered":"2024-03-31T16:36:22.837097+0000","last_unstale":"2024-03-31T16:36:23.847505+0000","last_undegraded":"2024-03-31T16:36:23.847505+0000","last_fullsized":"2024-03-31T16:36:23.847505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:18.008059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849891+0000","last_change":"2024-03-31T16:36:23.845970+0000","last_active":"2024-03-31T16:36:23.849891+0000","last_peered":"2024-03-31T16:36:23.849891+0000","last_clean":"2024-03-31T16:36:23.849891+0000","last_became_active":"2024-03-31T16:36:23.845614+0000","last_became_peered":"2024-03-31T16:36:23.845614+0000","last_unstale":"2024-03-31T16:36:23.849891+0000","last_undegraded":"2024-03-31T16:36:23.849891+0000","last_fullsized":"2024-03-31T16:36:23.849891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:12:24.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843138+0000","last_change":"2024-03-31T16:36:22.831209+0000","last_active":"2024-03-31T16:36:23.843138+0000","last_peered":"2024-03-31T16:36:23.843138+0000","last_clean":"2024-03-31T16:36:23.843138+0000","last_became_active":"2024-03-31T16:36:22.830965+0000","last_became_peered":"2024-03-31T16:36:22.830965+0000","last_unstale":"2024-03-31T16:36:23.843138+0000","last_undegraded":"2024-03-31T16:36:23.843138+0000","last_fullsized":"2024-03-31T16:36:23.843138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:08:31.842551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844011+0000","last_change":"2024-03-31T16:36:23.839787+0000","last_active":"2024-03-31T16:36:23.844011+0000","last_peered":"2024-03-31T16:36:23.844011+0000","last_clean":"2024-03-31T16:36:23.844011+0000","last_became_active":"2024-03-31T16:36:23.839538+0000","last_became_peered":"2024-03-31T16:36:23.839538+0000","last_unstale":"2024-03-31T16:36:23.844011+0000","last_undegraded":"2024-03-31T16:36:23.844011+0000","last_fullsized":"2024-03-31T16:36:23.844011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:12:24.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842021+0000","last_change":"2024-03-31T16:36:22.839238+0000","last_active":"2024-03-31T16:36:23.842021+0000","last_peered":"2024-03-31T16:36:23.842021+0000","last_clean":"2024-03-31T16:36:23.842021+0000","last_became_active":"2024-03-31T16:36:22.838973+0000","last_became_peered":"2024-03-31T16:36:22.838973+0000","last_unstale":"2024-03-31T16:36:23.842021+0000","last_undegraded":"2024-03-31T16:36:23.842021+0000","last_fullsized":"2024-03-31T16:36:23.842021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:07:00.927777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838186+0000","last_change":"2024-03-31T16:36:23.834834+0000","last_active":"2024-03-31T16:36:23.838186+0000","last_peered":"2024-03-31T16:36:23.838186+0000","last_clean":"2024-03-31T16:36:23.838186+0000","last_became_active":"2024-03-31T16:36:23.834554+0000","last_became_peered":"2024-03-31T16:36:23.834554+0000","last_unstale":"2024-03-31T16:36:23.838186+0000","last_undegraded":"2024-03-31T16:36:23.838186+0000","last_fullsized":"2024-03-31T16:36:23.838186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:51:29.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841982+0000","last_change":"2024-03-31T16:36:22.839379+0000","last_active":"2024-03-31T16:36:23.841982+0000","last_peered":"2024-03-31T16:36:23.841982+0000","last_clean":"2024-03-31T16:36:23.841982+0000","last_became_active":"2024-03-31T16:36:22.839048+0000","last_became_peered":"2024-03-31T16:36:22.839048+0000","last_unstale":"2024-03-31T16:36:23.841982+0000","last_undegraded":"2024-03-31T16:36:23.841982+0000","last_fullsized":"2024-03-31T16:36:23.841982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:14:29.111460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841663+0000","last_change":"2024-03-31T16:36:23.839629+0000","last_active":"2024-03-31T16:36:23.841663+0000","last_peered":"2024-03-31T16:36:23.841663+0000","last_clean":"2024-03-31T16:36:23.841663+0000","last_became_active":"2024-03-31T16:36:23.838875+0000","last_became_peered":"2024-03-31T16:36:23.838875+0000","last_unstale":"2024-03-31T16:36:23.841663+0000","last_undegraded":"2024-03-31T16:36:23.841663+0000","last_fullsized":"2024-03-31T16:36:23.841663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:51.725570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.824067+0000","last_change":"2024-03-31T16:36:22.834611+0000","last_active":"2024-03-31T16:36:23.824067+0000","last_peered":"2024-03-31T16:36:23.824067+0000","last_clean":"2024-03-31T16:36:23.824067+0000","last_became_active":"2024-03-31T16:36:22.834329+0000","last_became_peered":"2024-03-31T16:36:22.834329+0000","last_unstale":"2024-03-31T16:36:23.824067+0000","last_undegraded":"2024-03-31T16:36:23.824067+0000","last_fullsized":"2024-03-31T16:36:23.824067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:51:28.061010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849800+0000","last_change":"2024-03-31T16:36:23.844918+0000","last_active":"2024-03-31T16:36:23.849800+0000","last_peered":"2024-03-31T16:36:23.849800+0000","last_clean":"2024-03-31T16:36:23.849800+0000","last_became_active":"2024-03-31T16:36:23.844534+0000","last_became_peered":"2024-03-31T16:36:23.844534+0000","last_unstale":"2024-03-31T16:36:23.849800+0000","last_undegraded":"2024-03-31T16:36:23.849800+0000","last_fullsized":"2024-03-31T16:36:23.849800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:19.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823117+0000","last_change":"2024-03-31T16:36:22.834331+0000","last_active":"2024-03-31T16:36:23.823117+0000","last_peered":"2024-03-31T16:36:23.823117+0000","last_clean":"2024-03-31T16:36:23.823117+0000","last_became_active":"2024-03-31T16:36:22.834063+0000","last_became_peered":"2024-03-31T16:36:22.834063+0000","last_unstale":"2024-03-31T16:36:23.823117+0000","last_undegraded":"2024-03-31T16:36:23.823117+0000","last_fullsized":"2024-03-31T16:36:23.823117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:12.967125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.837815+0000","last_change":"2024-03-31T16:36:23.830814+0000","last_active":"2024-03-31T16:36:23.837815+0000","last_peered":"2024-03-31T16:36:23.837815+0000","last_clean":"2024-03-31T16:36:23.837815+0000","last_became_active":"2024-03-31T16:36:23.830475+0000","last_became_peered":"2024-03-31T16:36:23.830475+0000","last_unstale":"2024-03-31T16:36:23.837815+0000","last_undegraded":"2024-03-31T16:36:23.837815+0000","last_fullsized":"2024-03-31T16:36:23.837815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823417+0000","last_change":"2024-03-31T16:36:22.841405+0000","last_active":"2024-03-31T16:36:23.823417+0000","last_peered":"2024-03-31T16:36:23.823417+0000","last_clean":"2024-03-31T16:36:23.823417+0000","last_became_active":"2024-03-31T16:36:22.841094+0000","last_became_peered":"2024-03-31T16:36:22.841094+0000","last_unstale":"2024-03-31T16:36:23.823417+0000","last_undegraded":"2024-03-31T16:36:23.823417+0000","last_fullsized":"2024-03-31T16:36:23.823417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:12:23.937159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841864+0000","last_change":"2024-03-31T16:36:23.838995+0000","last_active":"2024-03-31T16:36:23.841864+0000","last_peered":"2024-03-31T16:36:23.841864+0000","last_clean":"2024-03-31T16:36:23.841864+0000","last_became_active":"2024-03-31T16:36:23.838738+0000","last_became_peered":"2024-03-31T16:36:23.838738+0000","last_unstale":"2024-03-31T16:36:23.841864+0000","last_undegraded":"2024-03-31T16:36:23.841864+0000","last_fullsized":"2024-03-31T16:36:23.841864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:38:07.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.821443+0000","last_change":"2024-03-31T16:36:22.829735+0000","last_active":"2024-03-31T16:36:23.821443+0000","last_peered":"2024-03-31T16:36:23.821443+0000","last_clean":"2024-03-31T16:36:23.821443+0000","last_became_active":"2024-03-31T16:36:22.829502+0000","last_became_peered":"2024-03-31T16:36:22.829502+0000","last_unstale":"2024-03-31T16:36:23.821443+0000","last_undegraded":"2024-03-31T16:36:23.821443+0000","last_fullsized":"2024-03-31T16:36:23.821443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:28.028289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841658+0000","last_change":"2024-03-31T16:36:23.836135+0000","last_active":"2024-03-31T16:36:23.841658+0000","last_peered":"2024-03-31T16:36:23.841658+0000","last_clean":"2024-03-31T16:36:23.841658+0000","last_became_active":"2024-03-31T16:36:23.835882+0000","last_became_peered":"2024-03-31T16:36:23.835882+0000","last_unstale":"2024-03-31T16:36:23.841658+0000","last_undegraded":"2024-03-31T16:36:23.841658+0000","last_fullsized":"2024-03-31T16:36:23.841658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T03:00:36.748087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842083+0000","last_change":"2024-03-31T16:36:22.841390+0000","last_active":"2024-03-31T16:36:23.842083+0000","last_peered":"2024-03-31T16:36:23.842083+0000","last_clean":"2024-03-31T16:36:23.842083+0000","last_became_active":"2024-03-31T16:36:22.841001+0000","last_became_peered":"2024-03-31T16:36:22.841001+0000","last_unstale":"2024-03-31T16:36:23.842083+0000","last_undegraded":"2024-03-31T16:36:23.842083+0000","last_fullsized":"2024-03-31T16:36:23.842083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:40:47.490534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851473+0000","last_change":"2024-03-31T16:36:23.846701+0000","last_active":"2024-03-31T16:36:23.851473+0000","last_peered":"2024-03-31T16:36:23.851473+0000","last_clean":"2024-03-31T16:36:23.851473+0000","last_became_active":"2024-03-31T16:36:23.846420+0000","last_became_peered":"2024-03-31T16:36:23.846420+0000","last_unstale":"2024-03-31T16:36:23.851473+0000","last_undegraded":"2024-03-31T16:36:23.851473+0000","last_fullsized":"2024-03-31T16:36:23.851473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:13:01.572970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851919+0000","last_change":"2024-03-31T16:36:22.836980+0000","last_active":"2024-03-31T16:36:23.851919+0000","last_peered":"2024-03-31T16:36:23.851919+0000","last_clean":"2024-03-31T16:36:23.851919+0000","last_became_active":"2024-03-31T16:36:22.836689+0000","last_became_peered":"2024-03-31T16:36:22.836689+0000","last_unstale":"2024-03-31T16:36:23.851919+0000","last_undegraded":"2024-03-31T16:36:23.851919+0000","last_fullsized":"2024-03-31T16:36:23.851919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:31:06.283348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849903+0000","last_change":"2024-03-31T16:36:23.845825+0000","last_active":"2024-03-31T16:36:23.849903+0000","last_peered":"2024-03-31T16:36:23.849903+0000","last_clean":"2024-03-31T16:36:23.849903+0000","last_became_active":"2024-03-31T16:36:23.845576+0000","last_became_peered":"2024-03-31T16:36:23.845576+0000","last_unstale":"2024-03-31T16:36:23.849903+0000","last_undegraded":"2024-03-31T16:36:23.849903+0000","last_fullsized":"2024-03-31T16:36:23.849903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841534+0000","last_change":"2024-03-31T16:36:22.835088+0000","last_active":"2024-03-31T16:36:23.841534+0000","last_peered":"2024-03-31T16:36:23.841534+0000","last_clean":"2024-03-31T16:36:23.841534+0000","last_became_active":"2024-03-31T16:36:22.834783+0000","last_became_peered":"2024-03-31T16:36:22.834783+0000","last_unstale":"2024-03-31T16:36:23.841534+0000","last_undegraded":"2024-03-31T16:36:23.841534+0000","last_fullsized":"2024-03-31T16:36:23.841534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:14:32.483271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.839130+0000","last_change":"2024-03-31T16:36:23.833239+0000","last_active":"2024-03-31T16:36:23.839130+0000","last_peered":"2024-03-31T16:36:23.839130+0000","last_clean":"2024-03-31T16:36:23.839130+0000","last_became_active":"2024-03-31T16:36:23.832791+0000","last_became_peered":"2024-03-31T16:36:23.832791+0000","last_unstale":"2024-03-31T16:36:23.839130+0000","last_undegraded":"2024-03-31T16:36:23.839130+0000","last_fullsized":"2024-03-31T16:36:23.839130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:30:51.820689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823126+0000","last_change":"2024-03-31T16:36:22.834884+0000","last_active":"2024-03-31T16:36:23.823126+0000","last_peered":"2024-03-31T16:36:23.823126+0000","last_clean":"2024-03-31T16:36:23.823126+0000","last_became_active":"2024-03-31T16:36:22.833985+0000","last_became_peered":"2024-03-31T16:36:22.833985+0000","last_unstale":"2024-03-31T16:36:23.823126+0000","last_undegraded":"2024-03-31T16:36:23.823126+0000","last_fullsized":"2024-03-31T16:36:23.823126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:14:32.483271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844078+0000","last_change":"2024-03-31T16:36:23.841228+0000","last_active":"2024-03-31T16:36:23.844078+0000","last_peered":"2024-03-31T16:36:23.844078+0000","last_clean":"2024-03-31T16:36:23.844078+0000","last_became_active":"2024-03-31T16:36:23.840969+0000","last_became_peered":"2024-03-31T16:36:23.840969+0000","last_unstale":"2024-03-31T16:36:23.844078+0000","last_undegraded":"2024-03-31T16:36:23.844078+0000","last_fullsized":"2024-03-31T16:36:23.844078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:51:29.063434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823932+0000","last_change":"2024-03-31T16:36:22.841598+0000","last_active":"2024-03-31T16:36:23.823932+0000","last_peered":"2024-03-31T16:36:23.823932+0000","last_clean":"2024-03-31T16:36:23.823932+0000","last_became_active":"2024-03-31T16:36:22.841187+0000","last_became_peered":"2024-03-31T16:36:22.841187+0000","last_unstale":"2024-03-31T16:36:23.823932+0000","last_undegraded":"2024-03-31T16:36:23.823932+0000","last_fullsized":"2024-03-31T16:36:23.823932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:21:22.166507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.848431+0000","last_change":"2024-03-31T16:36:23.842635+0000","last_active":"2024-03-31T16:36:23.848431+0000","last_peered":"2024-03-31T16:36:23.848431+0000","last_clean":"2024-03-31T16:36:23.848431+0000","last_became_active":"2024-03-31T16:36:23.842299+0000","last_became_peered":"2024-03-31T16:36:23.842299+0000","last_unstale":"2024-03-31T16:36:23.848431+0000","last_undegraded":"2024-03-31T16:36:23.848431+0000","last_fullsized":"2024-03-31T16:36:23.848431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:04:23.474063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.846117+0000","last_change":"2024-03-31T16:36:22.837012+0000","last_active":"2024-03-31T16:36:23.846117+0000","last_peered":"2024-03-31T16:36:23.846117+0000","last_clean":"2024-03-31T16:36:23.846117+0000","last_became_active":"2024-03-31T16:36:22.836736+0000","last_became_peered":"2024-03-31T16:36:22.836736+0000","last_unstale":"2024-03-31T16:36:23.846117+0000","last_undegraded":"2024-03-31T16:36:23.846117+0000","last_fullsized":"2024-03-31T16:36:23.846117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:05:50.723146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.830799+0000","last_change":"2024-03-31T16:36:23.826725+0000","last_active":"2024-03-31T16:36:23.830799+0000","last_peered":"2024-03-31T16:36:23.830799+0000","last_clean":"2024-03-31T16:36:23.830799+0000","last_became_active":"2024-03-31T16:36:23.826420+0000","last_became_peered":"2024-03-31T16:36:23.826420+0000","last_unstale":"2024-03-31T16:36:23.830799+0000","last_undegraded":"2024-03-31T16:36:23.830799+0000","last_fullsized":"2024-03-31T16:36:23.830799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:04:23.474063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849902+0000","last_change":"2024-03-31T16:36:22.839342+0000","last_active":"2024-03-31T16:36:23.849902+0000","last_peered":"2024-03-31T16:36:23.849902+0000","last_clean":"2024-03-31T16:36:23.849902+0000","last_became_active":"2024-03-31T16:36:22.839053+0000","last_became_peered":"2024-03-31T16:36:22.839053+0000","last_unstale":"2024-03-31T16:36:23.849902+0000","last_undegraded":"2024-03-31T16:36:23.849902+0000","last_fullsized":"2024-03-31T16:36:23.849902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:13.234390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.838189+0000","last_change":"2024-03-31T16:36:23.832223+0000","last_active":"2024-03-31T16:36:23.838189+0000","last_peered":"2024-03-31T16:36:23.838189+0000","last_clean":"2024-03-31T16:36:23.838189+0000","last_became_active":"2024-03-31T16:36:23.831139+0000","last_became_peered":"2024-03-31T16:36:23.831139+0000","last_unstale":"2024-03-31T16:36:23.838189+0000","last_undegraded":"2024-03-31T16:36:23.838189+0000","last_fullsized":"2024-03-31T16:36:23.838189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:12:24.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.840508+0000","last_change":"2024-03-31T16:36:22.835128+0000","last_active":"2024-03-31T16:36:23.840508+0000","last_peered":"2024-03-31T16:36:23.840508+0000","last_clean":"2024-03-31T16:36:23.840508+0000","last_became_active":"2024-03-31T16:36:22.834796+0000","last_became_peered":"2024-03-31T16:36:22.834796+0000","last_unstale":"2024-03-31T16:36:23.840508+0000","last_undegraded":"2024-03-31T16:36:23.840508+0000","last_fullsized":"2024-03-31T16:36:23.840508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:53:17.200161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844718+0000","last_change":"2024-03-31T16:36:23.840576+0000","last_active":"2024-03-31T16:36:23.844718+0000","last_peered":"2024-03-31T16:36:23.844718+0000","last_clean":"2024-03-31T16:36:23.844718+0000","last_became_active":"2024-03-31T16:36:23.840261+0000","last_became_peered":"2024-03-31T16:36:23.840261+0000","last_unstale":"2024-03-31T16:36:23.844718+0000","last_undegraded":"2024-03-31T16:36:23.844718+0000","last_fullsized":"2024-03-31T16:36:23.844718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:44:30.994346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841457+0000","last_change":"2024-03-31T16:36:22.832438+0000","last_active":"2024-03-31T16:36:23.841457+0000","last_peered":"2024-03-31T16:36:23.841457+0000","last_clean":"2024-03-31T16:36:23.841457+0000","last_became_active":"2024-03-31T16:36:22.832144+0000","last_became_peered":"2024-03-31T16:36:22.832144+0000","last_unstale":"2024-03-31T16:36:23.841457+0000","last_undegraded":"2024-03-31T16:36:23.841457+0000","last_fullsized":"2024-03-31T16:36:23.841457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:10:29.825587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843117+0000","last_change":"2024-03-31T16:36:23.836203+0000","last_active":"2024-03-31T16:36:23.843117+0000","last_peered":"2024-03-31T16:36:23.843117+0000","last_clean":"2024-03-31T16:36:23.843117+0000","last_became_active":"2024-03-31T16:36:23.835956+0000","last_became_peered":"2024-03-31T16:36:23.835956+0000","last_unstale":"2024-03-31T16:36:23.843117+0000","last_undegraded":"2024-03-31T16:36:23.843117+0000","last_fullsized":"2024-03-31T16:36:23.843117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T02:19:04.943798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823649+0000","last_change":"2024-03-31T16:36:22.836868+0000","last_active":"2024-03-31T16:36:23.823649+0000","last_peered":"2024-03-31T16:36:23.823649+0000","last_clean":"2024-03-31T16:36:23.823649+0000","last_became_active":"2024-03-31T16:36:22.836538+0000","last_became_peered":"2024-03-31T16:36:22.836538+0000","last_unstale":"2024-03-31T16:36:23.823649+0000","last_undegraded":"2024-03-31T16:36:23.823649+0000","last_fullsized":"2024-03-31T16:36:23.823649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:03:58.123187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844040+0000","last_change":"2024-03-31T16:36:23.842704+0000","last_active":"2024-03-31T16:36:23.844040+0000","last_peered":"2024-03-31T16:36:23.844040+0000","last_clean":"2024-03-31T16:36:23.844040+0000","last_became_active":"2024-03-31T16:36:23.842428+0000","last_became_peered":"2024-03-31T16:36:23.842428+0000","last_unstale":"2024-03-31T16:36:23.844040+0000","last_undegraded":"2024-03-31T16:36:23.844040+0000","last_fullsized":"2024-03-31T16:36:23.844040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T01:10:30.828010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.846580+0000","last_change":"2024-03-31T16:36:22.830634+0000","last_active":"2024-03-31T16:36:23.846580+0000","last_peered":"2024-03-31T16:36:23.846580+0000","last_clean":"2024-03-31T16:36:23.846580+0000","last_became_active":"2024-03-31T16:36:22.830383+0000","last_became_peered":"2024-03-31T16:36:22.830383+0000","last_unstale":"2024-03-31T16:36:23.846580+0000","last_undegraded":"2024-03-31T16:36:23.846580+0000","last_fullsized":"2024-03-31T16:36:23.846580+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:34.521212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.844046+0000","last_change":"2024-03-31T16:36:23.839791+0000","last_active":"2024-03-31T16:36:23.844046+0000","last_peered":"2024-03-31T16:36:23.844046+0000","last_clean":"2024-03-31T16:36:23.844046+0000","last_became_active":"2024-03-31T16:36:23.837774+0000","last_became_peered":"2024-03-31T16:36:23.837774+0000","last_unstale":"2024-03-31T16:36:23.844046+0000","last_undegraded":"2024-03-31T16:36:23.844046+0000","last_fullsized":"2024-03-31T16:36:23.844046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T18:37:04.484647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.829193+0000","last_change":"2024-03-31T16:36:22.836965+0000","last_active":"2024-03-31T16:36:23.829193+0000","last_peered":"2024-03-31T16:36:23.829193+0000","last_clean":"2024-03-31T16:36:23.829193+0000","last_became_active":"2024-03-31T16:36:22.836731+0000","last_became_peered":"2024-03-31T16:36:22.836731+0000","last_unstale":"2024-03-31T16:36:23.829193+0000","last_undegraded":"2024-03-31T16:36:23.829193+0000","last_fullsized":"2024-03-31T16:36:23.829193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:07:00.927777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843146+0000","last_change":"2024-03-31T16:36:23.834860+0000","last_active":"2024-03-31T16:36:23.843146+0000","last_peered":"2024-03-31T16:36:23.843146+0000","last_clean":"2024-03-31T16:36:23.843146+0000","last_became_active":"2024-03-31T16:36:23.834608+0000","last_became_peered":"2024-03-31T16:36:23.834608+0000","last_unstale":"2024-03-31T16:36:23.843146+0000","last_undegraded":"2024-03-31T16:36:23.843146+0000","last_fullsized":"2024-03-31T16:36:23.843146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:01:29.081356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.824643+0000","last_change":"2024-03-31T16:36:22.832368+0000","last_active":"2024-03-31T16:36:23.824643+0000","last_peered":"2024-03-31T16:36:23.824643+0000","last_clean":"2024-03-31T16:36:23.824643+0000","last_became_active":"2024-03-31T16:36:22.832066+0000","last_became_peered":"2024-03-31T16:36:22.832066+0000","last_unstale":"2024-03-31T16:36:23.824643+0000","last_undegraded":"2024-03-31T16:36:23.824643+0000","last_fullsized":"2024-03-31T16:36:23.824643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:34.521212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843892+0000","last_change":"2024-03-31T16:36:23.838651+0000","last_active":"2024-03-31T16:36:23.843892+0000","last_peered":"2024-03-31T16:36:23.843892+0000","last_clean":"2024-03-31T16:36:23.843892+0000","last_became_active":"2024-03-31T16:36:23.838383+0000","last_became_peered":"2024-03-31T16:36:23.838383+0000","last_unstale":"2024-03-31T16:36:23.843892+0000","last_undegraded":"2024-03-31T16:36:23.843892+0000","last_fullsized":"2024-03-31T16:36:23.843892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:19.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.824444+0000","last_change":"2024-03-31T16:36:22.841226+0000","last_active":"2024-03-31T16:36:23.824444+0000","last_peered":"2024-03-31T16:36:23.824444+0000","last_clean":"2024-03-31T16:36:23.824444+0000","last_became_active":"2024-03-31T16:36:22.840937+0000","last_became_peered":"2024-03-31T16:36:22.840937+0000","last_unstale":"2024-03-31T16:36:23.824444+0000","last_undegraded":"2024-03-31T16:36:23.824444+0000","last_fullsized":"2024-03-31T16:36:23.824444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:18.008059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.839543+0000","last_change":"2024-03-31T16:36:23.832575+0000","last_active":"2024-03-31T16:36:23.839543+0000","last_peered":"2024-03-31T16:36:23.839543+0000","last_clean":"2024-03-31T16:36:23.839543+0000","last_became_active":"2024-03-31T16:36:23.832310+0000","last_became_peered":"2024-03-31T16:36:23.832310+0000","last_unstale":"2024-03-31T16:36:23.839543+0000","last_undegraded":"2024-03-31T16:36:23.839543+0000","last_fullsized":"2024-03-31T16:36:23.839543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:12:28.883226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851893+0000","last_change":"2024-03-31T16:36:22.834380+0000","last_active":"2024-03-31T16:36:23.851893+0000","last_peered":"2024-03-31T16:36:23.851893+0000","last_clean":"2024-03-31T16:36:23.851893+0000","last_became_active":"2024-03-31T16:36:22.834022+0000","last_became_peered":"2024-03-31T16:36:22.834022+0000","last_unstale":"2024-03-31T16:36:23.851893+0000","last_undegraded":"2024-03-31T16:36:23.851893+0000","last_fullsized":"2024-03-31T16:36:23.851893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:04:22.471640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.851444+0000","last_change":"2024-03-31T16:36:23.846662+0000","last_active":"2024-03-31T16:36:23.851444+0000","last_peered":"2024-03-31T16:36:23.851444+0000","last_clean":"2024-03-31T16:36:23.851444+0000","last_became_active":"2024-03-31T16:36:23.846301+0000","last_became_peered":"2024-03-31T16:36:23.846301+0000","last_unstale":"2024-03-31T16:36:23.851444+0000","last_undegraded":"2024-03-31T16:36:23.851444+0000","last_fullsized":"2024-03-31T16:36:23.851444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:09:02.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.821311+0000","last_change":"2024-03-31T16:36:22.832561+0000","last_active":"2024-03-31T16:36:23.821311+0000","last_peered":"2024-03-31T16:36:23.821311+0000","last_clean":"2024-03-31T16:36:23.821311+0000","last_became_active":"2024-03-31T16:36:22.832303+0000","last_became_peered":"2024-03-31T16:36:22.832303+0000","last_unstale":"2024-03-31T16:36:23.821311+0000","last_undegraded":"2024-03-31T16:36:23.821311+0000","last_fullsized":"2024-03-31T16:36:23.821311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:44:29.991922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.849739+0000","last_change":"2024-03-31T16:36:23.846675+0000","last_active":"2024-03-31T16:36:23.849739+0000","last_peered":"2024-03-31T16:36:23.849739+0000","last_clean":"2024-03-31T16:36:23.849739+0000","last_became_active":"2024-03-31T16:36:23.846394+0000","last_became_peered":"2024-03-31T16:36:23.846394+0000","last_unstale":"2024-03-31T16:36:23.849739+0000","last_undegraded":"2024-03-31T16:36:23.849739+0000","last_fullsized":"2024-03-31T16:36:23.849739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:10.383103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.822558+0000","last_change":"2024-03-31T16:36:22.833130+0000","last_active":"2024-03-31T16:36:23.822558+0000","last_peered":"2024-03-31T16:36:23.822558+0000","last_clean":"2024-03-31T16:36:23.822558+0000","last_became_active":"2024-03-31T16:36:22.832813+0000","last_became_peered":"2024-03-31T16:36:22.832813+0000","last_unstale":"2024-03-31T16:36:23.822558+0000","last_undegraded":"2024-03-31T16:36:23.822558+0000","last_fullsized":"2024-03-31T16:36:23.822558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:07:00.927777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.843885+0000","last_change":"2024-03-31T16:36:23.842423+0000","last_active":"2024-03-31T16:36:23.843885+0000","last_peered":"2024-03-31T16:36:23.843885+0000","last_clean":"2024-03-31T16:36:23.843885+0000","last_became_active":"2024-03-31T16:36:23.842020+0000","last_became_peered":"2024-03-31T16:36:23.842020+0000","last_unstale":"2024-03-31T16:36:23.843885+0000","last_undegraded":"2024-03-31T16:36:23.843885+0000","last_fullsized":"2024-03-31T16:36:23.843885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:14.236814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.820971+0000","last_change":"2024-03-31T16:36:22.830077+0000","last_active":"2024-03-31T16:36:23.820971+0000","last_peered":"2024-03-31T16:36:23.820971+0000","last_clean":"2024-03-31T16:36:23.820971+0000","last_became_active":"2024-03-31T16:36:22.829811+0000","last_became_peered":"2024-03-31T16:36:22.829811+0000","last_unstale":"2024-03-31T16:36:23.820971+0000","last_undegraded":"2024-03-31T16:36:23.820971+0000","last_fullsized":"2024-03-31T16:36:23.820971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:13.234390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841206+0000","last_change":"2024-03-31T16:36:23.838979+0000","last_active":"2024-03-31T16:36:23.841206+0000","last_peered":"2024-03-31T16:36:23.841206+0000","last_clean":"2024-03-31T16:36:23.841206+0000","last_became_active":"2024-03-31T16:36:23.838724+0000","last_became_peered":"2024-03-31T16:36:23.838724+0000","last_unstale":"2024-03-31T16:36:23.841206+0000","last_undegraded":"2024-03-31T16:36:23.841206+0000","last_fullsized":"2024-03-31T16:36:23.841206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T17:28:19.010482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.823274+0000","last_change":"2024-03-31T16:36:22.834786+0000","last_active":"2024-03-31T16:36:23.823274+0000","last_peered":"2024-03-31T16:36:23.823274+0000","last_clean":"2024-03-31T16:36:23.823274+0000","last_became_active":"2024-03-31T16:36:22.834544+0000","last_became_peered":"2024-03-31T16:36:22.834544+0000","last_unstale":"2024-03-31T16:36:23.823274+0000","last_undegraded":"2024-03-31T16:36:23.823274+0000","last_fullsized":"2024-03-31T16:36:23.823274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:37:34.521212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.841633+0000","last_change":"2024-03-31T16:36:23.838920+0000","last_active":"2024-03-31T16:36:23.841633+0000","last_peered":"2024-03-31T16:36:23.841633+0000","last_clean":"2024-03-31T16:36:23.841633+0000","last_became_active":"2024-03-31T16:36:23.838632+0000","last_became_peered":"2024-03-31T16:36:23.838632+0000","last_unstale":"2024-03-31T16:36:23.841633+0000","last_undegraded":"2024-03-31T16:36:23.841633+0000","last_fullsized":"2024-03-31T16:36:23.841633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T00:06:57.897091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.824768+0000","last_change":"2024-03-31T16:36:22.833565+0000","last_active":"2024-03-31T16:36:23.824768+0000","last_peered":"2024-03-31T16:36:23.824768+0000","last_clean":"2024-03-31T16:36:23.824768+0000","last_became_active":"2024-03-31T16:36:22.833281+0000","last_became_peered":"2024-03-31T16:36:22.833281+0000","last_unstale":"2024-03-31T16:36:23.824768+0000","last_undegraded":"2024-03-31T16:36:23.824768+0000","last_fullsized":"2024-03-31T16:36:23.824768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T19:29:13.234390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.839219+0000","last_change":"2024-03-31T16:36:23.835225+0000","last_active":"2024-03-31T16:36:23.839219+0000","last_peered":"2024-03-31T16:36:23.839219+0000","last_clean":"2024-03-31T16:36:23.839219+0000","last_became_active":"2024-03-31T16:36:23.834993+0000","last_became_peered":"2024-03-31T16:36:23.834993+0000","last_unstale":"2024-03-31T16:36:23.839219+0000","last_undegraded":"2024-03-31T16:36:23.839219+0000","last_fullsized":"2024-03-31T16:36:23.839219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:29.030713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.822963+0000","last_change":"2024-03-31T16:36:22.841301+0000","last_active":"2024-03-31T16:36:23.822963+0000","last_peered":"2024-03-31T16:36:23.822963+0000","last_clean":"2024-03-31T16:36:23.822963+0000","last_became_active":"2024-03-31T16:36:22.841019+0000","last_became_peered":"2024-03-31T16:36:22.841019+0000","last_unstale":"2024-03-31T16:36:23.822963+0000","last_undegraded":"2024-03-31T16:36:23.822963+0000","last_fullsized":"2024-03-31T16:36:23.822963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T16:56:09.380679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.842784+0000","last_change":"2024-03-31T16:36:23.836388+0000","last_active":"2024-03-31T16:36:23.842784+0000","last_peered":"2024-03-31T16:36:23.842784+0000","last_clean":"2024-03-31T16:36:23.842784+0000","last_became_active":"2024-03-31T16:36:23.836016+0000","last_became_peered":"2024-03-31T16:36:23.836016+0000","last_unstale":"2024-03-31T16:36:23.842784+0000","last_undegraded":"2024-03-31T16:36:23.842784+0000","last_fullsized":"2024-03-31T16:36:23.842784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:22.806824+0000","last_clean_scrub_stamp":"2024-03-31T16:36:22.806824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T22:32:29.030713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.832227+0000","last_change":"2024-03-31T16:36:22.836270+0000","last_active":"2024-03-31T16:36:23.832227+0000","last_peered":"2024-03-31T16:36:23.832227+0000","last_clean":"2024-03-31T16:36:23.832227+0000","last_became_active":"2024-03-31T16:36:22.835964+0000","last_became_peered":"2024-03-31T16:36:22.835964+0000","last_unstale":"2024-03-31T16:36:23.832227+0000","last_undegraded":"2024-03-31T16:36:23.832227+0000","last_fullsized":"2024-03-31T16:36:23.832227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:36:21.804400+0000","last_clean_scrub_stamp":"2024-03-31T16:36:21.804400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T20:14:32.483271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-31T16:36:23.829103+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-03-31T16:36:23.829103+0000","last_peered":"2024-03-31T16:36:23.829103+0000","last_clean":"2024-03-31T16:36:23.829103+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-03-31T16:36:23.829103+0000","last_undegraded":"2024-03-31T16:36:23.829103+0000","last_fullsized":"2024-03-31T16:36:23.829103+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-31T16:36:27.167 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-31T16:36:27.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-31T16:36:27.201 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T16:36:27.197+0000 7ff868863640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-31T16:36:27.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.305+0000 7fe3106f2640 1 Processor -- start 2024-03-31T16:36:27.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.305+0000 7fe3106f2640 1 -- start start 2024-03-31T16:36:27.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.306+0000 7fe3106f2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe30815d630 0x7fe3080c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.306+0000 7fe3106f2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe3080d0540 0x7fe3080ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.306+0000 7fe3106f2640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3080c7dd0 con 0x7fe30815ca70 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.306+0000 7fe3106f2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe3080c80b0 con 0x7fe3080d0540 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.306+0000 7fe3106f2640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3080c8390 con 0x7fe30815d630 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.306+0000 7fe30ec8f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe3080d0540 0x7fe3080ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.306+0000 7fe30dc8d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe30815ca70 0x7fe3080cfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33720/0 (socket says 172.21.15.120:33720) 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.306+0000 7fe30dc8d640 1 -- 172.21.15.120:0/2961521790 learned_addr learned my addr 172.21.15.120:0/2961521790 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.307+0000 7fe30e48e640 1 --2- 172.21.15.120:0/2961521790 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe30815d630 0x7fe3080c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.307+0000 7fe30ec8f640 1 -- 172.21.15.120:0/2961521790 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe30815d630 msgr2=0x7fe3080c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.307+0000 7fe30ec8f640 1 --2- 172.21.15.120:0/2961521790 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe30815d630 0x7fe3080c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.307+0000 7fe30ec8f640 1 -- 172.21.15.120:0/2961521790 >> v1:172.21.15.120:6789/0 conn(0x7fe30815ca70 legacy=0x7fe3080cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.307+0000 7fe30ec8f640 1 -- 172.21.15.120:0/2961521790 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3080c8670 con 0x7fe3080d0540 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.307+0000 7fe30e48e640 1 --2- 172.21.15.120:0/2961521790 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe30815d630 0x7fe3080c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.307+0000 7fe30ec8f640 1 --2- 172.21.15.120:0/2961521790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3080d0540 0x7fe3080ce8d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe300009d90 tx=0x7fe30002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505087146c67e268 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.307+0000 7fe30d48c640 1 -- 172.21.15.120:0/2961521790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300039070 con 0x7fe3080d0540 2024-03-31T16:36:27.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe30d48c640 1 -- 172.21.15.120:0/2961521790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30002cc50 con 0x7fe3080d0540 2024-03-31T16:36:27.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe30d48c640 1 -- 172.21.15.120:0/2961521790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe300034440 con 0x7fe3080d0540 2024-03-31T16:36:27.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe3106f2640 1 -- 172.21.15.120:0/2961521790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3080d0540 msgr2=0x7fe3080ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2961521790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3080d0540 0x7fe3080ce8d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe300009d90 tx=0x7fe30002bea0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe3106f2640 1 -- 172.21.15.120:0/2961521790 shutdown_connections 2024-03-31T16:36:27.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2961521790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe3080d0540 0x7fe3080ce8d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2961521790 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe30815d630 0x7fe3080c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe3106f2640 1 -- 172.21.15.120:0/2961521790 >> 172.21.15.120:0/2961521790 conn(0x7fe3080b3e90 msgr2=0x7fe3080b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:27.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe3106f2640 1 -- 172.21.15.120:0/2961521790 shutdown_connections 2024-03-31T16:36:27.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.308+0000 7fe3106f2640 1 -- 172.21.15.120:0/2961521790 wait complete. 2024-03-31T16:36:27.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.310+0000 7fe3106f2640 1 Processor -- start 2024-03-31T16:36:27.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.310+0000 7fe3106f2640 1 -- start start 2024-03-31T16:36:27.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe3106f2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3080d0540 0x7fe30815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe3106f2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30815ca70 0x7fe3080cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe3106f2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe30815d630 0x7fe3080a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe3106f2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe3080cef90 con 0x7fe30815ca70 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe3106f2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3080cee10 con 0x7fe30815d630 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe3106f2640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3080cf110 con 0x7fe3080d0540 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe30dc8d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30815ca70 0x7fe3080cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe30dc8d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30815ca70 0x7fe3080cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37724/0 (socket says 172.21.15.120:37724) 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.311+0000 7fe30dc8d640 1 -- 172.21.15.120:0/2166602678 learned_addr learned my addr 172.21.15.120:0/2166602678 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30ec8f640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe30815d630 0x7fe3080a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30e48e640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3080d0540 0x7fe30815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30dc8d640 1 -- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3080d0540 msgr2=0x7fe30815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30dc8d640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3080d0540 0x7fe30815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30dc8d640 1 -- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe30815d630 msgr2=0x7fe3080a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30dc8d640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe30815d630 0x7fe3080a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30dc8d640 1 -- 172.21.15.120:0/2166602678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3080cb770 con 0x7fe30815ca70 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30e48e640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3080d0540 0x7fe30815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe30dc8d640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30815ca70 0x7fe3080cad90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c470 tx=0x7fe2f8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe2feffd640 1 -- 172.21.15.120:0/2166602678 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8017070 con 0x7fe30815ca70 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe2feffd640 1 -- 172.21.15.120:0/2166602678 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f8005ce0 con 0x7fe30815ca70 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3080cba50 con 0x7fe30815ca70 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe2feffd640 1 -- 172.21.15.120:0/2166602678 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80072f0 con 0x7fe30815ca70 2024-03-31T16:36:27.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.312+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3080cd0c0 con 0x7fe30815ca70 2024-03-31T16:36:27.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.313+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe308068cd0 con 0x7fe30815ca70 2024-03-31T16:36:27.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.314+0000 7fe2feffd640 1 -- 172.21.15.120:0/2166602678 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2f801a070 con 0x7fe30815ca70 2024-03-31T16:36:27.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.314+0000 7fe2feffd640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe2ec06c8f0 0x7fe2ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.314+0000 7fe2feffd640 1 -- 172.21.15.120:0/2166602678 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe2f808aee0 con 0x7fe30815ca70 2024-03-31T16:36:27.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.314+0000 7fe30e48e640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe2ec06c8f0 0x7fe2ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.315+0000 7fe30e48e640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe2ec06c8f0 0x7fe2ec06edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe304006fd0 tx=0x7fe304008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:27.322 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.319+0000 7fe2feffd640 1 -- 172.21.15.120:0/2166602678 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe2f8059310 con 0x7fe30815ca70 2024-03-31T16:36:27.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.585+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe3080cd290 con 0x7fe30815ca70 2024-03-31T16:36:27.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.587+0000 7fe2feffd640 1 -- 172.21.15.120:0/2166602678 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fe2f8058c10 con 0x7fe30815ca70 2024-03-31T16:36:27.591 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-03-31T16:36:27.591 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCakAlm7s+2DhAAf4okmBd2QJxliS57iZYpYA== 2024-03-31T16:36:27.591 INFO:teuthology.orchestra.run.smithi120.stdout: caps mds = "allow" 2024-03-31T16:36:27.591 INFO:teuthology.orchestra.run.smithi120.stdout: caps mon = "allow r" 2024-03-31T16:36:27.591 INFO:teuthology.orchestra.run.smithi120.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-31T16:36:27.591 INFO:teuthology.orchestra.run.smithi120.stderr:updated caps for client.0 2024-03-31T16:36:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe2ec06c8f0 msgr2=0x7fe2ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe2ec06c8f0 0x7fe2ec06edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe304006fd0 tx=0x7fe304008040 comp rx=0 tx=0).stop 2024-03-31T16:36:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30815ca70 msgr2=0x7fe3080cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30815ca70 0x7fe3080cad90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c470 tx=0x7fe2f8001e70 comp rx=0 tx=0).stop 2024-03-31T16:36:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 shutdown_connections 2024-03-31T16:36:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe2ec06c8f0 0x7fe2ec06edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe30815d630 0x7fe3080a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe30815ca70 0x7fe3080cad90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 --2- 172.21.15.120:0/2166602678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3080d0540 0x7fe30815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 >> 172.21.15.120:0/2166602678 conn(0x7fe3080b3e90 msgr2=0x7fe30815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 shutdown_connections 2024-03-31T16:36:27.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.590+0000 7fe3106f2640 1 -- 172.21.15.120:0/2166602678 wait complete. 2024-03-31T16:36:27.605 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-31T16:36:27.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.703+0000 7f18ba2ba640 1 Processor -- start 2024-03-31T16:36:27.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.703+0000 7f18ba2ba640 1 -- start start 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18ba2ba640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18b415da60 0x7f18b40cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18ba2ba640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b415d060 con 0x7f18b415f900 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18ba2ba640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b415d340 con 0x7f18b415fe90 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18ba2ba640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f18b415d620 con 0x7f18b415da60 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18b3fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f18b415f900 0x7f18b415c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33724/0 (socket says 172.21.15.120:33724) 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18b3fff640 1 -- 172.21.15.120:0/1720300971 learned_addr learned my addr 172.21.15.120:0/1720300971 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18b37fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f18b415da60 0x7f18b40cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18b2ffd640 1 -- 172.21.15.120:0/1720300971 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162569629 0 0) 0x7f18b415d060 con 0x7f18b415f900 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18b2ffd640 1 -- 172.21.15.120:0/1720300971 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f189c003520 con 0x7f18b415f900 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18b37fe640 1 -- 172.21.15.120:0/1720300971 >> v1:172.21.15.203:6789/0 conn(0x7f18b415fe90 legacy=0x7f18b40ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18b37fe640 1 -- 172.21.15.120:0/1720300971 >> v1:172.21.15.120:6789/0 conn(0x7f18b415f900 legacy=0x7f18b415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.704+0000 7f18b37fe640 1 -- 172.21.15.120:0/1720300971 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b40c74b0 con 0x7f18b415da60 2024-03-31T16:36:27.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.705+0000 7f18b37fe640 1 --2- 172.21.15.120:0/1720300971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415da60 0x7f18b40cfe30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18a40097a0 tx=0x7f18a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac280bc841b7227 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:27.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.705+0000 7f18b2ffd640 1 -- 172.21.15.120:0/1720300971 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4035020 con 0x7f18b415da60 2024-03-31T16:36:27.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.705+0000 7f18b2ffd640 1 -- 172.21.15.120:0/1720300971 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a4031830 con 0x7f18b415da60 2024-03-31T16:36:27.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.705+0000 7f18b2ffd640 1 -- 172.21.15.120:0/1720300971 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4031c00 con 0x7f18b415da60 2024-03-31T16:36:27.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.706+0000 7f18ba2ba640 1 -- 172.21.15.120:0/1720300971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415da60 msgr2=0x7f18b40cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.706+0000 7f18ba2ba640 1 --2- 172.21.15.120:0/1720300971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415da60 0x7f18b40cfe30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18a40097a0 tx=0x7f18a402b8d0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.706+0000 7f18ba2ba640 1 -- 172.21.15.120:0/1720300971 shutdown_connections 2024-03-31T16:36:27.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.706+0000 7f18ba2ba640 1 --2- 172.21.15.120:0/1720300971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415da60 0x7f18b40cfe30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.706+0000 7f18ba2ba640 1 -- 172.21.15.120:0/1720300971 >> 172.21.15.120:0/1720300971 conn(0x7f18b40b3e90 msgr2=0x7f18b40b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:27.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.706+0000 7f18ba2ba640 1 -- 172.21.15.120:0/1720300971 shutdown_connections 2024-03-31T16:36:27.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.706+0000 7f18ba2ba640 1 -- 172.21.15.120:0/1720300971 wait complete. 2024-03-31T16:36:27.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.707+0000 7f18ba2ba640 1 Processor -- start 2024-03-31T16:36:27.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.707+0000 7f18ba2ba640 1 -- start start 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18ba2ba640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b415da60 0x7f18b41f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18ba2ba640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415f900 0x7f18b41e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18ba2ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b415fe90 0x7f18b40cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18ba2ba640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f18b40d0780 con 0x7f18b415f900 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18ba2ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18b40d0600 con 0x7f18b415fe90 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18ba2ba640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f18b40cefe0 con 0x7f18b415da60 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415f900 0x7f18b41e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415f900 0x7f18b41e84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37740/0 (socket says 172.21.15.120:37740) 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b37fe640 1 -- 172.21.15.120:0/3622497622 learned_addr learned my addr 172.21.15.120:0/3622497622 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b3fff640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b415da60 0x7f18b41f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b37fe640 1 -- 172.21.15.120:0/3622497622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b415da60 msgr2=0x7f18b41f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b37fe640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b415da60 0x7f18b41f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b8857640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b415fe90 0x7f18b40cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b37fe640 1 -- 172.21.15.120:0/3622497622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b415fe90 msgr2=0x7f18b40cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b37fe640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b415fe90 0x7f18b40cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.708+0000 7f18b37fe640 1 -- 172.21.15.120:0/3622497622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b41e6070 con 0x7f18b415f900 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.709+0000 7f18b37fe640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415f900 0x7f18b41e84b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f18a40098c0 tx=0x7f18a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.709+0000 7f18b0ff9640 1 -- 172.21.15.120:0/3622497622 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4041070 con 0x7f18b415f900 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.709+0000 7f18b0ff9640 1 -- 172.21.15.120:0/3622497622 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a403b920 con 0x7f18b415f900 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.709+0000 7f18b0ff9640 1 -- 172.21.15.120:0/3622497622 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4035040 con 0x7f18b415f900 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.709+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b41e6350 con 0x7f18b415f900 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.709+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b406e250 con 0x7f18b415f900 2024-03-31T16:36:27.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.710+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b4068cd0 con 0x7f18b415f900 2024-03-31T16:36:27.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.710+0000 7f18b0ff9640 1 -- 172.21.15.120:0/3622497622 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18a4038020 con 0x7f18b415f900 2024-03-31T16:36:27.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.711+0000 7f18b0ff9640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18a006c8f0 0x7f18a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:27.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.711+0000 7f18b3fff640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18a006c8f0 0x7f18a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:27.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.711+0000 7f18b0ff9640 1 -- 172.21.15.120:0/3622497622 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f18a40ad5a0 con 0x7f18b415f900 2024-03-31T16:36:27.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.711+0000 7f18b3fff640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18a006c8f0 0x7f18a006edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f18a8000f60 tx=0x7f18a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:27.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.715+0000 7f18b0ff9640 1 -- 172.21.15.120:0/3622497622 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f18a407b950 con 0x7f18b415f900 2024-03-31T16:36:27.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.936+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18b4074bf0 con 0x7f18b415f900 2024-03-31T16:36:27.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.937+0000 7f18b0ff9640 1 -- 172.21.15.120:0/3622497622 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f18a4031800 con 0x7f18b415f900 2024-03-31T16:36:27.941 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:27.941 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/4016494046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4016494046},{"type":"v1","addr":"172.21.15.203:6834","nonce":4016494046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1319253278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":1319253278},{"type":"v1","addr":"172.21.15.203:6835","nonce":1319253278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1766153586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1766153586},{"type":"v1","addr":"172.21.15.120:6836","nonce":1766153586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:36:23.168388+0000","modified":"2024-03-31T16:36:25.178205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/2154626843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2154626843},{"type":"v1","addr":"172.21.15.120:6837","nonce":2154626843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-03-31T16:36:27.941 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 14 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.939+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18a006c8f0 msgr2=0x7f18a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.939+0000 7f18ba2ba640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18a006c8f0 0x7f18a006edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f18a8000f60 tx=0x7f18a8009040 comp rx=0 tx=0).stop 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.939+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415f900 msgr2=0x7f18b41e84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.939+0000 7f18ba2ba640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415f900 0x7f18b41e84b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f18a40098c0 tx=0x7f18a40046c0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.940+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 shutdown_connections 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.940+0000 7f18ba2ba640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f18a006c8f0 0x7f18a006edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.940+0000 7f18ba2ba640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b415fe90 0x7f18b40cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.940+0000 7f18ba2ba640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18b415f900 0x7f18b41e84b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.940+0000 7f18ba2ba640 1 --2- 172.21.15.120:0/3622497622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18b415da60 0x7f18b41f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:27.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.940+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 >> 172.21.15.120:0/3622497622 conn(0x7f18b40b3e90 msgr2=0x7f18b4160430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:27.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.940+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 shutdown_connections 2024-03-31T16:36:27.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:27.940+0000 7f18ba2ba640 1 -- 172.21.15.120:0/3622497622 wait complete. 2024-03-31T16:36:28.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-31T16:36:23.168388+0000', 'modified': '2024-03-31T16:36:25.178205+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5088': {'gid': 5088, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6837/2154626843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6835', 'nonce': 2154626843}, {'type': 'v1', 'addr': '172.21.15.120:6837', 'nonce': 2154626843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5088, 'qdb_cluster': [5088]} 2024-03-31T16:36:28.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-31T16:36:28.360 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-31T16:36:28.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.458+0000 7fe7c5463640 1 Processor -- start 2024-03-31T16:36:28.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.458+0000 7fe7c5463640 1 -- start start 2024-03-31T16:36:28.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7c5463640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe7c00d0e70 0x7fe7c00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7c5463640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c00cf6c0 con 0x7fe7c00d2110 2024-03-31T16:36:28.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7c5463640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c00cf9a0 con 0x7fe7c015f6e0 2024-03-31T16:36:28.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7c5463640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c00cfc80 con 0x7fe7c00d0e70 2024-03-31T16:36:28.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7bf7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe7c00d2110 0x7fe7c00d25a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33726/0 (socket says 172.21.15.120:33726) 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7bf7fe640 1 -- 172.21.15.120:0/2346713986 learned_addr learned my addr 172.21.15.120:0/2346713986 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282346562 0 0) 0x7fe7c00cf6c0 con 0x7fe7c00d2110 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7a8003520 con 0x7fe7c00d2110 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.459+0000 7fe7beffd640 1 --2- 172.21.15.120:0/2346713986 >> v2:172.21.15.203:3300/0 conn(0x7fe7c00d0e70 0x7fe7c00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4055050356 0 0) 0x7fe7a8003520 con 0x7fe7c00d2110 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 >> v2:172.21.15.203:3300/0 conn(0x7fe7c00d0e70 msgr2=0x7fe7c00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 --2- 172.21.15.120:0/2346713986 >> v2:172.21.15.203:3300/0 conn(0x7fe7c00d0e70 0x7fe7c00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 >> v1:172.21.15.203:6789/0 conn(0x7fe7c015f6e0 legacy=0x7fe7c00d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c00cff60 con 0x7fe7c00d2110 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7fe7b80019f0 con 0x7fe7c00d2110 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 >> v1:172.21.15.120:6789/0 conn(0x7fe7c00d2110 legacy=0x7fe7c00d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a80039b0 0x7fe7a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8004800 0x7fe7a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a80051c0 0x7fe7a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c00cfc80 con 0x7fe7a8004800 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a800c160 con 0x7fe7a80051c0 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a800c360 con 0x7fe7a80039b0 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8004800 0x7fe7a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a80051c0 0x7fe7a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7beffd640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a80039b0 0x7fe7a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7be7fc640 1 -- 172.21.15.120:0/2346713986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a80039b0 msgr2=0x7fe7a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a80039b0 0x7fe7a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7be7fc640 1 -- 172.21.15.120:0/2346713986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a80051c0 msgr2=0x7fe7a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.468 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a80051c0 0x7fe7a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7be7fc640 1 -- 172.21.15.120:0/2346713986 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a8003520 con 0x7fe7a8004800 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.460+0000 7fe7bf7fe640 1 -- 172.21.15.120:0/2346713986 reap_dead start 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.461+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8004800 0x7fe7a8004c80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0001750 tx=0x7fe7a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5647c26ba975410 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.461+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0001370 con 0x7fe7a8004800 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.461+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b00052d0 con 0x7fe7a8004800 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.461+0000 7fe7bdffb640 1 -- 172.21.15.120:0/2346713986 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0003830 con 0x7fe7a8004800 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.462+0000 7fe7c5463640 1 -- 172.21.15.120:0/2346713986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8004800 msgr2=0x7fe7a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.462+0000 7fe7c5463640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8004800 0x7fe7a8004c80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0001750 tx=0x7fe7a8005830 comp rx=0 tx=0).stop 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.462+0000 7fe7c5463640 1 -- 172.21.15.120:0/2346713986 shutdown_connections 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.462+0000 7fe7c5463640 1 --2- 172.21.15.120:0/2346713986 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7a8004800 0x7fe7a8004c80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.462+0000 7fe7c5463640 1 -- 172.21.15.120:0/2346713986 >> 172.21.15.120:0/2346713986 conn(0x7fe7c008bfb0 msgr2=0x7fe7c00d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:28.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.462+0000 7fe7c5463640 1 -- 172.21.15.120:0/2346713986 shutdown_connections 2024-03-31T16:36:28.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.462+0000 7fe7c5463640 1 -- 172.21.15.120:0/2346713986 wait complete. 2024-03-31T16:36:28.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.463+0000 7fe7c5463640 1 Processor -- start 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.463+0000 7fe7c5463640 1 -- start start 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7c5463640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a8004800 0x7fe7c00b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7c5463640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7c00cd0c0 0x7fe7c00cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7c5463640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c00b3e30 0x7fe7c00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7c5463640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c015e910 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7c5463640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c015fb40 con 0x7fe7c00b3e30 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7c5463640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c015ea90 con 0x7fe7a8004800 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7c00cd0c0 0x7fe7c00cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7c00cd0c0 0x7fe7c00cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37746/0 (socket says 172.21.15.120:37746) 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 -- 172.21.15.120:0/4155525764 learned_addr learned my addr 172.21.15.120:0/4155525764 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:28.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c00b3e30 0x7fe7c00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7beffd640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a8004800 0x7fe7c00b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 -- 172.21.15.120:0/4155525764 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a8004800 msgr2=0x7fe7c00b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a8004800 0x7fe7c00b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 -- 172.21.15.120:0/4155525764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c00b3e30 msgr2=0x7fe7c00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c00b3e30 0x7fe7c00b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 -- 172.21.15.120:0/4155525764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c00ce020 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7c00cd0c0 0x7fe7c00cd540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0005040 tx=0x7fe7b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.464+0000 7fe7a77fe640 1 -- 172.21.15.120:0/4155525764 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0041070 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.465+0000 7fe7a77fe640 1 -- 172.21.15.120:0/4155525764 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b0005480 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.465+0000 7fe7c5463640 1 -- 172.21.15.120:0/4155525764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c014e520 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.465+0000 7fe7a77fe640 1 -- 172.21.15.120:0/4155525764 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0007a30 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.465+0000 7fe7c5463640 1 -- 172.21.15.120:0/4155525764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c00cdd40 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.466+0000 7fe7a77fe640 1 -- 172.21.15.120:0/4155525764 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7b0044070 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.466+0000 7fe7a77fe640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe7ac06c920 0x7fe7ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.466+0000 7fe7a77fe640 1 -- 172.21.15.120:0/4155525764 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe7b00ad5f0 con 0x7fe7c00cd0c0 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.466+0000 7fe7beffd640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe7ac06c920 0x7fe7ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.467+0000 7fe7beffd640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe7ac06c920 0x7fe7ac06ede0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe7c006a2b0 tx=0x7fe7b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.467+0000 7fe7c8055740 1 Processor -- start 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7c8055740 1 -- start start 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384816e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384aeb20 0x5627384b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562738481c20 0x5627384b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7c8055740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5627383eb020 con 0x5627384aeb20 2024-03-31T16:36:28.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7c8055740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5627383935f0 con 0x562738481c20 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7c8055740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5627383e6fd0 con 0x5627384ae740 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7be7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384aeb20 0x5627384b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7be7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384aeb20 0x5627384b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37748/0 (socket says 172.21.15.120:37748) 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7be7fc640 1 -- 172.21.15.120:0/3338964920 learned_addr learned my addr 172.21.15.120:0/3338964920 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562738481c20 0x5627384b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.468+0000 7fe7beffd640 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384816e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7be7fc640 1 -- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 msgr2=0x5627384816e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384816e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7be7fc640 1 -- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562738481c20 msgr2=0x5627384b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562738481c20 0x5627384b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7be7fc640 1 -- 172.21.15.120:0/3338964920 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627380ff2d0 con 0x5627384aeb20 2024-03-31T16:36:28.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562738481c20 0x5627384b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384aeb20 0x5627384b14d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00abac0 tx=0x7fe7b007b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dafe865d8c728a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/3338964920 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b004b040 con 0x5627384aeb20 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/3338964920 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b0006e10 con 0x5627384aeb20 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.469+0000 7fe7a4ff9640 1 -- 172.21.15.120:0/3338964920 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0001370 con 0x5627384aeb20 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 -- 172.21.15.120:0/3338964920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384aeb20 msgr2=0x5627384b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384aeb20 0x5627384b14d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00abac0 tx=0x7fe7b007b3e0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 -- 172.21.15.120:0/3338964920 shutdown_connections 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562738481c20 0x5627384b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384aeb20 0x5627384b14d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 --2- 172.21.15.120:0/3338964920 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384816e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 -- 172.21.15.120:0/3338964920 >> 172.21.15.120:0/3338964920 conn(0x562738483950 msgr2=0x5627384cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:28.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 -- 172.21.15.120:0/3338964920 shutdown_connections 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 -- 172.21.15.120:0/3338964920 wait complete. 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 -- start start 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.470+0000 7fe7c8055740 1 Processor -- start 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384aeb20 0x5627384b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384b6b60 0x5627384b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7c8055740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5627383935f0 con 0x5627384ae740 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7c8055740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5627383a69c0 con 0x5627384b6b60 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7c8055740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5627383eb020 con 0x5627384aeb20 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7c8055740 10 client.0 _ll_register_callbacks cb 0x56273838afc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T16:36:28.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7beffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7beffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37762/0 (socket says 172.21.15.120:37762) 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7beffd640 1 -- 172.21.15.120:0/278465864 learned_addr learned my addr 172.21.15.120:0/278465864 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384aeb20 0x5627384b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.471+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384b6b60 0x5627384b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7beffd640 1 -- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384aeb20 msgr2=0x5627384b8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7beffd640 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384aeb20 0x5627384b8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7beffd640 1 -- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384b6b60 msgr2=0x5627384b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7beffd640 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384b6b60 0x5627384b9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7beffd640 1 -- 172.21.15.120:0/278465864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627381c96b0 con 0x5627384ae740 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384aeb20 0x5627384b8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:28.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7beffd640 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b6620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4016a10 tx=0x7fe7b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9776dab39a47794b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe79dffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe79dffb640 1 -- 172.21.15.120:0/278465864 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4015b50 con 0x5627384ae740 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe79dffb640 1 -- 172.21.15.120:0/278465864 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe7b4015cf0 con 0x5627384ae740 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 1 -- 172.21.15.120:0/278465864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7b0006e10 con 0x5627384ae740 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe79dffb640 1 -- 172.21.15.120:0/278465864 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fe7b4034050 con 0x5627384ae740 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 10 client.5265 fetch_fsmap learned FSMap version 14 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 1 -- 172.21.15.120:0/278465864 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5627384dd0e0 con 0x5627384ae740 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe79dffb640 1 -- 172.21.15.120:0/278465864 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b0006e10 con 0x5627384ae740 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe79dffb640 1 -- 172.21.15.120:0/278465864 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7fe7b4024430 con 0x5627384ae740 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 10 client.5265 fetch_fsmap finished waiting for FSMap version 14 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 10 client.5265 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-31T16:36:28.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 20 client.5265 populate_metadata read hostname 'smithi120' 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] conn(0x5627384b3d40 0x5627384b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 4 client.5265 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.472+0000 7fe7c8055740 1 -- 172.21.15.120:0/278465864 --> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627383bf4e0 con 0x5627384b3d40 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.473+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] conn(0x5627384b3d40 0x5627384b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.473+0000 7fe79dffb640 10 client.5265 ms_handle_connect on v2:172.21.15.120:6835/2154626843 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.473+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] conn(0x5627384b3d40 0x5627384b4120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bee0017fcda05e4 server_cookie=f184d9464b99abc1 in_seq=0 out_seq=0 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.473+0000 7fe79dffb640 1 -- 172.21.15.120:0/278465864 <== mds.0 v2:172.21.15.120:6835/2154626843 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5627383bf4e0 con 0x5627384b3d40 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.473+0000 7fe79dffb640 10 client.5265 handle_command_reply: tid=0 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.473+0000 7fe7c8055740 1 client.5265 shutdown 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 -- 172.21.15.120:0/278465864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 msgr2=0x5627384b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b6620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4016a10 tx=0x7fe7b4004730 comp rx=0 tx=0).stop 2024-03-31T16:36:28.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 -- 172.21.15.120:0/278465864 shutdown_connections 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] conn(0x5627384b3d40 0x5627384b4120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384b6b60 0x5627384b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384aeb20 0x5627384b8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe79dffb640 0 client.5265 ms_handle_reset on v2:172.21.15.120:6835/2154626843 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 --2- 172.21.15.120:0/278465864 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b6620 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 -- 172.21.15.120:0/278465864 >> 172.21.15.120:0/278465864 conn(0x562738481c20 msgr2=0x5627384cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 -- 172.21.15.120:0/278465864 shutdown_connections 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 1 -- 172.21.15.120:0/278465864 wait complete. 2024-03-31T16:36:28.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.474+0000 7fe7c8055740 20 client.5265 trim_cache size 0 max 16384 2024-03-31T16:36:28.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7c8055740 1 Processor -- start 2024-03-31T16:36:28.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7c8055740 1 -- start start 2024-03-31T16:36:28.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x56273853fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384b6b60 0x5627384acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7c8055740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0200430 con 0x5627384ae740 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7c8055740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0151150 con 0x5627384aeb20 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7c8055740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c01ffde0 con 0x5627384b6b60 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.492+0000 7fe7beffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7beffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37768/0 (socket says 172.21.15.120:37768) 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7beffd640 1 -- 172.21.15.120:0/664783197 learned_addr learned my addr 172.21.15.120:0/664783197 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x56273853fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384b6b60 0x5627384acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7beffd640 1 -- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384b6b60 msgr2=0x5627384acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7beffd640 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384b6b60 0x5627384acf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7beffd640 1 -- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 msgr2=0x56273853fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7beffd640 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x56273853fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7beffd640 1 -- 172.21.15.120:0/664783197 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627384ccdb0 con 0x5627384ae740 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x56273853fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384b6b60 0x5627384acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe7beffd640 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b3020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40166d0 tx=0x7fe7b4025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08ed13ede5f1fa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe79ffff640 1 -- 172.21.15.120:0/664783197 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b403d070 con 0x5627384ae740 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe79ffff640 1 -- 172.21.15.120:0/664783197 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b4031040 con 0x5627384ae740 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.493+0000 7fe79ffff640 1 -- 172.21.15.120:0/664783197 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4024e60 con 0x5627384ae740 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 -- 172.21.15.120:0/664783197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 msgr2=0x5627384b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b3020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40166d0 tx=0x7fe7b4025000 comp rx=0 tx=0).stop 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 -- 172.21.15.120:0/664783197 shutdown_connections 2024-03-31T16:36:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384b6b60 0x5627384acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x56273853fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 --2- 172.21.15.120:0/664783197 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384ae740 0x5627384b3020 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 -- 172.21.15.120:0/664783197 >> 172.21.15.120:0/664783197 conn(0x562738481c20 msgr2=0x5627384b63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 -- 172.21.15.120:0/664783197 shutdown_connections 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 -- 172.21.15.120:0/664783197 wait complete. 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 -- start start 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.494+0000 7fe7c8055740 1 Processor -- start 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x5627384b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7c8055740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384b6b60 0x5627384cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7c8055740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5627384a2aa0 con 0x5627384b6b60 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7c8055740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5627384b8380 con 0x5627384aeb20 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7c8055740 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x5627384dc950 con 0x5627384ae740 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7c8055740 10 client.0 _ll_register_callbacks cb 0x7fe7b401a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7bf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384b6b60 0x5627384cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7bf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384b6b60 0x5627384cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37778/0 (socket says 172.21.15.120:37778) 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7bf7fe640 1 -- 172.21.15.120:0/2010388425 learned_addr learned my addr 172.21.15.120:0/2010388425 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7beffd640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x5627384b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7bf7fe640 1 -- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 msgr2=0x5627384b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7bf7fe640 1 -- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 msgr2=0x5627384b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x5627384b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7bf7fe640 1 -- 172.21.15.120:0/2010388425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627384eebb0 con 0x5627384b6b60 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7beffd640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.495+0000 7fe7be7fc640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x5627384b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7bf7fe640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384b6b60 0x5627384cf9e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe7c008e150 tx=0x7fe7b8007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5ca10bb73075c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe79dffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe79dffb640 1 -- 172.21.15.120:0/2010388425 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b801b070 con 0x5627384b6b60 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe79dffb640 1 -- 172.21.15.120:0/2010388425 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe7b800a830 con 0x5627384b6b60 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 1 -- 172.21.15.120:0/2010388425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7b4031040 con 0x5627384b6b60 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe79dffb640 1 -- 172.21.15.120:0/2010388425 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fe7b8026050 con 0x5627384b6b60 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 10 client.5271 fetch_fsmap learned FSMap version 14 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 1 -- 172.21.15.120:0/2010388425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56273853f040 con 0x5627384b6b60 2024-03-31T16:36:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe79dffb640 1 -- 172.21.15.120:0/2010388425 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b4031040 con 0x5627384b6b60 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe79dffb640 1 -- 172.21.15.120:0/2010388425 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7fe7b8029020 con 0x5627384b6b60 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 10 client.5271 fetch_fsmap finished waiting for FSMap version 14 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 10 client.5271 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 20 client.5271 populate_metadata read hostname 'smithi120' 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] conn(0x5627384d0350 0x5627384a1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 4 client.5271 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7c8055740 1 -- 172.21.15.120:0/2010388425 --> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] -- command(tid 0: {"prefix": "status"}) -- 0x5627383f8560 con 0x5627384d0350 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.496+0000 7fe7beffd640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] conn(0x5627384d0350 0x5627384a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe79dffb640 10 client.5271 ms_handle_connect on v2:172.21.15.120:6835/2154626843 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7beffd640 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] conn(0x5627384d0350 0x5627384a1220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d3ec15c711896aa server_cookie=a5040f20c6ecb759 in_seq=0 out_seq=0 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe79dffb640 1 -- 172.21.15.120:0/2010388425 <== mds.0 v2:172.21.15.120:6835/2154626843 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5627383f8560 con 0x5627384d0350 2024-03-31T16:36:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe79dffb640 10 client.5271 handle_command_reply: tid=0 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 client.5271 shutdown 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 -- 172.21.15.120:0/2010388425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384b6b60 msgr2=0x5627384cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384b6b60 0x5627384cf9e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe7c008e150 tx=0x7fe7b8007780 comp rx=0 tx=0).stop 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 -- 172.21.15.120:0/2010388425 shutdown_connections 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.120:6835/2154626843,v1:172.21.15.120:6837/2154626843] conn(0x5627384d0350 0x5627384a1220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5627384b6b60 0x5627384cf9e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5627384aeb20 0x5627384b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe79dffb640 0 client.5271 ms_handle_reset on v2:172.21.15.120:6835/2154626843 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 --2- 172.21.15.120:0/2010388425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x5627384ae740 0x5627384b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 -- 172.21.15.120:0/2010388425 >> 172.21.15.120:0/2010388425 conn(0x562738481c20 msgr2=0x5627384efe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:28.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 -- 172.21.15.120:0/2010388425 shutdown_connections 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 1 -- 172.21.15.120:0/2010388425 wait complete. 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.497+0000 7fe7c8055740 20 client.5271 trim_cache size 0 max 16384 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "8cbda8ce-b993-4141-a43e-650fa7bfe1da", 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5088, 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-03-31T16:36:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-03-31T16:36:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 4.6815012149999999, 2024-03-31T16:36:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 14, 2024-03-31T16:36:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 32, 2024-03-31T16:36:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 32, 2024-03-31T16:36:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 12.156555352 2024-03-31T16:36:28.512 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-03-31T16:36:28.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 -- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe7ac06c920 msgr2=0x7fe7ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe7ac06c920 0x7fe7ac06ede0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe7c006a2b0 tx=0x7fe7b4008040 comp rx=0 tx=0).stop 2024-03-31T16:36:28.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 -- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7c00cd0c0 msgr2=0x7fe7c00cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7c00cd0c0 0x7fe7c00cd540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0005040 tx=0x7fe7b0001120 comp rx=0 tx=0).stop 2024-03-31T16:36:28.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 -- 172.21.15.120:0/4155525764 shutdown_connections 2024-03-31T16:36:28.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe7ac06c920 0x7fe7ac06ede0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c00b3e30 0x7fe7c00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7c00cd0c0 0x7fe7c00cd540 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 --2- 172.21.15.120:0/4155525764 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7a8004800 0x7fe7c00b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 -- 172.21.15.120:0/4155525764 >> 172.21.15.120:0/4155525764 conn(0x7fe7c008bfb0 msgr2=0x7fe7c015ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:28.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 -- 172.21.15.120:0/4155525764 shutdown_connections 2024-03-31T16:36:28.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.498+0000 7fe7c5463640 1 -- 172.21.15.120:0/4155525764 wait complete. 2024-03-31T16:36:28.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-31T16:36:28.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.613+0000 7fd4b300d640 1 Processor -- start 2024-03-31T16:36:28.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.613+0000 7fd4b300d640 1 -- start start 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b300d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd4ac06c580 0x7fd4ac06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b300d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac06ea40 0x7fd4ac06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b300d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4ac067900 con 0x7fd4ac1590c0 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b300d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd4ac06e5b0 con 0x7fd4ac06c580 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b300d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd4ac0b47d0 con 0x7fd4ac06ea40 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b0da9640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd4ac1590c0 0x7fd4ac15f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33740/0 (socket says 172.21.15.120:33740) 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b0da9640 1 -- 172.21.15.120:0/2309760945 learned_addr learned my addr 172.21.15.120:0/2309760945 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4abfff640 1 --2- 172.21.15.120:0/2309760945 >> v2:172.21.15.203:3300/0 conn(0x7fd4ac06c580 0x7fd4ac06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344999547 0 0) 0x7fd4ac067900 con 0x7fd4ac1590c0 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b15aa640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac06ea40 0x7fd4ac06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c003520 con 0x7fd4ac1590c0 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4215936666 0 0) 0x7fd49c003520 con 0x7fd4ac1590c0 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac06ea40 msgr2=0x7fd4ac06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac06ea40 0x7fd4ac06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 >> v2:172.21.15.203:3300/0 conn(0x7fd4ac06c580 msgr2=0x7fd4ac06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 --2- 172.21.15.120:0/2309760945 >> v2:172.21.15.203:3300/0 conn(0x7fd4ac06c580 0x7fd4ac06ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ac0b4ab0 con 0x7fd4ac1590c0 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7fd4a0001670 con 0x7fd4ac1590c0 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 >> v1:172.21.15.120:6789/0 conn(0x7fd4ac1590c0 legacy=0x7fd4ac15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd49c0039b0 0x7fd49c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac06ea40 0x7fd49c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c004d40 0x7fd49c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac06e5b0 con 0x7fd49c0039b0 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac0b47d0 con 0x7fd49c004d40 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd49c00b9c0 con 0x7fd4ac06ea40 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.614+0000 7fd4b0da9640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd49c0039b0 0x7fd49c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.615+0000 7fd4abfff640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac06ea40 0x7fd49c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.615+0000 7fd4b15aa640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c004d40 0x7fd49c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.615+0000 7fd4b0da9640 1 -- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac06ea40 msgr2=0x7fd49c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.615+0000 7fd4b0da9640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac06ea40 0x7fd49c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.615+0000 7fd4b0da9640 1 -- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c004d40 msgr2=0x7fd49c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.615+0000 7fd4b0da9640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c004d40 0x7fd49c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.615+0000 7fd4b0da9640 1 -- 172.21.15.120:0/2309760945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c003520 con 0x7fd49c0039b0 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.615+0000 7fd4b15aa640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c004d40 0x7fd49c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.616+0000 7fd4b0da9640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd49c0039b0 0x7fd49c003dd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c210 tx=0x7fd49c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c3e6d4abc0d26b server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.616+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0007d70 con 0x7fd49c0039b0 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.616+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a0030070 con 0x7fd49c0039b0 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.616+0000 7fd4ab7fe640 1 -- 172.21.15.120:0/2309760945 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a002cd60 con 0x7fd49c0039b0 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.617+0000 7fd4b300d640 1 -- 172.21.15.120:0/2309760945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd49c0039b0 msgr2=0x7fd49c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.617+0000 7fd4b300d640 1 --2- 172.21.15.120:0/2309760945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd49c0039b0 0x7fd49c003dd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000c210 tx=0x7fd49c005830 comp rx=0 tx=0).stop 2024-03-31T16:36:28.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.617+0000 7fd4b15aa640 1 -- 172.21.15.120:0/2309760945 reap_dead start 2024-03-31T16:36:28.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.617+0000 7fd4b300d640 1 -- 172.21.15.120:0/2309760945 shutdown_connections 2024-03-31T16:36:28.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.617+0000 7fd4b300d640 1 -- 172.21.15.120:0/2309760945 >> 172.21.15.120:0/2309760945 conn(0x7fd4ac071e60 msgr2=0x7fd4ac072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:28.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.617+0000 7fd4b300d640 1 -- 172.21.15.120:0/2309760945 shutdown_connections 2024-03-31T16:36:28.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.617+0000 7fd4b300d640 1 -- 172.21.15.120:0/2309760945 wait complete. 2024-03-31T16:36:28.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.618+0000 7fd4b300d640 1 Processor -- start 2024-03-31T16:36:28.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.618+0000 7fd4b300d640 1 -- start start 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b300d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c0039b0 0x7fd4ac1435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b300d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac0cfcd0 0x7fd4ac0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b300d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4ac15b890 0x7fd4ac15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b300d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac0b4380 con 0x7fd4ac15b890 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b300d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac06e240 con 0x7fd49c0039b0 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b300d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd4ac0b4500 con 0x7fd4ac0cfcd0 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4ac15b890 0x7fd4ac15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4ac15b890 0x7fd4ac15bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37790/0 (socket says 172.21.15.120:37790) 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 -- 172.21.15.120:0/3663928352 learned_addr learned my addr 172.21.15.120:0/3663928352 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:36:28.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4abfff640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac0cfcd0 0x7fd4ac0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b0da9640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c0039b0 0x7fd4ac1435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 -- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac0cfcd0 msgr2=0x7fd4ac0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac0cfcd0 0x7fd4ac0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 -- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c0039b0 msgr2=0x7fd4ac1435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c0039b0 0x7fd4ac1435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 -- 172.21.15.120:0/3663928352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ac143af0 con 0x7fd4ac15b890 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4abfff640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac0cfcd0 0x7fd4ac0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b0da9640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c0039b0 0x7fd4ac1435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b15aa640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4ac15b890 0x7fd4ac15bd40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0759b0 tx=0x7fd4a4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4a97fa640 1 -- 172.21.15.120:0/3663928352 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a401a030 con 0x7fd4ac15b890 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4a97fa640 1 -- 172.21.15.120:0/3663928352 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a4010d20 con 0x7fd4ac15b890 2024-03-31T16:36:28.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ac14f300 con 0x7fd4ac15b890 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4a97fa640 1 -- 172.21.15.120:0/3663928352 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4003bd0 con 0x7fd4ac15b890 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.619+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ac14e260 con 0x7fd4ac15b890 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.620+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4ac0685c0 con 0x7fd4ac15b890 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.621+0000 7fd4a97fa640 1 -- 172.21.15.120:0/3663928352 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4a4005d10 con 0x7fd4ac15b890 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.621+0000 7fd4a97fa640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd49006c920 0x7fd49006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.622+0000 7fd4a97fa640 1 -- 172.21.15.120:0/3663928352 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd4a408c150 con 0x7fd4ac15b890 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.622+0000 7fd4b0da9640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd49006c920 0x7fd49006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.622+0000 7fd4b0da9640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd49006c920 0x7fd49006ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0034000 tx=0x7fd4a0007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:36:28.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.626+0000 7fd4a97fa640 1 -- 172.21.15.120:0/3663928352 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd4a4025020 con 0x7fd4ac15b890 2024-03-31T16:36:28.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.845+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd4ac0b3f00 con 0x7fd4ac15b890 2024-03-31T16:36:28.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.845+0000 7fd4a97fa640 1 -- 172.21.15.120:0/3663928352 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7fd4a405a610 con 0x7fd4ac15b890 2024-03-31T16:36:28.849 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-31T16:36:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd49006c920 msgr2=0x7fd49006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd49006c920 0x7fd49006ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0034000 tx=0x7fd4a0007000 comp rx=0 tx=0).stop 2024-03-31T16:36:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4ac15b890 msgr2=0x7fd4ac15bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:36:28.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4ac15b890 0x7fd4ac15bd40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0759b0 tx=0x7fd4a4010590 comp rx=0 tx=0).stop 2024-03-31T16:36:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 shutdown_connections 2024-03-31T16:36:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd49006c920 0x7fd49006ede0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd4ac15b890 0x7fd4ac15bd40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4ac0cfcd0 0x7fd4ac0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 --2- 172.21.15.120:0/3663928352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd49c0039b0 0x7fd4ac1435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:36:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 >> 172.21.15.120:0/3663928352 conn(0x7fd4ac071e60 msgr2=0x7fd4ac0ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:36:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 shutdown_connections 2024-03-31T16:36:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:28.847+0000 7fd4b300d640 1 -- 172.21.15.120:0/3663928352 wait complete. 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-31T16:36:28.862 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-31T16:36:28.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:28.863 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-03-31T16:36:28.878 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-31T16:36:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-31T16:36:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-03-31T16:36:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:36:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42671sec preferred_lft 42671sec 2024-03-31T16:36:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:f2:d8:9a:13:40 brd ff:ff:ff:ff:ff:ff 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::3024:58ff:fea2:4615/64 scope link 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 02:f2:d8:9a:13:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::f2:d8ff:fe9a:1340/64 scope link 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-31T16:36:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether c2:35:96:f4:e0:a0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-31T16:36:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::c035:96ff:fef4:e0a0/64 scope link 2024-03-31T16:36:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-03-31T16:36:28.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:28.881 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-31T16:36:28.944 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-03-31T16:36:28.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:28.946 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-03-31T16:36:29.002 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-03-31T16:36:29.002 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-31T16:36:29.002 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-31T16:36:29.002 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-31T16:36:29.002 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-31T16:36:29.003 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-31T16:36:29.003 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-03-31T16:36:29.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-31T16:36:29.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-31T16:36:29.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-31T16:36:29.003 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-03-31T16:36:29.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-31T16:36:29.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:36:29.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:29.139 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-03-31T16:36:29.153 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-31T16:36:29.153 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-31T16:36:29.154 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-31T16:36:29.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:29.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-03-31T16:36:29.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:36:29.221 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-31T16:36:29.275 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-31T16:36:29.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-31T16:36:29.276 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-31T16:36:29.330 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-31T16:36:29.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:29.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-31T16:36:29.415 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-31T16:36:29.415 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-31T16:36:29.415 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:36:29.424 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-31T16:36:29.424 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-31T16:36:29.424 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:36:29.424 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:36:29.424 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:36:29.429 INFO:teuthology.orchestra.run.smithi120.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-31T16:36:29.429 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-31T16:36:29.429 INFO:teuthology.orchestra.run.smithi120.stdout:invalid new device string format 2024-03-31T16:36:29.429 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.203:3300,172.21.15.203:3301" 2024-03-31T16:36:29.430 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-31T16:36:29.430 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: resolved to: "172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790" 2024-03-31T16:36:29.430 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.120:6789,172.21.15.203:6789,172.21.15.203:6790:/ 2024-03-31T16:36:29.430 INFO:teuthology.orchestra.run.smithi120.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8cbda8ce-b993-4141-a43e-650fa7bfe1da" will pass to kernel 2024-03-31T16:36:29.432 INFO:teuthology.orchestra.run.smithi120.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-31T16:36:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: You just mounted a file system that supports labels which does not 2024-03-31T16:36:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-31T16:36:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: applications will generate AVC messages and not be allowed access to 2024-03-31T16:36:29.432 INFO:teuthology.orchestra.run.smithi120.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-31T16:36:29.433 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-31T16:36:29.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:29.433 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-31T16:36:29.500 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-31T16:36:29.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-31T16:36:29.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:36:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-31T16:36:29.602 INFO:teuthology.orchestra.run.smithi120.stdout:client4892 2024-03-31T16:36:29.603 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:36:29.603 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-31T16:36:29.619 DEBUG:teuthology.orchestra.run.smithi120:> mktemp -d --suffix=xfstests-dev 2024-03-31T16:36:29.675 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.HCjZqVXECMxfstests-dev 2024-03-31T16:36:29.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:29.675 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.HCjZqVXECMxfstests-dev) 2024-03-31T16:36:29.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:29.743 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.HCjZqVXECMxfstests-dev) 2024-03-31T16:36:29.800 INFO:teuthology.orchestra.run.smithi120.stderr:Cloning into '/tmp/tmp.HCjZqVXECMxfstests-dev'... 2024-03-31T16:36:30.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:30.583 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-31T16:36:30.643 DEBUG:teuthology.orchestra.run.smithi120:> mktemp -d --suffix=test 2024-03-31T16:36:30.698 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.qAaS0p7MZjtest 2024-03-31T16:36:30.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:36:30.698 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-31T16:36:30.753 DEBUG:teuthology.orchestra.run.smithi120:> mktemp -d --suffix=scratch 2024-03-31T16:36:30.808 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:36:30.808 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-03-31T16:36:30.808 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-03-31T16:36:31.439 INFO:teuthology.orchestra.run.smithi120.stdout:Last metadata expiration check: 0:03:24 ago on Sun 31 Mar 2024 04:33:07 PM UTC. 2024-03-31T16:36:31.540 INFO:teuthology.orchestra.run.smithi120.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-03-31T16:36:31.541 INFO:teuthology.orchestra.run.smithi120.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-03-31T16:36:31.542 INFO:teuthology.orchestra.run.smithi120.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-03-31T16:36:31.543 INFO:teuthology.orchestra.run.smithi120.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-03-31T16:36:31.544 INFO:teuthology.orchestra.run.smithi120.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-03-31T16:36:31.546 INFO:teuthology.orchestra.run.smithi120.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-03-31T16:36:31.548 INFO:teuthology.orchestra.run.smithi120.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-03-31T16:36:31.549 INFO:teuthology.orchestra.run.smithi120.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-03-31T16:36:31.552 INFO:teuthology.orchestra.run.smithi120.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-03-31T16:36:31.555 INFO:teuthology.orchestra.run.smithi120.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-03-31T16:36:31.556 INFO:teuthology.orchestra.run.smithi120.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-03-31T16:36:31.558 INFO:teuthology.orchestra.run.smithi120.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-03-31T16:36:31.559 INFO:teuthology.orchestra.run.smithi120.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-03-31T16:36:31.560 INFO:teuthology.orchestra.run.smithi120.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-03-31T16:36:31.561 INFO:teuthology.orchestra.run.smithi120.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-03-31T16:36:31.562 INFO:teuthology.orchestra.run.smithi120.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-03-31T16:36:31.563 INFO:teuthology.orchestra.run.smithi120.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-03-31T16:36:31.564 INFO:teuthology.orchestra.run.smithi120.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-03-31T16:36:31.565 INFO:teuthology.orchestra.run.smithi120.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-03-31T16:36:31.568 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-03-31T16:36:31.635 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-03-31T16:36:31.639 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-03-31T16:36:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-03-31T16:36:31.639 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-03-31T16:36:31.639 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-03-31T16:36:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-03-31T16:36:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-31T16:36:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-devel x86_64 5.14.0-434.el9 CentOS-AppStream 16 M 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-03-31T16:36:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-03-31T16:36:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-31T16:36:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-31T16:36:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-31T16:36:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:31.643 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-03-31T16:36:31.643 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-03-31T16:36:31.643 INFO:teuthology.orchestra.run.smithi120.stdout:Install 17 Packages 2024-03-31T16:36:31.643 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 28 Packages 2024-03-31T16:36:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:36:31.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:36:31.644 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 103 M 2024-03-31T16:36:31.644 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-03-31T16:36:31.646 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:36:32.305 INFO:teuthology.orchestra.run.smithi120.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 111 kB/s | 17 kB 00:00 2024-03-31T16:36:32.322 INFO:teuthology.orchestra.run.smithi120.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 86 kB/s | 14 kB 00:00 2024-03-31T16:36:32.498 INFO:teuthology.orchestra.run.smithi120.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 70 kB/s | 13 kB 00:00 2024-03-31T16:36:32.514 INFO:teuthology.orchestra.run.smithi120.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 76 kB/s | 15 kB 00:00 2024-03-31T16:36:32.656 INFO:teuthology.orchestra.run.smithi120.stdout:(5/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 95 kB/s | 15 kB 00:00 2024-03-31T16:36:32.673 INFO:teuthology.orchestra.run.smithi120.stdout:(6/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 124 kB/s | 20 kB 00:00 2024-03-31T16:36:32.765 INFO:teuthology.orchestra.run.smithi120.stdout:(7/45): fio-3.35-1.el9.x86_64.rpm 10 MB/s | 6.2 MB 00:00 2024-03-31T16:36:32.799 INFO:teuthology.orchestra.run.smithi120.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 264 kB/s | 33 kB 00:00 2024-03-31T16:36:32.958 INFO:teuthology.orchestra.run.smithi120.stdout:(9/45): sqlite-3.34.1-7.el9.x86_64.rpm 3.8 MB/s | 747 kB 00:00 2024-03-31T16:36:32.992 INFO:teuthology.orchestra.run.smithi120.stdout:(10/45): udftools-2.2-5.el9.x86_64.rpm 752 kB/s | 144 kB 00:00 2024-03-31T16:36:33.150 INFO:teuthology.orchestra.run.smithi120.stdout:(11/45): kernel-devel-5.14.0-434.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-03-31T16:36:33.175 INFO:teuthology.orchestra.run.smithi120.stdout:(12/45): rmt-1.6-6.el9.x86_64.rpm 210 kB/s | 45 kB 00:00 2024-03-31T16:36:33.301 INFO:teuthology.orchestra.run.smithi120.stdout:(13/45): libnbd-1.18.1-3.el9.x86_64.rpm 540 kB/s | 166 kB 00:00 2024-03-31T16:36:33.334 INFO:teuthology.orchestra.run.smithi120.stdout:(14/45): gdbm-devel-1.19-4.el9.x86_64.rpm 370 kB/s | 59 kB 00:00 2024-03-31T16:36:33.368 INFO:teuthology.orchestra.run.smithi120.stdout:(15/45): gdbm-1.19-4.el9.x86_64.rpm 688 kB/s | 132 kB 00:00 2024-03-31T16:36:33.402 INFO:teuthology.orchestra.run.smithi120.stdout:(16/45): python-unversioned-command-3.9.18-3.el 248 kB/s | 8.3 kB 00:00 2024-03-31T16:36:33.452 INFO:teuthology.orchestra.run.smithi120.stdout:(17/45): python3-devel-3.9.18-3.el9.x86_64.rpm 4.0 MB/s | 204 kB 00:00 2024-03-31T16:36:33.494 INFO:teuthology.orchestra.run.smithi120.stdout:(18/45): python3-3.9.18-3.el9.x86_64.rpm 602 kB/s | 25 kB 00:00 2024-03-31T16:36:33.678 INFO:teuthology.orchestra.run.smithi120.stdout:(19/45): python3-libs-3.9.18-3.el9.x86_64.rpm 40 MB/s | 7.3 MB 00:00 2024-03-31T16:36:33.720 INFO:teuthology.orchestra.run.smithi120.stdout:(20/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 15 MB/s | 619 kB 00:00 2024-03-31T16:36:33.745 INFO:teuthology.orchestra.run.smithi120.stdout:(21/45): dump-0.4-0.51.b47.el9.x86_64.rpm 198 kB/s | 88 kB 00:00 2024-03-31T16:36:33.829 INFO:teuthology.orchestra.run.smithi120.stdout:(22/45): device-mapper-1.02.197-2.el9.x86_64.rp 1.3 MB/s | 141 kB 00:00 2024-03-31T16:36:33.854 INFO:teuthology.orchestra.run.smithi120.stdout:(23/45): device-mapper-event-1.02.197-2.el9.x86 315 kB/s | 34 kB 00:00 2024-03-31T16:36:33.879 INFO:teuthology.orchestra.run.smithi120.stdout:(24/45): indent-2.2.13-5.el9.x86_64.rpm 330 kB/s | 179 kB 00:00 2024-03-31T16:36:33.905 INFO:teuthology.orchestra.run.smithi120.stdout:(25/45): device-mapper-event-libs-1.02.197-2.el 426 kB/s | 32 kB 00:00 2024-03-31T16:36:33.980 INFO:teuthology.orchestra.run.smithi120.stdout:(26/45): device-mapper-libs-1.02.197-2.el9.x86_ 1.4 MB/s | 179 kB 00:00 2024-03-31T16:36:34.013 INFO:teuthology.orchestra.run.smithi120.stdout:(27/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 2.0 MB/s | 222 kB 00:00 2024-03-31T16:36:34.039 INFO:teuthology.orchestra.run.smithi120.stdout:(28/45): libcom_err-1.46.5-5.el9.x86_64.rpm 450 kB/s | 26 kB 00:00 2024-03-31T16:36:34.072 INFO:teuthology.orchestra.run.smithi120.stdout:(29/45): libgcc-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 92 kB 00:00 2024-03-31T16:36:34.131 INFO:teuthology.orchestra.run.smithi120.stdout:(30/45): libgomp-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 268 kB 00:00 2024-03-31T16:36:34.156 INFO:teuthology.orchestra.run.smithi120.stdout:(31/45): libss-1.46.5-5.el9.x86_64.rpm 380 kB/s | 32 kB 00:00 2024-03-31T16:36:34.232 INFO:teuthology.orchestra.run.smithi120.stdout:(32/45): libstdc++-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 743 kB 00:00 2024-03-31T16:36:34.265 INFO:teuthology.orchestra.run.smithi120.stdout:(33/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-03-31T16:36:34.358 INFO:teuthology.orchestra.run.smithi120.stdout:(34/45): lvm2-2.03.23-2.el9.x86_64.rpm 7.6 MB/s | 1.5 MB 00:00 2024-03-31T16:36:34.392 INFO:teuthology.orchestra.run.smithi120.stdout:(35/45): make-4.3-8.el9.x86_64.rpm 4.2 MB/s | 536 kB 00:00 2024-03-31T16:36:34.425 INFO:teuthology.orchestra.run.smithi120.stdout:(36/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2024-03-31T16:36:34.659 INFO:teuthology.orchestra.run.smithi120.stdout:(37/45): cpp-11.4.1-3.el9.x86_64.rpm 35 MB/s | 11 MB 00:00 2024-03-31T16:36:34.692 INFO:teuthology.orchestra.run.smithi120.stdout:(38/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 1.4 MB/s | 47 kB 00:00 2024-03-31T16:36:34.776 INFO:teuthology.orchestra.run.smithi120.stdout:(39/45): git-2.43.0-1.el9.x86_64.rpm 607 kB/s | 51 kB 00:00 2024-03-31T16:36:34.910 INFO:teuthology.orchestra.run.smithi120.stdout:(40/45): git-core-2.43.0-1.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-03-31T16:36:35.052 INFO:teuthology.orchestra.run.smithi120.stdout:(41/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 20 MB/s | 13 MB 00:00 2024-03-31T16:36:35.110 INFO:teuthology.orchestra.run.smithi120.stdout:(42/45): git-core-doc-2.43.0-1.el9.noarch.rpm 15 MB/s | 2.9 MB 00:00 2024-03-31T16:36:35.169 INFO:teuthology.orchestra.run.smithi120.stdout:(43/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 21 MB/s | 2.4 MB 00:00 2024-03-31T16:36:35.194 INFO:teuthology.orchestra.run.smithi120.stdout:(44/45): perl-Git-2.43.0-1.el9.noarch.rpm 453 kB/s | 38 kB 00:00 2024-03-31T16:36:35.545 INFO:teuthology.orchestra.run.smithi120.stdout:(45/45): gcc-11.4.1-3.el9.x86_64.rpm 28 MB/s | 32 MB 00:01 2024-03-31T16:36:35.546 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-03-31T16:36:35.547 INFO:teuthology.orchestra.run.smithi120.stdout:Total 26 MB/s | 103 MB 00:03 2024-03-31T16:36:36.387 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-03-31T16:36:36.698 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-03-31T16:36:36.698 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-03-31T16:36:38.170 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-03-31T16:36:38.171 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-03-31T16:36:41.377 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-03-31T16:36:41.429 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-31T16:36:41.491 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-31T16:36:41.565 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-03-31T16:36:41.624 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-03-31T16:36:41.680 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-03-31T16:36:41.727 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-03-31T16:36:41.778 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-03-31T16:36:41.982 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-03-31T16:36:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-03-31T16:36:42.268 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-03-31T16:36:43.649 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-03-31T16:36:43.755 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-03-31T16:36:43.794 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-03-31T16:36:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-03-31T16:36:44.726 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-03-31T16:36:44.765 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-03-31T16:36:44.802 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-03-31T16:36:44.834 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-31T16:36:45.088 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-31T16:36:45.737 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-03-31T16:36:45.859 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-03-31T16:36:46.304 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-03-31T16:36:46.391 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-03-31T16:36:47.422 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-03-31T16:36:47.587 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-03-31T16:36:47.626 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-03-31T16:36:47.662 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-03-31T16:36:47.690 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-03-31T16:36:47.716 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-03-31T16:36:47.750 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-03-31T16:36:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-03-31T16:36:47.826 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-03-31T16:36:47.851 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-03-31T16:36:48.007 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-03-31T16:36:48.045 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-03-31T16:36:48.076 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-03-31T16:36:48.106 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-03-31T16:36:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-03-31T16:36:58.141 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-devel-5.14.0-434.el9.x86_64 36/73 2024-03-31T16:37:01.797 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:37:01.800 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:37:08.682 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-devel-5.14.0-434.el9.x86_64 36/73 2024-03-31T16:37:08.747 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-03-31T16:37:08.771 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-31T16:37:08.871 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-31T16:37:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-03-31T16:37:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-31T16:37:09.049 INFO:teuthology.orchestra.run.smithi120.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-03-31T16:37:09.049 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:37:09.369 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-31T16:37:09.429 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-03-31T16:37:09.492 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-03-31T16:37:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-03-31T16:37:09.613 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-03-31T16:37:09.642 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-03-31T16:37:09.671 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-03-31T16:37:09.704 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-03-31T16:37:09.743 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-03-31T16:37:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-03-31T16:37:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-03-31T16:37:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-03-31T16:37:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-31T16:37:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-31T16:37:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-03-31T16:37:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-31T16:37:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-31T16:37:09.974 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-31T16:37:10.019 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-03-31T16:37:10.062 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-03-31T16:37:10.088 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-03-31T16:37:10.113 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-03-31T16:37:10.118 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-31T16:37:10.147 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-31T16:37:10.172 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-03-31T16:37:10.198 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-03-31T16:37:10.223 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-03-31T16:37:10.265 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-03-31T16:37:10.290 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-03-31T16:37:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-03-31T16:37:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-03-31T16:37:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-03-31T16:37:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-03-31T16:37:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-31T16:37:10.607 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-31T16:37:10.638 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-03-31T16:37:10.671 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-03-31T16:37:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-03-31T16:37:10.766 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-03-31T16:37:13.221 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-03-31T16:37:13.221 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-03-31T16:37:13.221 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-devel-5.14.0-434.el9.x86_64 8/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 9/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 10/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : udftools-2.2-5.el9.x86_64 11/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 12/73 2024-03-31T16:37:13.222 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-03-31T16:37:13.223 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-03-31T16:37:13.223 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-03-31T16:37:13.223 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-03-31T16:37:13.223 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-03-31T16:37:13.223 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-03-31T16:37:13.223 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-03-31T16:37:13.224 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-03-31T16:37:13.224 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-03-31T16:37:13.224 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-03-31T16:37:13.224 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-03-31T16:37:13.224 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-03-31T16:37:13.224 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-03-31T16:37:13.225 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-03-31T16:37:13.225 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-03-31T16:37:13.225 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-03-31T16:37:13.225 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-03-31T16:37:13.226 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-03-31T16:37:13.227 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-03-31T16:37:13.227 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-03-31T16:37:13.227 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-03-31T16:37:13.227 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-03-31T16:37:13.227 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-03-31T16:37:13.227 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-03-31T16:37:13.227 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-03-31T16:37:13.227 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-03-31T16:37:13.228 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-03-31T16:37:13.229 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-03-31T16:37:13.229 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-03-31T16:37:13.229 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-03-31T16:37:13.229 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-03-31T16:37:13.229 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-03-31T16:37:13.229 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-03-31T16:37:13.229 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-03-31T16:37:13.229 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-03-31T16:37:14.319 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: cpp-11.4.1-3.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: gcc-11.4.1-3.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-03-31T16:37:14.320 INFO:teuthology.orchestra.run.smithi120.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: git-2.43.0-1.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: git-core-2.43.0-1.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: libgcc-11.4.1-3.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: libgomp-11.4.1-3.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: libss-1.46.5-5.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: make-1:4.3-8.el9.x86_64 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: perl-Git-2.43.0-1.el9.noarch 2024-03-31T16:37:14.321 INFO:teuthology.orchestra.run.smithi120.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-3.9.18-3.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-03-31T16:37:14.322 INFO:teuthology.orchestra.run.smithi120.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-434.el9.x86_64 2024-03-31T16:37:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-31T16:37:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-03-31T16:37:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: udftools-2.2-5.el9.x86_64 2024-03-31T16:37:14.323 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:37:14.323 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-03-31T16:37:15.146 DEBUG:teuthology.orchestra.run.smithi120:> sudo useradd -m fsgqa 2024-03-31T16:37:15.179 INFO:teuthology.orchestra.run.smithi120.stderr:useradd: user 'fsgqa' already exists 2024-03-31T16:37:15.180 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-31T16:37:15.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo groupadd fsgqa 2024-03-31T16:37:15.249 INFO:teuthology.orchestra.run.smithi120.stderr:groupadd: group 'fsgqa' already exists 2024-03-31T16:37:15.250 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-31T16:37:15.251 DEBUG:teuthology.orchestra.run.smithi120:> sudo useradd fsgqa2 2024-03-31T16:37:16.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo useradd 123456-fsgqa 2024-03-31T16:37:16.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-31T16:37:16.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.681+0000 7f58829bd640 1 Processor -- start 2024-03-31T16:37:16.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.681+0000 7f58829bd640 1 -- start start 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.682+0000 7f58829bd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c15e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.682+0000 7f58829bd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f587c0b4620 0x7f587c15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.682+0000 7f58829bd640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f587c0b4c00 con 0x7f587c15ac50 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.682+0000 7f58829bd640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f587c06d5b0 con 0x7f587c0b4620 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.682+0000 7f58829bd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f587c06db70 con 0x7f587c15a870 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.682+0000 7f5880f5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f587c0b4620 0x7f587c15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.682+0000 7f5880f5a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f587c0b4620 0x7f587c15ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39234/0 (socket says 172.21.15.120:39234) 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.682+0000 7f5880f5a640 1 -- 172.21.15.120:0/1177430240 learned_addr learned my addr 172.21.15.120:0/1177430240 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.683+0000 7f587bfff640 1 --2- 172.21.15.120:0/1177430240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:16.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.683+0000 7f5880f5a640 1 -- 172.21.15.120:0/1177430240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 msgr2=0x7f587c15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.683+0000 7f5880f5a640 1 --2- 172.21.15.120:0/1177430240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.683+0000 7f5880f5a640 1 -- 172.21.15.120:0/1177430240 >> v1:172.21.15.203:6789/0 conn(0x7f587c15ac50 legacy=0x7f587c0b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.683+0000 7f5880f5a640 1 -- 172.21.15.120:0/1177430240 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c0b4ee0 con 0x7f587c0b4620 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.683+0000 7f587bfff640 1 --2- 172.21.15.120:0/1177430240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.683+0000 7f5880f5a640 1 --2- 172.21.15.120:0/1177430240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c15ead0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5874009e50 tx=0x7f587402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd38be3f5bd714f server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.683+0000 7f587affd640 1 -- 172.21.15.120:0/1177430240 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587402c9e0 con 0x7f587c0b4620 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f587affd640 1 -- 172.21.15.120:0/1177430240 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587402cb80 con 0x7f587c0b4620 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f587affd640 1 -- 172.21.15.120:0/1177430240 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58740343f0 con 0x7f587c0b4620 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f58829bd640 1 -- 172.21.15.120:0/1177430240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 msgr2=0x7f587c15ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f58829bd640 1 --2- 172.21.15.120:0/1177430240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c15ead0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5874009e50 tx=0x7f587402be40 comp rx=0 tx=0).stop 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f58829bd640 1 -- 172.21.15.120:0/1177430240 shutdown_connections 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f58829bd640 1 --2- 172.21.15.120:0/1177430240 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c15ead0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f58829bd640 1 --2- 172.21.15.120:0/1177430240 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f58829bd640 1 -- 172.21.15.120:0/1177430240 >> 172.21.15.120:0/1177430240 conn(0x7f587c06b750 msgr2=0x7f587c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:37:16.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f58829bd640 1 -- 172.21.15.120:0/1177430240 shutdown_connections 2024-03-31T16:37:16.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.684+0000 7f58829bd640 1 -- 172.21.15.120:0/1177430240 wait complete. 2024-03-31T16:37:16.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.685+0000 7f58829bd640 1 Processor -- start 2024-03-31T16:37:16.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f58829bd640 1 -- start start 2024-03-31T16:37:16.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f58829bd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:16.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f58829bd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f58829bd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f587c15ac50 0x7f587c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f58829bd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f587c0d0400 con 0x7f587c0b4620 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f58829bd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f587c0d0280 con 0x7f587c15ac50 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f58829bd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f587c0d0580 con 0x7f587c15a870 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f587bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f587bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c1576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39248/0 (socket says 172.21.15.120:39248) 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.686+0000 7f587bfff640 1 -- 172.21.15.120:0/1220067165 learned_addr learned my addr 172.21.15.120:0/1220067165 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f5880f5a640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f587c15ac50 0x7f587c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f587b7fe640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f587bfff640 1 -- 172.21.15.120:0/1220067165 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 msgr2=0x7f587c14b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f587bfff640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c14b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f587bfff640 1 -- 172.21.15.120:0/1220067165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f587c15ac50 msgr2=0x7f587c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f587bfff640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f587c15ac50 0x7f587c158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f587bfff640 1 -- 172.21.15.120:0/1220067165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c157ee0 con 0x7f587c0b4620 2024-03-31T16:37:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f587bfff640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c1576b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c7f0 tx=0x7f586c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:37:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f5878ff9640 1 -- 172.21.15.120:0/1220067165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c015070 con 0x7f587c0b4620 2024-03-31T16:37:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f5878ff9640 1 -- 172.21.15.120:0/1220067165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586c007a30 con 0x7f587c0b4620 2024-03-31T16:37:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587c1581c0 con 0x7f587c0b4620 2024-03-31T16:37:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f5878ff9640 1 -- 172.21.15.120:0/1220067165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c007e00 con 0x7f587c0b4620 2024-03-31T16:37:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.687+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587c158780 con 0x7f587c0b4620 2024-03-31T16:37:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.688+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587c155940 con 0x7f587c0b4620 2024-03-31T16:37:16.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.689+0000 7f5878ff9640 1 -- 172.21.15.120:0/1220067165 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f586c018070 con 0x7f587c0b4620 2024-03-31T16:37:16.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.689+0000 7f5878ff9640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f586806c8f0 0x7f586806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:16.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.690+0000 7f5878ff9640 1 -- 172.21.15.120:0/1220067165 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f586c08baa0 con 0x7f587c0b4620 2024-03-31T16:37:16.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.690+0000 7f587b7fe640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f586806c8f0 0x7f586806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:16.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.690+0000 7f587b7fe640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f586806c8f0 0x7f586806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f5870008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:37:16.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.698+0000 7f5878ff9640 1 -- 172.21.15.120:0/1220067165 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f587c155940 con 0x7f587c0b4620 2024-03-31T16:37:16.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.948+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f587c0685c0 con 0x7f587c0b4620 2024-03-31T16:37:16.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.949+0000 7f5878ff9640 1 -- 172.21.15.120:0/1220067165 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7f586c059f60 con 0x7f587c0b4620 2024-03-31T16:37:16.953 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:37:16.953 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","modified":"2024-03-31T16:34:33.108523Z","created":"2024-03-31T16:34:33.108523Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3301","nonce":0},{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-31T16:37:16.953 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2024-03-31T16:37:16.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f586806c8f0 msgr2=0x7f586806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:16.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f586806c8f0 0x7f586806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f5870008040 comp rx=0 tx=0).stop 2024-03-31T16:37:16.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 msgr2=0x7f587c1576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:16.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c1576b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c7f0 tx=0x7f586c00cbf0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 shutdown_connections 2024-03-31T16:37:16.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f586806c8f0 0x7f586806edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f587c15ac50 0x7f587c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f587c15a870 0x7f587c14b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 --2- 172.21.15.120:0/1220067165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f587c0b4620 0x7f587c1576b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:16.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 >> 172.21.15.120:0/1220067165 conn(0x7f587c06b750 msgr2=0x7f587c15d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:37:16.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 shutdown_connections 2024-03-31T16:37:16.956 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:16.951+0000 7f58829bd640 1 -- 172.21.15.120:0/1220067165 wait complete. 2024-03-31T16:37:16.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-03-31T16:37:17.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.102+0000 7f40d0e08640 1 Processor -- start 2024-03-31T16:37:17.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.102+0000 7f40d0e08640 1 -- start start 2024-03-31T16:37:17.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40d0e08640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f40cc155550 0x7f40cc155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40d0e08640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40cc15f800 0x7f40cc0d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40d0e08640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc0d07c0 0x7f40cc0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40d0e08640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f40cc0d0c10 con 0x7f40cc15f800 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40d0e08640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f40cc0b40b0 con 0x7f40cc155550 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40d0e08640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f40cc0b4390 con 0x7f40cc0d07c0 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40c1d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40cc15f800 0x7f40cc0d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40c1d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f40cc15f800 0x7f40cc0d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39258/0 (socket says 172.21.15.120:39258) 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40c1d9b640 1 -- 172.21.15.120:0/1385271311 learned_addr learned my addr 172.21.15.120:0/1385271311 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40c1d9b640 1 -- 172.21.15.120:0/1385271311 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc0d07c0 msgr2=0x7f40cc0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40c1d9b640 1 --2- 172.21.15.120:0/1385271311 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc0d07c0 0x7f40cc0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40c1d9b640 1 -- 172.21.15.120:0/1385271311 >> v2:172.21.15.203:3300/0 conn(0x7f40cc155550 msgr2=0x7f40cc155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40c1d9b640 1 --2- 172.21.15.120:0/1385271311 >> v2:172.21.15.203:3300/0 conn(0x7f40cc155550 0x7f40cc155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.103+0000 7f40c1d9b640 1 -- 172.21.15.120:0/1385271311 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc0b4670 con 0x7f40cc15f800 2024-03-31T16:37:17.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40c1d9b640 1 --2- 172.21.15.120:0/1385271311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc15f800 0x7f40cc0d0280 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f40cc073ac0 tx=0x7f40b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c31503fe266d50 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:37:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40c9d9b640 1 -- 172.21.15.120:0/1385271311 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4035020 con 0x7f40cc15f800 2024-03-31T16:37:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40c9d9b640 1 -- 172.21.15.120:0/1385271311 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b4031870 con 0x7f40cc15f800 2024-03-31T16:37:17.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40c9d9b640 1 -- 172.21.15.120:0/1385271311 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4031c40 con 0x7f40cc15f800 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40d0e08640 1 -- 172.21.15.120:0/1385271311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc15f800 msgr2=0x7f40cc0d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40d0e08640 1 --2- 172.21.15.120:0/1385271311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc15f800 0x7f40cc0d0280 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f40cc073ac0 tx=0x7f40b402b910 comp rx=0 tx=0).stop 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40d0e08640 1 -- 172.21.15.120:0/1385271311 shutdown_connections 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40d0e08640 1 --2- 172.21.15.120:0/1385271311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc15f800 0x7f40cc0d0280 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40d0e08640 1 --2- 172.21.15.120:0/1385271311 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc0d07c0 0x7f40cc0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40d0e08640 1 --2- 172.21.15.120:0/1385271311 >> v2:172.21.15.203:3300/0 conn(0x7f40cc155550 0x7f40cc155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.104+0000 7f40d0e08640 1 -- 172.21.15.120:0/1385271311 >> 172.21.15.120:0/1385271311 conn(0x7f40cc06b750 msgr2=0x7f40cc06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.105+0000 7f40d0e08640 1 -- 172.21.15.120:0/1385271311 shutdown_connections 2024-03-31T16:37:17.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.105+0000 7f40d0e08640 1 -- 172.21.15.120:0/1385271311 wait complete. 2024-03-31T16:37:17.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.106+0000 7f40d0e08640 1 Processor -- start 2024-03-31T16:37:17.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.106+0000 7f40d0e08640 1 -- start start 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40d0e08640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc0d07c0 0x7f40cc1f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40d0e08640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc155550 0x7f40cc09bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40d0e08640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc15f800 0x7f40cc0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40d0e08640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc15fc80 con 0x7f40cc0d07c0 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40d0e08640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc0b4c30 con 0x7f40cc155550 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40d0e08640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f40cc15ba20 con 0x7f40cc15f800 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc0d07c0 0x7f40cc1f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc0d07c0 0x7f40cc1f4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39268/0 (socket says 172.21.15.120:39268) 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 -- 172.21.15.120:0/2070244109 learned_addr learned my addr 172.21.15.120:0/2070244109 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40c1d9b640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc155550 0x7f40cc09bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:17.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40cad9d640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc15f800 0x7f40cc0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 -- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc15f800 msgr2=0x7f40cc0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc15f800 0x7f40cc0b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 -- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc155550 msgr2=0x7f40cc09bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc155550 0x7f40cc09bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 -- 172.21.15.120:0/2070244109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc09c440 con 0x7f40cc0d07c0 2024-03-31T16:37:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40cad9d640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc15f800 0x7f40cc0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-31T16:37:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40ca59c640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc0d07c0 0x7f40cc1f4080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00b4a0 tx=0x7f40bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:37:17.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40c37fe640 1 -- 172.21.15.120:0/2070244109 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc014070 con 0x7f40cc0d07c0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40c37fe640 1 -- 172.21.15.120:0/2070244109 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40bc010610 con 0x7f40cc0d07c0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.107+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40cc09c720 con 0x7f40cc0d07c0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.108+0000 7f40c37fe640 1 -- 172.21.15.120:0/2070244109 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc010a00 con 0x7f40cc0d07c0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.108+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40cc15cc80 con 0x7f40cc0d07c0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.109+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40cc0685c0 con 0x7f40cc0d07c0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.109+0000 7f40c37fe640 1 -- 172.21.15.120:0/2070244109 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f40bc017070 con 0x7f40cc0d07c0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.109+0000 7f40c37fe640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f40ac06c8f0 0x7f40ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.110+0000 7f40c1d9b640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f40ac06c8f0 0x7f40ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.110+0000 7f40c37fe640 1 -- 172.21.15.120:0/2070244109 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f40bc08b650 con 0x7f40cc0d07c0 2024-03-31T16:37:17.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.110+0000 7f40c1d9b640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f40ac06c8f0 0x7f40ac06edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f40b4036000 tx=0x7f40b403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-31T16:37:17.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.114+0000 7f40c37fe640 1 -- 172.21.15.120:0/2070244109 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f40bc059a00 con 0x7f40cc0d07c0 2024-03-31T16:37:17.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.362+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f40cc0cc560 con 0x7f40cc0d07c0 2024-03-31T16:37:17.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.363+0000 7f40c37fe640 1 -- 172.21.15.120:0/2070244109 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) ==== 92+0+63 (secure 0 0 0) 0x7f40bc059300 con 0x7f40cc0d07c0 2024-03-31T16:37:17.367 INFO:teuthology.orchestra.run.smithi120.stdout:[client.admin] 2024-03-31T16:37:17.367 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== 2024-03-31T16:37:17.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f40ac06c8f0 msgr2=0x7f40ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:17.369 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f40ac06c8f0 0x7f40ac06edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f40b4036000 tx=0x7f40b403c040 comp rx=0 tx=0).stop 2024-03-31T16:37:17.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc0d07c0 msgr2=0x7f40cc1f4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-31T16:37:17.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc0d07c0 0x7f40cc1f4080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f40bc00b4a0 tx=0x7f40bc00b960 comp rx=0 tx=0).stop 2024-03-31T16:37:17.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 shutdown_connections 2024-03-31T16:37:17.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f40ac06c8f0 0x7f40ac06edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40cc15f800 0x7f40cc0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40cc155550 0x7f40cc09bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.370 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 --2- 172.21.15.120:0/2070244109 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40cc0d07c0 0x7f40cc1f4080 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-31T16:37:17.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 >> 172.21.15.120:0/2070244109 conn(0x7f40cc06b750 msgr2=0x7f40cc0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-31T16:37:17.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 shutdown_connections 2024-03-31T16:37:17.371 INFO:teuthology.orchestra.run.smithi120.stderr:2024-03-31T16:37:17.365+0000 7f40d0e08640 1 -- 172.21.15.120:0/2070244109 wait complete. 2024-03-31T16:37:17.380 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:37:17.380 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/tmp/tmp.HCjZqVXECMxfstests-dev/local.config 2024-03-31T16:37:17.407 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.120:6789:/test export TEST_DIR=/tmp/tmp.qAaS0p7MZjtest export SCRATCH_DEV=172.21.15.120:6789:/scratch export SCRATCH_MNT=/tmp/tmp.QrZcf5mS2uscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA==" 2024-03-31T16:37:17.407 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-03-31T16:37:17.407 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/tmp/tmp.HCjZqVXECMxfstests-dev/ceph.exclude 2024-03-31T16:37:17.473 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo make) 2024-03-31T16:37:17.544 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize -cfi 2024-03-31T16:37:17.954 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-31T16:37:17.955 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file './config.guess' 2024-03-31T16:37:17.958 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file './config.sub' 2024-03-31T16:37:17.961 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file './install-sh' 2024-03-31T16:37:17.965 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file './ltmain.sh' 2024-03-31T16:37:17.987 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-31T16:37:17.987 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-31T16:37:17.992 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-31T16:37:17.996 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-31T16:37:18.001 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-31T16:37:18.006 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-31T16:37:18.012 INFO:teuthology.orchestra.run.smithi120.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-31T16:37:18.014 INFO:teuthology.orchestra.run.smithi120.stdout:cp include/install-sh . 2024-03-31T16:37:18.015 INFO:teuthology.orchestra.run.smithi120.stdout:aclocal -I m4 2024-03-31T16:37:19.032 INFO:teuthology.orchestra.run.smithi120.stdout:autoheader 2024-03-31T16:37:19.318 INFO:teuthology.orchestra.run.smithi120.stdout:autoconf 2024-03-31T16:37:19.486 INFO:teuthology.orchestra.run.smithi120.stdout:./configure \ 2024-03-31T16:37:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: --libexecdir=/usr/lib \ 2024-03-31T16:37:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: --exec_prefix=/var/lib 2024-03-31T16:37:19.713 INFO:teuthology.orchestra.run.smithi120.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-31T16:37:19.713 INFO:teuthology.orchestra.run.smithi120.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-31T16:37:19.715 INFO:teuthology.orchestra.run.smithi120.stdout:checking how to print strings... printf 2024-03-31T16:37:19.715 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gcc... gcc 2024-03-31T16:37:19.773 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether the C compiler works... yes 2024-03-31T16:37:19.773 INFO:teuthology.orchestra.run.smithi120.stdout:checking for C compiler default output file name... a.out 2024-03-31T16:37:19.804 INFO:teuthology.orchestra.run.smithi120.stdout:checking for suffix of executables... 2024-03-31T16:37:19.869 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether we are cross compiling... no 2024-03-31T16:37:19.886 INFO:teuthology.orchestra.run.smithi120.stdout:checking for suffix of object files... o 2024-03-31T16:37:19.901 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether we are using the GNU C compiler... yes 2024-03-31T16:37:19.916 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether gcc accepts -g... yes 2024-03-31T16:37:19.943 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-31T16:37:19.945 INFO:teuthology.orchestra.run.smithi120.stdout:checking for a sed that does not truncate output... /bin/sed 2024-03-31T16:37:19.947 INFO:teuthology.orchestra.run.smithi120.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-03-31T16:37:19.948 INFO:teuthology.orchestra.run.smithi120.stdout:checking for egrep... /bin/grep -E 2024-03-31T16:37:19.949 INFO:teuthology.orchestra.run.smithi120.stdout:checking for fgrep... /bin/grep -F 2024-03-31T16:37:19.952 INFO:teuthology.orchestra.run.smithi120.stdout:checking for ld used by gcc... /bin/ld 2024-03-31T16:37:19.953 INFO:teuthology.orchestra.run.smithi120.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-03-31T16:37:19.965 INFO:teuthology.orchestra.run.smithi120.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-03-31T16:37:20.988 INFO:teuthology.orchestra.run.smithi120.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-03-31T16:37:20.988 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether ln -s works... yes 2024-03-31T16:37:20.996 INFO:teuthology.orchestra.run.smithi120.stdout:checking the maximum length of command line arguments... 1572864 2024-03-31T16:37:20.999 INFO:teuthology.orchestra.run.smithi120.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-31T16:37:20.999 INFO:teuthology.orchestra.run.smithi120.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-31T16:37:20.999 INFO:teuthology.orchestra.run.smithi120.stdout:checking for /bin/ld option to reload object files... -r 2024-03-31T16:37:20.999 INFO:teuthology.orchestra.run.smithi120.stdout:checking for objdump... objdump 2024-03-31T16:37:20.999 INFO:teuthology.orchestra.run.smithi120.stdout:checking how to recognize dependent libraries... pass_all 2024-03-31T16:37:20.999 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dlltool... no 2024-03-31T16:37:20.999 INFO:teuthology.orchestra.run.smithi120.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-31T16:37:20.999 INFO:teuthology.orchestra.run.smithi120.stdout:checking for ar... ar 2024-03-31T16:37:21.032 INFO:teuthology.orchestra.run.smithi120.stdout:checking for archiver @FILE support... @ 2024-03-31T16:37:21.032 INFO:teuthology.orchestra.run.smithi120.stdout:checking for strip... strip 2024-03-31T16:37:21.033 INFO:teuthology.orchestra.run.smithi120.stdout:checking for ranlib... ranlib 2024-03-31T16:37:21.033 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gawk... gawk 2024-03-31T16:37:21.093 INFO:teuthology.orchestra.run.smithi120.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-03-31T16:37:21.094 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sysroot... no 2024-03-31T16:37:21.097 INFO:teuthology.orchestra.run.smithi120.stdout:checking for a working dd... /bin/dd 2024-03-31T16:37:21.099 INFO:teuthology.orchestra.run.smithi120.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-03-31T16:37:21.112 INFO:teuthology.orchestra.run.smithi120.stdout:checking for mt... no 2024-03-31T16:37:21.113 INFO:teuthology.orchestra.run.smithi120.stdout:checking if : is a manifest tool... no 2024-03-31T16:37:21.184 INFO:teuthology.orchestra.run.smithi120.stdout:checking how to run the C preprocessor... gcc -E 2024-03-31T16:37:21.382 INFO:teuthology.orchestra.run.smithi120.stdout:checking for ANSI C header files... yes 2024-03-31T16:37:21.402 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/types.h... yes 2024-03-31T16:37:21.430 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/stat.h... yes 2024-03-31T16:37:21.453 INFO:teuthology.orchestra.run.smithi120.stdout:checking for stdlib.h... yes 2024-03-31T16:37:21.476 INFO:teuthology.orchestra.run.smithi120.stdout:checking for string.h... yes 2024-03-31T16:37:21.507 INFO:teuthology.orchestra.run.smithi120.stdout:checking for memory.h... yes 2024-03-31T16:37:21.531 INFO:teuthology.orchestra.run.smithi120.stdout:checking for strings.h... yes 2024-03-31T16:37:21.563 INFO:teuthology.orchestra.run.smithi120.stdout:checking for inttypes.h... yes 2024-03-31T16:37:21.588 INFO:teuthology.orchestra.run.smithi120.stdout:checking for stdint.h... yes 2024-03-31T16:37:21.626 INFO:teuthology.orchestra.run.smithi120.stdout:checking for unistd.h... yes 2024-03-31T16:37:21.663 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dlfcn.h... yes 2024-03-31T16:37:21.666 INFO:teuthology.orchestra.run.smithi120.stdout:checking for objdir... .libs 2024-03-31T16:37:21.727 INFO:teuthology.orchestra.run.smithi120.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-31T16:37:21.727 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-31T16:37:21.742 INFO:teuthology.orchestra.run.smithi120.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-31T16:37:21.759 INFO:teuthology.orchestra.run.smithi120.stdout:checking if gcc static flag -static works... no 2024-03-31T16:37:21.779 INFO:teuthology.orchestra.run.smithi120.stdout:checking if gcc supports -c -o file.o... yes 2024-03-31T16:37:21.779 INFO:teuthology.orchestra.run.smithi120.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-31T16:37:21.786 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-31T16:37:21.811 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether -lc should be explicitly linked in... no 2024-03-31T16:37:21.869 INFO:teuthology.orchestra.run.smithi120.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-31T16:37:21.869 INFO:teuthology.orchestra.run.smithi120.stdout:checking how to hardcode library paths into programs... immediate 2024-03-31T16:37:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether stripping libraries is possible... yes 2024-03-31T16:37:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:checking if libtool supports shared libraries... yes 2024-03-31T16:37:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether to build shared libraries... yes 2024-03-31T16:37:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether to build static libraries... yes 2024-03-31T16:37:21.876 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gcc... (cached) gcc 2024-03-31T16:37:21.892 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-31T16:37:21.892 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-31T16:37:21.892 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-31T16:37:21.892 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gmake... /usr/bin/gmake 2024-03-31T16:37:21.892 INFO:teuthology.orchestra.run.smithi120.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-03-31T16:37:21.893 INFO:teuthology.orchestra.run.smithi120.stdout:checking for tar... /bin/tar 2024-03-31T16:37:21.893 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gzip... /bin/gzip 2024-03-31T16:37:21.901 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether gcc -MM is supported... yes 2024-03-31T16:37:21.901 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sort... /bin/sort 2024-03-31T16:37:21.901 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether ln -s works... yes 2024-03-31T16:37:21.901 INFO:teuthology.orchestra.run.smithi120.stdout:checking for rpm... /bin/rpm 2024-03-31T16:37:21.904 INFO:teuthology.orchestra.run.smithi120.stdout:checking for rpmbuild... no 2024-03-31T16:37:21.938 INFO:teuthology.orchestra.run.smithi120.stdout:checking assert.h usability... yes 2024-03-31T16:37:21.946 INFO:teuthology.orchestra.run.smithi120.stdout:checking assert.h presence... yes 2024-03-31T16:37:21.946 INFO:teuthology.orchestra.run.smithi120.stdout:checking for assert.h... yes 2024-03-31T16:37:21.972 INFO:teuthology.orchestra.run.smithi120.stdout:checking bstring.h usability... no 2024-03-31T16:37:21.982 INFO:teuthology.orchestra.run.smithi120.stdout:checking bstring.h presence... no 2024-03-31T16:37:21.982 INFO:teuthology.orchestra.run.smithi120.stdout:checking for bstring.h... no 2024-03-31T16:37:22.007 INFO:teuthology.orchestra.run.smithi120.stdout:checking libgen.h usability... yes 2024-03-31T16:37:22.014 INFO:teuthology.orchestra.run.smithi120.stdout:checking libgen.h presence... yes 2024-03-31T16:37:22.015 INFO:teuthology.orchestra.run.smithi120.stdout:checking for libgen.h... yes 2024-03-31T16:37:22.052 INFO:teuthology.orchestra.run.smithi120.stdout:checking dirent.h usability... yes 2024-03-31T16:37:22.060 INFO:teuthology.orchestra.run.smithi120.stdout:checking dirent.h presence... yes 2024-03-31T16:37:22.060 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dirent.h... yes 2024-03-31T16:37:22.114 INFO:teuthology.orchestra.run.smithi120.stdout:checking errno.h usability... yes 2024-03-31T16:37:22.122 INFO:teuthology.orchestra.run.smithi120.stdout:checking errno.h presence... yes 2024-03-31T16:37:22.122 INFO:teuthology.orchestra.run.smithi120.stdout:checking for errno.h... yes 2024-03-31T16:37:22.156 INFO:teuthology.orchestra.run.smithi120.stdout:checking malloc.h usability... yes 2024-03-31T16:37:22.165 INFO:teuthology.orchestra.run.smithi120.stdout:checking malloc.h presence... yes 2024-03-31T16:37:22.165 INFO:teuthology.orchestra.run.smithi120.stdout:checking for malloc.h... yes 2024-03-31T16:37:22.191 INFO:teuthology.orchestra.run.smithi120.stdout:checking uuid.h usability... no 2024-03-31T16:37:22.201 INFO:teuthology.orchestra.run.smithi120.stdout:checking uuid.h presence... no 2024-03-31T16:37:22.201 INFO:teuthology.orchestra.run.smithi120.stdout:checking for uuid.h... no 2024-03-31T16:37:22.245 INFO:teuthology.orchestra.run.smithi120.stdout:checking uuid/uuid.h usability... yes 2024-03-31T16:37:22.255 INFO:teuthology.orchestra.run.smithi120.stdout:checking uuid/uuid.h presence... yes 2024-03-31T16:37:22.255 INFO:teuthology.orchestra.run.smithi120.stdout:checking for uuid/uuid.h... yes 2024-03-31T16:37:22.281 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/uuid.h usability... no 2024-03-31T16:37:22.291 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/uuid.h presence... no 2024-03-31T16:37:22.292 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/uuid.h... no 2024-03-31T16:37:22.318 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/file.h usability... yes 2024-03-31T16:37:22.326 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/file.h presence... yes 2024-03-31T16:37:22.327 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/file.h... yes 2024-03-31T16:37:22.363 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/fcntl.h usability... yes 2024-03-31T16:37:22.375 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/fcntl.h presence... yes 2024-03-31T16:37:22.376 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/fcntl.h... yes 2024-03-31T16:37:22.403 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/syssgi.h usability... no 2024-03-31T16:37:22.413 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/syssgi.h presence... no 2024-03-31T16:37:22.413 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/syssgi.h... no 2024-03-31T16:37:22.451 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/param.h usability... yes 2024-03-31T16:37:22.462 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/param.h presence... yes 2024-03-31T16:37:22.462 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/param.h... yes 2024-03-31T16:37:22.467 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/stat.h... (cached) yes 2024-03-31T16:37:22.499 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/statvfs.h usability... yes 2024-03-31T16:37:22.507 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/statvfs.h presence... yes 2024-03-31T16:37:22.508 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/statvfs.h... yes 2024-03-31T16:37:22.534 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/time.h usability... yes 2024-03-31T16:37:22.543 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/time.h presence... yes 2024-03-31T16:37:22.543 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/time.h... yes 2024-03-31T16:37:22.575 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/ioctl.h usability... yes 2024-03-31T16:37:22.583 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/ioctl.h presence... yes 2024-03-31T16:37:22.584 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/ioctl.h... yes 2024-03-31T16:37:22.612 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/wait.h usability... yes 2024-03-31T16:37:22.622 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/wait.h presence... yes 2024-03-31T16:37:22.622 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/wait.h... yes 2024-03-31T16:37:22.627 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/types.h... (cached) yes 2024-03-31T16:37:22.631 INFO:teuthology.orchestra.run.smithi120.stdout:checking for strings.h... (cached) yes 2024-03-31T16:37:22.658 INFO:teuthology.orchestra.run.smithi120.stdout:checking err.h usability... yes 2024-03-31T16:37:22.666 INFO:teuthology.orchestra.run.smithi120.stdout:checking err.h presence... yes 2024-03-31T16:37:22.666 INFO:teuthology.orchestra.run.smithi120.stdout:checking for err.h... yes 2024-03-31T16:37:22.693 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/falloc.h usability... yes 2024-03-31T16:37:22.701 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/falloc.h presence... yes 2024-03-31T16:37:22.701 INFO:teuthology.orchestra.run.smithi120.stdout:checking for linux/falloc.h... yes 2024-03-31T16:37:22.727 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-03-31T16:37:22.737 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-03-31T16:37:22.737 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-31T16:37:22.761 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/fs/xfs_itable.h usability... no 2024-03-31T16:37:22.771 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/fs/xfs_itable.h presence... no 2024-03-31T16:37:22.771 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-31T16:37:22.795 INFO:teuthology.orchestra.run.smithi120.stdout:checking xfs/platform_defs.h usability... no 2024-03-31T16:37:22.805 INFO:teuthology.orchestra.run.smithi120.stdout:checking xfs/platform_defs.h presence... no 2024-03-31T16:37:22.805 INFO:teuthology.orchestra.run.smithi120.stdout:checking for xfs/platform_defs.h... no 2024-03-31T16:37:22.828 INFO:teuthology.orchestra.run.smithi120.stdout:checking btrfs/ioctl.h usability... no 2024-03-31T16:37:22.839 INFO:teuthology.orchestra.run.smithi120.stdout:checking btrfs/ioctl.h presence... no 2024-03-31T16:37:22.839 INFO:teuthology.orchestra.run.smithi120.stdout:checking for btrfs/ioctl.h... no 2024-03-31T16:37:22.862 INFO:teuthology.orchestra.run.smithi120.stdout:checking cifs/ioctl.h usability... no 2024-03-31T16:37:22.872 INFO:teuthology.orchestra.run.smithi120.stdout:checking cifs/ioctl.h presence... no 2024-03-31T16:37:22.873 INFO:teuthology.orchestra.run.smithi120.stdout:checking for cifs/ioctl.h... no 2024-03-31T16:37:22.900 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/mman.h usability... yes 2024-03-31T16:37:22.909 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/mman.h presence... yes 2024-03-31T16:37:22.909 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/mman.h... yes 2024-03-31T16:37:22.935 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/ext4.h usability... no 2024-03-31T16:37:22.945 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/ext4.h presence... no 2024-03-31T16:37:22.945 INFO:teuthology.orchestra.run.smithi120.stdout:checking for linux/ext4.h... no 2024-03-31T16:37:22.956 INFO:teuthology.orchestra.run.smithi120.stdout:checking for xfs/xfs_log_format.h... no 2024-03-31T16:37:22.991 INFO:teuthology.orchestra.run.smithi120.stdout:checking for uuid_compare... no 2024-03-31T16:37:23.027 INFO:teuthology.orchestra.run.smithi120.stdout:checking for uuid_compare in -luuid... yes 2024-03-31T16:37:23.104 INFO:teuthology.orchestra.run.smithi120.stdout:checking for xfs/xfs.h... yes 2024-03-31T16:37:23.117 INFO:teuthology.orchestra.run.smithi120.stdout:checking for xfs/libxfs.h... no 2024-03-31T16:37:23.132 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-31T16:37:23.177 INFO:teuthology.orchestra.run.smithi120.stdout:checking for xfs/xqm.h... yes 2024-03-31T16:37:23.224 INFO:teuthology.orchestra.run.smithi120.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-31T16:37:23.247 INFO:teuthology.orchestra.run.smithi120.stdout:checking xfs/handle.h usability... yes 2024-03-31T16:37:23.254 INFO:teuthology.orchestra.run.smithi120.stdout:checking xfs/handle.h presence... yes 2024-03-31T16:37:23.255 INFO:teuthology.orchestra.run.smithi120.stdout:checking for xfs/handle.h... yes 2024-03-31T16:37:23.285 INFO:teuthology.orchestra.run.smithi120.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-31T16:37:23.308 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/acl.h usability... yes 2024-03-31T16:37:23.318 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/acl.h presence... yes 2024-03-31T16:37:23.318 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/acl.h... yes 2024-03-31T16:37:23.340 INFO:teuthology.orchestra.run.smithi120.stdout:checking acl/libacl.h usability... yes 2024-03-31T16:37:23.349 INFO:teuthology.orchestra.run.smithi120.stdout:checking acl/libacl.h presence... yes 2024-03-31T16:37:23.349 INFO:teuthology.orchestra.run.smithi120.stdout:checking for acl/libacl.h... yes 2024-03-31T16:37:23.381 INFO:teuthology.orchestra.run.smithi120.stdout:checking for acl_init in -lacl... yes 2024-03-31T16:37:23.403 INFO:teuthology.orchestra.run.smithi120.stdout:checking gdbm-ndbm.h usability... no 2024-03-31T16:37:23.414 INFO:teuthology.orchestra.run.smithi120.stdout:checking gdbm-ndbm.h presence... no 2024-03-31T16:37:23.414 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gdbm-ndbm.h... no 2024-03-31T16:37:23.437 INFO:teuthology.orchestra.run.smithi120.stdout:checking gdbm/ndbm.h usability... yes 2024-03-31T16:37:23.447 INFO:teuthology.orchestra.run.smithi120.stdout:checking gdbm/ndbm.h presence... yes 2024-03-31T16:37:23.447 INFO:teuthology.orchestra.run.smithi120.stdout:checking for gdbm/ndbm.h... yes 2024-03-31T16:37:23.482 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dbm_open in -lgdbm... no 2024-03-31T16:37:23.516 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dbm_fetch in -lgdbm... no 2024-03-31T16:37:23.550 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dbm_store in -lgdbm... no 2024-03-31T16:37:23.583 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dbm_close in -lgdbm... no 2024-03-31T16:37:23.619 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-03-31T16:37:23.650 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-03-31T16:37:23.681 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-03-31T16:37:23.713 INFO:teuthology.orchestra.run.smithi120.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-03-31T16:37:23.736 INFO:teuthology.orchestra.run.smithi120.stdout:checking libaio.h usability... yes 2024-03-31T16:37:23.747 INFO:teuthology.orchestra.run.smithi120.stdout:checking libaio.h presence... yes 2024-03-31T16:37:23.747 INFO:teuthology.orchestra.run.smithi120.stdout:checking for libaio.h... yes 2024-03-31T16:37:23.770 INFO:teuthology.orchestra.run.smithi120.stdout:checking liburing.h usability... no 2024-03-31T16:37:23.780 INFO:teuthology.orchestra.run.smithi120.stdout:checking liburing.h presence... no 2024-03-31T16:37:23.780 INFO:teuthology.orchestra.run.smithi120.stdout:checking for liburing.h... no 2024-03-31T16:37:23.812 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/capability.h usability... yes 2024-03-31T16:37:23.822 INFO:teuthology.orchestra.run.smithi120.stdout:checking sys/capability.h presence... yes 2024-03-31T16:37:23.822 INFO:teuthology.orchestra.run.smithi120.stdout:checking for sys/capability.h... yes 2024-03-31T16:37:23.846 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/fiemap.h usability... yes 2024-03-31T16:37:23.854 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/fiemap.h presence... yes 2024-03-31T16:37:23.854 INFO:teuthology.orchestra.run.smithi120.stdout:checking for linux/fiemap.h... yes 2024-03-31T16:37:23.888 INFO:teuthology.orchestra.run.smithi120.stdout:checking for fallocate... yes 2024-03-31T16:37:23.921 INFO:teuthology.orchestra.run.smithi120.stdout:checking for open_by_handle_at... yes 2024-03-31T16:37:23.945 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/fs.h usability... yes 2024-03-31T16:37:23.953 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/fs.h presence... yes 2024-03-31T16:37:23.953 INFO:teuthology.orchestra.run.smithi120.stdout:checking for linux/fs.h... yes 2024-03-31T16:37:23.974 INFO:teuthology.orchestra.run.smithi120.stdout:checking btrfsutil.h usability... no 2024-03-31T16:37:23.985 INFO:teuthology.orchestra.run.smithi120.stdout:checking btrfsutil.h presence... no 2024-03-31T16:37:23.985 INFO:teuthology.orchestra.run.smithi120.stdout:checking for btrfsutil.h... no 2024-03-31T16:37:24.026 INFO:teuthology.orchestra.run.smithi120.stdout:checking for copy_file_range... yes 2024-03-31T16:37:24.061 INFO:teuthology.orchestra.run.smithi120.stdout:checking for SEEK_DATA... yes 2024-03-31T16:37:24.110 INFO:teuthology.orchestra.run.smithi120.stdout:checking for BMV_OF_SHARED... yes 2024-03-31T16:37:24.146 INFO:teuthology.orchestra.run.smithi120.stdout:checking for nftw... yes 2024-03-31T16:37:24.180 INFO:teuthology.orchestra.run.smithi120.stdout:checking for RLIMIT_NOFILE... yes 2024-03-31T16:37:24.212 INFO:teuthology.orchestra.run.smithi120.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-31T16:37:24.245 INFO:teuthology.orchestra.run.smithi120.stdout:checking for FICLONE... yes 2024-03-31T16:37:24.278 INFO:teuthology.orchestra.run.smithi120.stdout:checking for renameat2... yes 2024-03-31T16:37:24.311 INFO:teuthology.orchestra.run.smithi120.stdout:checking for reallocarray... yes 2024-03-31T16:37:24.341 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct mount_attr... yes 2024-03-31T16:37:24.378 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-31T16:37:24.409 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-31T16:37:24.441 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-31T16:37:24.473 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-31T16:37:24.506 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-31T16:37:24.537 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-31T16:37:24.568 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-31T16:37:24.594 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/btrfs.h usability... yes 2024-03-31T16:37:24.602 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/btrfs.h presence... yes 2024-03-31T16:37:24.603 INFO:teuthology.orchestra.run.smithi120.stdout:checking for linux/btrfs.h... yes 2024-03-31T16:37:24.632 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/btrfs_tree.h usability... yes 2024-03-31T16:37:24.640 INFO:teuthology.orchestra.run.smithi120.stdout:checking linux/btrfs_tree.h presence... yes 2024-03-31T16:37:24.640 INFO:teuthology.orchestra.run.smithi120.stdout:checking for linux/btrfs_tree.h... yes 2024-03-31T16:37:24.661 INFO:teuthology.orchestra.run.smithi120.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-31T16:37:24.682 INFO:teuthology.orchestra.run.smithi120.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-31T16:37:24.698 INFO:teuthology.orchestra.run.smithi120.stdout:configure: creating ./config.status 2024-03-31T16:37:24.996 INFO:teuthology.orchestra.run.smithi120.stdout:config.status: creating include/builddefs 2024-03-31T16:37:25.006 INFO:teuthology.orchestra.run.smithi120.stdout:config.status: creating include/config.h 2024-03-31T16:37:25.015 INFO:teuthology.orchestra.run.smithi120.stdout:config.status: executing libtool commands 2024-03-31T16:37:25.051 INFO:teuthology.orchestra.run.smithi120.stdout:Building include 2024-03-31T16:37:25.055 INFO:teuthology.orchestra.run.smithi120.stdout:Building lib 2024-03-31T16:37:25.058 INFO:teuthology.orchestra.run.smithi120.stdout: [LTDEP] 2024-03-31T16:37:25.189 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] dataascii.lo 2024-03-31T16:37:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] databin.lo 2024-03-31T16:37:25.449 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] datapid.lo 2024-03-31T16:37:25.547 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] file_lock.lo 2024-03-31T16:37:25.679 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] forker.lo 2024-03-31T16:37:25.798 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] pattern.lo 2024-03-31T16:37:25.906 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] open_flags.lo 2024-03-31T16:37:26.040 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] random_range.lo 2024-03-31T16:37:26.249 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] string_to_tokens.lo 2024-03-31T16:37:26.341 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] str_to_bytes.lo 2024-03-31T16:37:26.468 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] tlibio.lo 2024-03-31T16:37:26.686 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] write_log.lo 2024-03-31T16:37:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] random.lo 2024-03-31T16:37:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: [LD] 2024-03-31T16:37:27.109 INFO:teuthology.orchestra.run.smithi120.stdout:Building ltp 2024-03-31T16:37:27.111 INFO:teuthology.orchestra.run.smithi120.stdout: [DEP] 2024-03-31T16:37:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] doio 2024-03-31T16:37:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fsstress 2024-03-31T16:37:29.369 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fsx 2024-03-31T16:37:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] growfiles 2024-03-31T16:37:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] iogen 2024-03-31T16:37:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-stress 2024-03-31T16:37:31.321 INFO:teuthology.orchestra.run.smithi120.stdout:Building src 2024-03-31T16:37:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: [DEP] 2024-03-31T16:37:31.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:37:31.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:37:33.095 INFO:teuthology.orchestra.run.smithi120.stdout: [DEP] 2024-03-31T16:37:33.125 INFO:teuthology.orchestra.run.smithi120.stdout: [DEP] 2024-03-31T16:37:33.132 INFO:teuthology.orchestra.run.smithi120.stdout: [DEP] 2024-03-31T16:37:33.340 INFO:teuthology.orchestra.run.smithi120.stdout: [DEP] 2024-03-31T16:37:33.361 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] dirstress 2024-03-31T16:37:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fill 2024-03-31T16:37:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fill2 2024-03-31T16:37:33.927 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] getpagesize 2024-03-31T16:37:34.063 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] holes 2024-03-31T16:37:34.288 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] lstat64 2024-03-31T16:37:34.479 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] nametest 2024-03-31T16:37:34.696 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] permname 2024-03-31T16:37:34.904 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] randholes 2024-03-31T16:37:35.135 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] runas 2024-03-31T16:37:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] truncfile 2024-03-31T16:37:35.469 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] usemem 2024-03-31T16:37:35.599 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] mmapcat 2024-03-31T16:37:35.754 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] append_reader 2024-03-31T16:37:35.905 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] append_writer 2024-03-31T16:37:36.059 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] dirperf 2024-03-31T16:37:36.274 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] metaperf 2024-03-31T16:37:36.536 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] devzero 2024-03-31T16:37:36.715 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] feature 2024-03-31T16:37:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] alloc 2024-03-31T16:37:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fault 2024-03-31T16:37:37.281 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fstest 2024-03-31T16:37:37.522 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_access_root 2024-03-31T16:37:37.683 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] godown 2024-03-31T16:37:37.848 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] resvtest 2024-03-31T16:37:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] writemod 2024-03-31T16:37:38.189 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] writev_on_pagefault 2024-03-31T16:37:38.351 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] makeextents 2024-03-31T16:37:38.529 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] itrash 2024-03-31T16:37:38.668 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] rename 2024-03-31T16:37:38.816 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] multi_open_unlink 2024-03-31T16:37:38.978 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] unwritten_sync 2024-03-31T16:37:39.145 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] genhashnames 2024-03-31T16:37:39.333 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_holes 2024-03-31T16:37:39.472 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_writev 2024-03-31T16:37:39.626 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_truncate_cmtime 2024-03-31T16:37:39.790 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] dirhash_collide 2024-03-31T16:37:40.002 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_rename_overwrite 2024-03-31T16:37:40.147 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] holetest 2024-03-31T16:37:40.375 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_truncate_self 2024-03-31T16:37:40.515 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] af_unix 2024-03-31T16:37:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_stale_pmd 2024-03-31T16:37:40.806 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_cow_race 2024-03-31T16:37:40.946 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_fallocate 2024-03-31T16:37:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fsync-err 2024-03-31T16:37:41.257 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_write_ro 2024-03-31T16:37:41.398 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-31T16:37:41.561 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-31T16:37:41.723 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_ofd_locks 2024-03-31T16:37:41.918 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_collision 2024-03-31T16:37:42.097 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] mmap-write-concurrent 2024-03-31T16:37:42.272 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_get_file_time 2024-03-31T16:37:42.418 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_create_short_dirs 2024-03-31T16:37:42.589 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_create_long_dirs 2024-03-31T16:37:42.754 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_enospc 2024-03-31T16:37:42.921 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_writev_overlap 2024-03-31T16:37:43.091 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] checkpoint_journal 2024-03-31T16:37:43.224 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] mmap-rw-fault 2024-03-31T16:37:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] allocstale 2024-03-31T16:37:43.572 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_cow_memory_failure 2024-03-31T16:37:43.740 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fake-dump-rootino 2024-03-31T16:37:43.873 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] dio-buf-fault 2024-03-31T16:37:44.029 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] rewinddir-test 2024-03-31T16:37:44.213 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] readdir-while-renames 2024-03-31T16:37:44.375 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] xfsctl 2024-03-31T16:37:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] bstat 2024-03-31T16:37:44.757 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mtab 2024-03-31T16:37:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] getdevicesize 2024-03-31T16:37:45.092 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] preallo_rw_pattern_reader 2024-03-31T16:37:45.264 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] preallo_rw_pattern_writer 2024-03-31T16:37:45.423 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] ftrunc 2024-03-31T16:37:45.582 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] trunc 2024-03-31T16:37:45.741 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fs_perms 2024-03-31T16:37:45.882 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] testx 2024-03-31T16:37:46.019 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] looptest 2024-03-31T16:37:46.186 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] locktest 2024-03-31T16:37:46.479 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] unwritten_mmap 2024-03-31T16:37:46.640 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] bulkstat_unlink_test 2024-03-31T16:37:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] deduperace 2024-03-31T16:37:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] bulkstat_unlink_test_modified 2024-03-31T16:37:47.192 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_dir_offset 2024-03-31T16:37:47.322 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_futimens 2024-03-31T16:37:47.441 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_immutable 2024-03-31T16:37:48.031 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] stale_handle 2024-03-31T16:37:48.177 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] pwrite_mmap_blocked 2024-03-31T16:37:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_dir_offset2 2024-03-31T16:37:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] seek_sanity_test 2024-03-31T16:37:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] seek_copy_test 2024-03-31T16:37:49.103 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_readdir_1 2024-03-31T16:37:49.232 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_readdir_2 2024-03-31T16:37:49.391 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fsync-tester 2024-03-31T16:37:49.634 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] nsexec 2024-03-31T16:37:49.819 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] cloner 2024-03-31T16:37:50.003 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] renameat2 2024-03-31T16:37:50.169 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_getcwd 2024-03-31T16:37:50.323 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] e4compact 2024-03-31T16:37:50.513 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] test-nextquota 2024-03-31T16:37:50.664 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] punch-alternating 2024-03-31T16:37:50.841 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-31T16:37:51.015 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] listxattr 2024-03-31T16:37:51.167 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] dio-interleaved 2024-03-31T16:37:51.333 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_dir_type 2024-03-31T16:37:51.485 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] dio-invalidate-cache 2024-03-31T16:37:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] stat_test 2024-03-31T16:37:52.008 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_encrypted_d_revalidate 2024-03-31T16:37:52.163 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] attr_replace_test 2024-03-31T16:37:52.315 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] swapon 2024-03-31T16:37:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] mkswap 2024-03-31T16:37:52.617 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_attr_corruption 2024-03-31T16:37:52.748 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_open_tmpfiles 2024-03-31T16:37:52.908 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fscrypt-crypt-util 2024-03-31T16:37:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] bulkstat_null_ocount 2024-03-31T16:37:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] splice-test 2024-03-31T16:37:54.073 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] chprojid_fail 2024-03-31T16:37:54.261 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] detached_mounts_propagation 2024-03-31T16:37:54.422 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] ext4_resize 2024-03-31T16:37:54.549 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_readdir_3 2024-03-31T16:37:54.749 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] splice2pipe 2024-03-31T16:37:54.916 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] uuid_ioctl 2024-03-31T16:37:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-31T16:37:55.238 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fiemap-tester 2024-03-31T16:37:55.501 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_stripealign 2024-03-31T16:37:55.637 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] open_by_handle 2024-03-31T16:37:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] dbtest 2024-03-31T16:37:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_mmap_dio 2024-03-31T16:37:56.278 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] xfsfind 2024-03-31T16:37:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] t_reflink_read_race 2024-03-31T16:37:56.672 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] fssum 2024-03-31T16:37:57.111 INFO:teuthology.orchestra.run.smithi120.stdout:Building log-writes 2024-03-31T16:37:57.116 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] replay-log 2024-03-31T16:37:57.419 INFO:teuthology.orchestra.run.smithi120.stdout:Building perf 2024-03-31T16:37:57.422 INFO:teuthology.orchestra.run.smithi120.stdout:Building aio-dio-regress 2024-03-31T16:37:57.428 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aiocp 2024-03-31T16:37:57.627 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-31T16:37:57.790 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-append-write-read-race 2024-03-31T16:37:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-cow-race 2024-03-31T16:37:58.112 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-cycle-write 2024-03-31T16:37:58.290 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-eof-race 2024-03-31T16:37:58.450 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-extend-stat 2024-03-31T16:37:58.605 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-fcntl-race 2024-03-31T16:37:58.762 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-hole-filling-race 2024-03-31T16:37:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-invalidate-failure 2024-03-31T16:37:59.076 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-invalidate-readahead 2024-03-31T16:37:59.241 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aiodio_sparse2 2024-03-31T16:37:59.500 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-subblock-eof-read 2024-03-31T16:37:59.621 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-dio-write-verify 2024-03-31T16:37:59.803 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-31T16:37:59.924 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-31T16:38:00.052 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] aio-last-ref-held-by-io 2024-03-31T16:38:00.220 INFO:teuthology.orchestra.run.smithi120.stdout:Building vfs 2024-03-31T16:38:00.225 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] vfstest 2024-03-31T16:38:02.042 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:38:02.045 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:38:03.690 INFO:teuthology.orchestra.run.smithi120.stdout: [CC] mount-idmapped 2024-03-31T16:38:04.085 INFO:teuthology.orchestra.run.smithi120.stdout:Building m4 2024-03-31T16:38:04.089 INFO:teuthology.orchestra.run.smithi120.stdout:Building common 2024-03-31T16:38:04.092 INFO:teuthology.orchestra.run.smithi120.stdout:Building tests 2024-03-31T16:38:04.097 INFO:teuthology.orchestra.run.smithi120.stdout:Building btrfs 2024-03-31T16:38:04.102 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/btrfs/group.list 2024-03-31T16:38:04.163 INFO:teuthology.orchestra.run.smithi120.stdout:Building ceph 2024-03-31T16:38:04.168 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ceph/group.list 2024-03-31T16:38:04.182 INFO:teuthology.orchestra.run.smithi120.stdout:Building cifs 2024-03-31T16:38:04.187 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/cifs/group.list 2024-03-31T16:38:04.199 INFO:teuthology.orchestra.run.smithi120.stdout:Building ext4 2024-03-31T16:38:04.204 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ext4/group.list 2024-03-31T16:38:04.240 INFO:teuthology.orchestra.run.smithi120.stdout:Building f2fs 2024-03-31T16:38:04.245 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/f2fs/group.list 2024-03-31T16:38:04.261 INFO:teuthology.orchestra.run.smithi120.stdout:Building generic 2024-03-31T16:38:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/generic/group.list 2024-03-31T16:38:04.359 INFO:teuthology.orchestra.run.smithi120.stdout:Building nfs 2024-03-31T16:38:04.364 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/nfs/group.list 2024-03-31T16:38:04.379 INFO:teuthology.orchestra.run.smithi120.stdout:Building ocfs2 2024-03-31T16:38:04.384 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ocfs2/group.list 2024-03-31T16:38:04.396 INFO:teuthology.orchestra.run.smithi120.stdout:Building overlay 2024-03-31T16:38:04.401 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/overlay/group.list 2024-03-31T16:38:04.440 INFO:teuthology.orchestra.run.smithi120.stdout:Building perf 2024-03-31T16:38:04.445 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/perf/group.list 2024-03-31T16:38:04.455 INFO:teuthology.orchestra.run.smithi120.stdout:Building selftest 2024-03-31T16:38:04.461 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/selftest/group.list 2024-03-31T16:38:04.472 INFO:teuthology.orchestra.run.smithi120.stdout:Building shared 2024-03-31T16:38:04.477 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/shared/group.list 2024-03-31T16:38:04.493 INFO:teuthology.orchestra.run.smithi120.stdout:Building tmpfs 2024-03-31T16:38:04.499 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/tmpfs/group.list 2024-03-31T16:38:04.513 INFO:teuthology.orchestra.run.smithi120.stdout:Building udf 2024-03-31T16:38:04.517 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/udf/group.list 2024-03-31T16:38:04.529 INFO:teuthology.orchestra.run.smithi120.stdout:Building xfs 2024-03-31T16:38:04.536 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/xfs/group.list 2024-03-31T16:38:04.632 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo make install) 2024-03-31T16:38:04.668 INFO:teuthology.orchestra.run.smithi120.stdout:Building include 2024-03-31T16:38:04.672 INFO:teuthology.orchestra.run.smithi120.stdout:Building lib 2024-03-31T16:38:04.675 INFO:teuthology.orchestra.run.smithi120.stdout:Building ltp 2024-03-31T16:38:04.679 INFO:teuthology.orchestra.run.smithi120.stdout:Building src 2024-03-31T16:38:04.712 INFO:teuthology.orchestra.run.smithi120.stdout:Building log-writes 2024-03-31T16:38:04.715 INFO:teuthology.orchestra.run.smithi120.stdout:Building perf 2024-03-31T16:38:04.718 INFO:teuthology.orchestra.run.smithi120.stdout:Building aio-dio-regress 2024-03-31T16:38:04.722 INFO:teuthology.orchestra.run.smithi120.stdout:Building vfs 2024-03-31T16:38:04.726 INFO:teuthology.orchestra.run.smithi120.stdout:Building m4 2024-03-31T16:38:04.729 INFO:teuthology.orchestra.run.smithi120.stdout:Building common 2024-03-31T16:38:04.733 INFO:teuthology.orchestra.run.smithi120.stdout:Building tests 2024-03-31T16:38:04.738 INFO:teuthology.orchestra.run.smithi120.stdout:Building btrfs 2024-03-31T16:38:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/btrfs/group.list 2024-03-31T16:38:04.804 INFO:teuthology.orchestra.run.smithi120.stdout:Building ceph 2024-03-31T16:38:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ceph/group.list 2024-03-31T16:38:04.823 INFO:teuthology.orchestra.run.smithi120.stdout:Building cifs 2024-03-31T16:38:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/cifs/group.list 2024-03-31T16:38:04.840 INFO:teuthology.orchestra.run.smithi120.stdout:Building ext4 2024-03-31T16:38:04.845 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ext4/group.list 2024-03-31T16:38:04.881 INFO:teuthology.orchestra.run.smithi120.stdout:Building f2fs 2024-03-31T16:38:04.886 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/f2fs/group.list 2024-03-31T16:38:04.902 INFO:teuthology.orchestra.run.smithi120.stdout:Building generic 2024-03-31T16:38:04.909 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/generic/group.list 2024-03-31T16:38:05.000 INFO:teuthology.orchestra.run.smithi120.stdout:Building nfs 2024-03-31T16:38:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/nfs/group.list 2024-03-31T16:38:05.019 INFO:teuthology.orchestra.run.smithi120.stdout:Building ocfs2 2024-03-31T16:38:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ocfs2/group.list 2024-03-31T16:38:05.036 INFO:teuthology.orchestra.run.smithi120.stdout:Building overlay 2024-03-31T16:38:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/overlay/group.list 2024-03-31T16:38:05.081 INFO:teuthology.orchestra.run.smithi120.stdout:Building perf 2024-03-31T16:38:05.086 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/perf/group.list 2024-03-31T16:38:05.097 INFO:teuthology.orchestra.run.smithi120.stdout:Building selftest 2024-03-31T16:38:05.101 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/selftest/group.list 2024-03-31T16:38:05.114 INFO:teuthology.orchestra.run.smithi120.stdout:Building shared 2024-03-31T16:38:05.119 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/shared/group.list 2024-03-31T16:38:05.135 INFO:teuthology.orchestra.run.smithi120.stdout:Building tmpfs 2024-03-31T16:38:05.140 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/tmpfs/group.list 2024-03-31T16:38:05.153 INFO:teuthology.orchestra.run.smithi120.stdout:Building udf 2024-03-31T16:38:05.158 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/udf/group.list 2024-03-31T16:38:05.169 INFO:teuthology.orchestra.run.smithi120.stdout:Building xfs 2024-03-31T16:38:05.175 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/xfs/group.list 2024-03-31T16:38:05.270 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-31T16:38:05.270 INFO:teuthology.orchestra.run.smithi120.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-31T16:38:05.270 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-31T16:38:05.272 INFO:teuthology.orchestra.run.smithi120.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-31T16:38:05.272 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-31T16:38:05.274 INFO:teuthology.orchestra.run.smithi120.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-31T16:38:05.282 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-31T16:38:05.354 INFO:teuthology.orchestra.run.smithi120.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-31T16:38:05.362 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-31T16:38:05.378 INFO:teuthology.orchestra.run.smithi120.stdout:Building log-writes 2024-03-31T16:38:05.382 INFO:teuthology.orchestra.run.smithi120.stdout:Building perf 2024-03-31T16:38:05.385 INFO:teuthology.orchestra.run.smithi120.stdout:Building aio-dio-regress 2024-03-31T16:38:05.389 INFO:teuthology.orchestra.run.smithi120.stdout:Building vfs 2024-03-31T16:38:05.392 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake -C log-writes install 2024-03-31T16:38:05.393 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-31T16:38:05.401 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-31T16:38:05.410 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake -C perf install 2024-03-31T16:38:05.411 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-31T16:38:05.419 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-31T16:38:05.439 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-31T16:38:05.441 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-31T16:38:05.449 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-31T16:38:05.495 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake -C vfs install 2024-03-31T16:38:05.497 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-31T16:38:05.505 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-31T16:38:05.516 INFO:teuthology.orchestra.run.smithi120.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-31T16:38:05.524 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-31T16:38:06.669 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-31T16:38:06.760 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-31T16:38:06.784 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-31T16:38:06.785 INFO:teuthology.orchestra.run.smithi120.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-31T16:38:06.786 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-31T16:38:06.787 INFO:teuthology.orchestra.run.smithi120.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-31T16:38:06.795 INFO:teuthology.orchestra.run.smithi120.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-31T16:38:06.919 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-31T16:38:06.921 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/btrfs/ install 2024-03-31T16:38:06.923 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/btrfs/group.list 2024-03-31T16:38:06.983 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-31T16:38:06.991 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 320 /var/lib/xfstests/tests/btrfs 2024-03-31T16:38:07.768 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-31T16:38:07.776 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 320.out /var/lib/xfstests/tests/btrfs 2024-03-31T16:38:08.555 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ceph/ install 2024-03-31T16:38:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ceph/group.list 2024-03-31T16:38:08.571 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-31T16:38:08.578 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-31T16:38:08.596 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-31T16:38:08.603 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-31T16:38:08.622 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/cifs/ install 2024-03-31T16:38:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/cifs/group.list 2024-03-31T16:38:08.636 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-31T16:38:08.644 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-31T16:38:08.652 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-31T16:38:08.660 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-31T16:38:08.668 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ext4/ install 2024-03-31T16:38:08.671 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ext4/group.list 2024-03-31T16:38:08.706 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-31T16:38:08.714 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-31T16:38:08.883 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-31T16:38:08.891 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-31T16:38:09.069 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/f2fs/ install 2024-03-31T16:38:09.072 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/f2fs/group.list 2024-03-31T16:38:09.087 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-31T16:38:09.096 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-31T16:38:09.105 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-31T16:38:09.113 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-31T16:38:09.124 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/generic/ install 2024-03-31T16:38:09.127 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/generic/group.list 2024-03-31T16:38:09.222 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-31T16:38:09.230 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-31T16:38:11.018 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-31T16:38:11.026 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-31T16:38:12.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/nfs/ install 2024-03-31T16:38:12.854 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/nfs/group.list 2024-03-31T16:38:12.867 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-31T16:38:12.875 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-31T16:38:12.883 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-31T16:38:12.891 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-31T16:38:12.899 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ocfs2/ install 2024-03-31T16:38:12.902 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/ocfs2/group.list 2024-03-31T16:38:12.914 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-31T16:38:12.922 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-31T16:38:12.930 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-31T16:38:12.938 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-31T16:38:12.946 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/overlay/ install 2024-03-31T16:38:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/overlay/group.list 2024-03-31T16:38:12.987 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-31T16:38:12.995 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-31T16:38:13.253 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-31T16:38:13.261 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-31T16:38:13.517 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/perf/ install 2024-03-31T16:38:13.519 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/perf/group.list 2024-03-31T16:38:13.530 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-31T16:38:13.539 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-31T16:38:13.546 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-31T16:38:13.555 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-31T16:38:13.563 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/selftest/ install 2024-03-31T16:38:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/selftest/group.list 2024-03-31T16:38:13.576 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-31T16:38:13.584 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-31T16:38:13.604 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-31T16:38:13.612 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-31T16:38:13.632 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/shared/ install 2024-03-31T16:38:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/shared/group.list 2024-03-31T16:38:13.650 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-31T16:38:13.658 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-31T16:38:13.671 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-31T16:38:13.679 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-31T16:38:13.692 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/tmpfs/ install 2024-03-31T16:38:13.694 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/tmpfs/group.list 2024-03-31T16:38:13.706 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-31T16:38:13.714 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-31T16:38:13.722 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-31T16:38:13.730 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-31T16:38:13.738 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/udf/ install 2024-03-31T16:38:13.741 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/udf/group.list 2024-03-31T16:38:13.751 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-31T16:38:13.759 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-31T16:38:13.767 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-31T16:38:13.775 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-31T16:38:13.783 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.HCjZqVXECMxfstests-dev/tests/xfs/ install 2024-03-31T16:38:13.786 INFO:teuthology.orchestra.run.smithi120.stdout: [GROUP] /tmp/tmp.HCjZqVXECMxfstests-dev/tests/xfs/group.list 2024-03-31T16:38:13.882 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-31T16:38:13.890 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-31T16:38:15.591 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-31T16:38:15.600 INFO:teuthology.orchestra.run.smithi120.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-31T16:38:17.310 INFO:teuthology.orchestra.run.smithi120.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-31T16:38:17.318 INFO:teuthology.orchestra.run.smithi120.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-31T16:38:17.326 INFO:teuthology.orchestra.run.smithi120.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-31T16:38:17.334 INFO:teuthology.orchestra.run.smithi120.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-31T16:38:17.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-31T16:38:17.344 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec ls tests/generic) 2024-03-31T16:38:17.400 INFO:teuthology.orchestra.run.smithi120.stdout:001 2024-03-31T16:38:17.400 INFO:teuthology.orchestra.run.smithi120.stdout:001.out 2024-03-31T16:38:17.400 INFO:teuthology.orchestra.run.smithi120.stdout:002 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:002.out 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:003 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:003.out 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:004 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:004.out 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:005 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:005.out 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:006 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:006.out 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:007 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:007.out 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:008 2024-03-31T16:38:17.401 INFO:teuthology.orchestra.run.smithi120.stdout:008.out 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:009 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:009.out 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:010 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:010.out 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:011 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:011.out 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:012 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:012.out 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:013 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:013.out 2024-03-31T16:38:17.402 INFO:teuthology.orchestra.run.smithi120.stdout:014 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:014.out 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:015 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:015.out 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:016 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:016.out 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:017 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:017.out 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:018 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:018.out 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:019 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:019.out 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:020 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:020.out 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:021 2024-03-31T16:38:17.403 INFO:teuthology.orchestra.run.smithi120.stdout:021.out 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:022 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:022.out 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:023 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:023.out 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:024 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:024.out 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:025 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:025.out 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:026 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:026.out 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:027 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:027.out 2024-03-31T16:38:17.404 INFO:teuthology.orchestra.run.smithi120.stdout:028 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:028.out 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:029 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:029.out 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:030 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:030.out 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:031 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:031.out 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:032 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:032.out 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:033 2024-03-31T16:38:17.405 INFO:teuthology.orchestra.run.smithi120.stdout:033.out 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:034 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:034.out 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:035 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:035.cfg 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:035.out.default 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:035.out.nfs 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:036 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:036.out 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:037 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:037.out 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:038 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:038.out 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:039 2024-03-31T16:38:17.406 INFO:teuthology.orchestra.run.smithi120.stdout:039.out 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:040 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:040.out 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:041 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:041.out 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:042 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:042.out 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:043 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:043.out 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:044 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:044.out 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:045 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:045.out 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:046 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:046.out 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:047 2024-03-31T16:38:17.407 INFO:teuthology.orchestra.run.smithi120.stdout:047.out 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:048 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:048.out 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:049 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:049.out 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:050 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:050.cfg 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:050.out.default 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:050.out.nojournal 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:050.out.xfsquota 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:051 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:051.out 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:052 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:052.out 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:053 2024-03-31T16:38:17.408 INFO:teuthology.orchestra.run.smithi120.stdout:053.out 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:054 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:054.out 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:055 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:055.out 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:056 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:056.out 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:057 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:057.out 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:058 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:058.out 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:059 2024-03-31T16:38:17.409 INFO:teuthology.orchestra.run.smithi120.stdout:059.out 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:060 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:060.out 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:061 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:061.out 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:062 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:062.out 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:063 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:063.out 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:064 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:064.out 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:065 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:065.out 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:066 2024-03-31T16:38:17.410 INFO:teuthology.orchestra.run.smithi120.stdout:066.out 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:067 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:067.out 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:068 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:068.out 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:069 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:069.out 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:070 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:070.out 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:071 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:071.out 2024-03-31T16:38:17.411 INFO:teuthology.orchestra.run.smithi120.stdout:072 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:072.out 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:073 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:073.out 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:074 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:074.out 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:075 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:075.out 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:076 2024-03-31T16:38:17.412 INFO:teuthology.orchestra.run.smithi120.stdout:076.out 2024-03-31T16:38:17.413 INFO:teuthology.orchestra.run.smithi120.stdout:077 2024-03-31T16:38:17.413 INFO:teuthology.orchestra.run.smithi120.stdout:077.out 2024-03-31T16:38:17.413 INFO:teuthology.orchestra.run.smithi120.stdout:078 2024-03-31T16:38:17.413 INFO:teuthology.orchestra.run.smithi120.stdout:078.out 2024-03-31T16:38:17.413 INFO:teuthology.orchestra.run.smithi120.stdout:079 2024-03-31T16:38:17.413 INFO:teuthology.orchestra.run.smithi120.stdout:079.out 2024-03-31T16:38:17.413 INFO:teuthology.orchestra.run.smithi120.stdout:080 2024-03-31T16:38:17.413 INFO:teuthology.orchestra.run.smithi120.stdout:080.out 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:081 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:081.out 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:082 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:082.out 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:083 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:083.out 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:084 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:084.out 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:085 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:085.out 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:086 2024-03-31T16:38:17.414 INFO:teuthology.orchestra.run.smithi120.stdout:086.out 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:087 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:087.out 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:088 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:088.out 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:089 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:089.out 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:090 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:090.out 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:091 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:091.out 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:092 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:092.out 2024-03-31T16:38:17.415 INFO:teuthology.orchestra.run.smithi120.stdout:093 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:093.out 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:094 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:094.out 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:095 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:095.out 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:096 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:096.out 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:097 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:097.out 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:098 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:098.out 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:099 2024-03-31T16:38:17.416 INFO:teuthology.orchestra.run.smithi120.stdout:099.out 2024-03-31T16:38:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:100 2024-03-31T16:38:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:100.out 2024-03-31T16:38:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:101 2024-03-31T16:38:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:101.out 2024-03-31T16:38:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:102 2024-03-31T16:38:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:102.out 2024-03-31T16:38:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:103 2024-03-31T16:38:17.417 INFO:teuthology.orchestra.run.smithi120.stdout:103.out 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:104 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:104.out 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:105 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:105.out 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:106 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:106.out 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:107 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:107.out 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:108 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:108.out 2024-03-31T16:38:17.418 INFO:teuthology.orchestra.run.smithi120.stdout:109 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:109.out 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:110 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:110.out 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:111 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:111.out 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:112 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:112.out 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:113 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:113.out 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:114 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:114.out 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:115 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:115.out 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:116 2024-03-31T16:38:17.419 INFO:teuthology.orchestra.run.smithi120.stdout:116.out 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:117 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:117.out 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:118 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:118.out 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:119 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:119.out 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:120 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:120.out 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:121 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:121.out 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:122 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:122.out 2024-03-31T16:38:17.420 INFO:teuthology.orchestra.run.smithi120.stdout:123 2024-03-31T16:38:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:123.out 2024-03-31T16:38:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:124 2024-03-31T16:38:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:124.out 2024-03-31T16:38:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:125 2024-03-31T16:38:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:125.out 2024-03-31T16:38:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:126 2024-03-31T16:38:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:126.out 2024-03-31T16:38:17.421 INFO:teuthology.orchestra.run.smithi120.stdout:127 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:127.out 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:128 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:128.out 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:129 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:129.out 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:130 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:130.out 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:131 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:131.out 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:132 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:132.out 2024-03-31T16:38:17.422 INFO:teuthology.orchestra.run.smithi120.stdout:133 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:133.out 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:134 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:134.out 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:135 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:135.out 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:136 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:136.out 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:137 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:137.out 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:138 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:138.out 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:139 2024-03-31T16:38:17.423 INFO:teuthology.orchestra.run.smithi120.stdout:139.out 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:140 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:140.out 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:141 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:141.out 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:142 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:142.out 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:143 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:143.out 2024-03-31T16:38:17.424 INFO:teuthology.orchestra.run.smithi120.stdout:144 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:144.out 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:145 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:145.out 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:146 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:146.out 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:147 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:147.out 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:148 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:148.out 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:149 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:149.out 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:150 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:150.out 2024-03-31T16:38:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:151 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:151.out 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:152 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:152.out 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:153 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:153.out 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:154 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:154.out 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:155 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:155.out 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:156 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:156.out 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:157 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:157.out 2024-03-31T16:38:17.426 INFO:teuthology.orchestra.run.smithi120.stdout:158 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:158.out 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:159 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:159.out 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:160 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:160.out 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:161 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:161.out 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:162 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:162.out 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:163 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:163.out 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:164 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:164.out 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:165 2024-03-31T16:38:17.427 INFO:teuthology.orchestra.run.smithi120.stdout:165.out 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:166 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:166.out 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:167 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:167.out 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:168 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:168.out 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:169 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:169.out 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:170 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:170.out 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:171 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:171.out 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:172 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:172.out 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:173 2024-03-31T16:38:17.428 INFO:teuthology.orchestra.run.smithi120.stdout:173.out 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:174 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:174.out 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:175 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:175.out 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:176 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:176.out 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:177 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:177.out 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:178 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:178.out 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:179 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:179.out 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:180 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:180.out 2024-03-31T16:38:17.429 INFO:teuthology.orchestra.run.smithi120.stdout:181 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:181.out 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:182 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:182.out 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:183 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:183.out 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:184 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:184.out 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:185 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:185.out 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:186 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:186.out 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:187 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:187.out 2024-03-31T16:38:17.430 INFO:teuthology.orchestra.run.smithi120.stdout:188 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:188.out 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:189 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:189.out 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:190 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:190.out 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:191 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:191.out 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:192 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:192.out 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:193 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:193.out 2024-03-31T16:38:17.431 INFO:teuthology.orchestra.run.smithi120.stdout:194 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:194.out 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:195 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:195.out 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:196 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:196.out 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:197 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:197.out 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:198 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:198.out 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:199 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:199.out 2024-03-31T16:38:17.432 INFO:teuthology.orchestra.run.smithi120.stdout:200 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:200.out 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:201 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:201.out 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:202 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:202.out 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:203 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:203.out 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:204 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:204.out 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:205 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:205.out 2024-03-31T16:38:17.433 INFO:teuthology.orchestra.run.smithi120.stdout:206 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:206.out 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:207 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:207.out 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:208 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:208.out 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:209 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:209.out 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:210 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:210.out 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:211 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:211.out 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:212 2024-03-31T16:38:17.434 INFO:teuthology.orchestra.run.smithi120.stdout:212.out 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:213 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:213.out 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:214 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:214.out 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:215 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:215.out 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:216 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:216.out 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:217 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:217.out 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:218 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:218.out 2024-03-31T16:38:17.435 INFO:teuthology.orchestra.run.smithi120.stdout:219 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:219.out 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:220 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:220.out 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:221 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:221.out 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:222 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:222.out 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:223 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:223.out 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:224 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:224.out 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:225 2024-03-31T16:38:17.436 INFO:teuthology.orchestra.run.smithi120.stdout:225.out 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:226 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:226.out 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:227 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:227.out 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:228 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:228.out 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:229 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:229.out 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:230 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:230.out 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:231 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:231.out 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:232 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:232.out 2024-03-31T16:38:17.437 INFO:teuthology.orchestra.run.smithi120.stdout:233 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:233.out 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:234 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:234.out 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:235 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:235.out 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:236 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:236.out 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:237 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:237.out 2024-03-31T16:38:17.438 INFO:teuthology.orchestra.run.smithi120.stdout:238 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:238.out 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:239 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:239.out 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:240 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:240.out 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:241 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:241.out 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:242 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:242.out 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:243 2024-03-31T16:38:17.439 INFO:teuthology.orchestra.run.smithi120.stdout:243.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:244 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:244.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:245 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:245.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:246 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:246.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:247 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:247.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:248 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:248.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:249 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:249.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:250 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:250.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:251 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:251.out 2024-03-31T16:38:17.440 INFO:teuthology.orchestra.run.smithi120.stdout:252 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:252.out 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:253 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:253.out 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:254 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:254.out 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:255 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:255.out 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:256 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:256.out 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:257 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:257.out 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:258 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:258.out 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:259 2024-03-31T16:38:17.441 INFO:teuthology.orchestra.run.smithi120.stdout:259.out 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:260 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:260.out 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:261 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:261.out 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:262 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:262.out 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:263 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:263.out 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:264 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:264.out 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:265 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:265.out 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:266 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:266.out 2024-03-31T16:38:17.442 INFO:teuthology.orchestra.run.smithi120.stdout:267 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:267.out 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:268 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:268.out 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:269 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:269.out 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:270 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:270.out 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:271 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:271.out 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:272 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:272.out 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:273 2024-03-31T16:38:17.443 INFO:teuthology.orchestra.run.smithi120.stdout:273.out 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:274 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:274.out 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:275 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:275.out 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:276 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:276.out 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:277 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:277.out 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:278 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:278.out 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:279 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:279.out 2024-03-31T16:38:17.444 INFO:teuthology.orchestra.run.smithi120.stdout:280 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:280.out 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:281 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:281.out 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:282 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:282.out 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:283 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:283.out 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:284 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:284.out 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:285 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:285.out 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:286 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:286.out 2024-03-31T16:38:17.445 INFO:teuthology.orchestra.run.smithi120.stdout:287 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:287.out 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:288 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:288.out 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:289 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:289.out 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:290 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:290.out 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:291 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:291.out 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:292 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:292.out 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:293 2024-03-31T16:38:17.446 INFO:teuthology.orchestra.run.smithi120.stdout:293.out 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:294 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:294.out 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:295 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:295.out 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:296 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:296.out 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:297 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:297.out 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:298 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:298.out 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:299 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:299.out 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:300 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:300.out 2024-03-31T16:38:17.447 INFO:teuthology.orchestra.run.smithi120.stdout:301 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:301.out 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:302 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:302.out 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:303 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:303.out 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:304 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:304.out 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:305 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:305.out 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:306 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:306.out 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:307 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:307.out 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:308 2024-03-31T16:38:17.448 INFO:teuthology.orchestra.run.smithi120.stdout:308.out 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:309 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:309.out 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:310 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:310.out 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:311 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:311.out 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:312 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:312.out 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:313 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:313.out 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:314 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:314.out 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:315 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:315.out 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:316 2024-03-31T16:38:17.449 INFO:teuthology.orchestra.run.smithi120.stdout:316.out 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:317 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:317.out 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:318 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:318.out 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:319 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:319.out 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:320 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:320.out 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:321 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:321.out 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:322 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:322.out 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:323 2024-03-31T16:38:17.450 INFO:teuthology.orchestra.run.smithi120.stdout:323.out 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:324 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:324.out 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:325 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:325.out 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:326 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:326.out 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:327 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:327.out 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:328 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:328.out 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:329 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:329.out 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:330 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:330.out 2024-03-31T16:38:17.451 INFO:teuthology.orchestra.run.smithi120.stdout:331 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:331.out 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:332 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:332.out 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:333 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:333.out 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:334 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:334.out 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:335 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:335.out 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:336 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:336.out 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:337 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:337.out 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:338 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:338.out 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:339 2024-03-31T16:38:17.452 INFO:teuthology.orchestra.run.smithi120.stdout:339.out 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:340 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:340.out 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:341 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:341.out 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:342 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:342.out 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:343 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:343.out 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:344 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:344.out 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:345 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:345.out 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:346 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:346.out 2024-03-31T16:38:17.453 INFO:teuthology.orchestra.run.smithi120.stdout:347 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:347.out 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:348 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:348.out 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:349 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:349.out 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:350 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:350.out 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:351 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:351.out 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:352 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:352.out 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:353 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:353.out 2024-03-31T16:38:17.454 INFO:teuthology.orchestra.run.smithi120.stdout:354 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:354.out 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:355 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:355.out 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:356 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:356.out 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:357 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:357.out 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:358 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:358.out 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:359 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:359.out 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:360 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:360.out 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:361 2024-03-31T16:38:17.455 INFO:teuthology.orchestra.run.smithi120.stdout:361.out 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:362 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:362.out 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:363 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:363.out 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:364 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:364.out 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:365 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:365.out 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:366 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:366.out 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:367 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:367.out 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:368 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:368.out 2024-03-31T16:38:17.456 INFO:teuthology.orchestra.run.smithi120.stdout:369 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:369.out 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:370 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:370.out 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:371 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:371.out 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:372 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:372.out 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:373 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:373.out 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:374 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:374.out 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:375 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:375.out 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:376 2024-03-31T16:38:17.457 INFO:teuthology.orchestra.run.smithi120.stdout:376.out 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:377 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:377.out 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:378 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:378.out 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:379 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:379.out 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:380 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:380.out 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:381 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:381.out 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:382 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:382.out 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:383 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:383.out 2024-03-31T16:38:17.458 INFO:teuthology.orchestra.run.smithi120.stdout:384 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:384.out 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:385 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:385.out 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:386 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:386.out 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:387 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:387.out 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:388 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:388.out 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:389 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:389.out 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:390 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:390.out 2024-03-31T16:38:17.459 INFO:teuthology.orchestra.run.smithi120.stdout:391 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:391.out 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:392 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:392.out 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:393 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:393.out 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:394 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:394.out 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:395 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:395.out 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:396 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:396.out 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:397 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:397.out 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:398 2024-03-31T16:38:17.460 INFO:teuthology.orchestra.run.smithi120.stdout:398.out 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:399 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:399.out 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:400 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:400.out 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:401 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:401.out 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:402 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:402.out 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:403 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:403.out 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:404 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:404.out 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:405 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:405.out 2024-03-31T16:38:17.461 INFO:teuthology.orchestra.run.smithi120.stdout:406 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:406.out 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:407 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:407.out 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:408 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:408.out 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:409 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:409.out 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:410 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:410.out 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:411 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:411.out 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:412 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:412.out 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:413 2024-03-31T16:38:17.462 INFO:teuthology.orchestra.run.smithi120.stdout:413.out 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:414 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:414.out 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:415 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:415.out 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:416 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:416.out 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:417 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:417.out 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:418 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:418.out 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:419 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:419.out 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:420 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:420.out 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:421 2024-03-31T16:38:17.463 INFO:teuthology.orchestra.run.smithi120.stdout:421.out 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:422 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:422.out 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:423 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:423.out 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:424 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:424.out 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:425 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:425.out 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:426 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:426.out 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:427 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:427.out 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:428 2024-03-31T16:38:17.464 INFO:teuthology.orchestra.run.smithi120.stdout:428.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:429 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:429.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:430 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:430.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:431 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:431.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:432 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:432.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:433 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:433.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:434 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:434.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:435 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:435.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:436 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:436.out 2024-03-31T16:38:17.465 INFO:teuthology.orchestra.run.smithi120.stdout:437 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:437.out 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:438 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:438.out 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:439 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:439.out 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:440 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:440.out 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:441 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:441.out 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:442 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:442.out 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:443 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:443.out 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:444 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:444.out 2024-03-31T16:38:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:445 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:445.out 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:446 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:446.out 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:447 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:447.out 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:448 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:448.out 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:449 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:449.out 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:450 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:450.out 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:451 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:451.out 2024-03-31T16:38:17.467 INFO:teuthology.orchestra.run.smithi120.stdout:452 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:452.out 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:453 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:453.out 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:454 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:454.out 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:455 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:455.out 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:456 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:456.out 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:457 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:457.out 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:458 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:458.out 2024-03-31T16:38:17.468 INFO:teuthology.orchestra.run.smithi120.stdout:459 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:459.out 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:460 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:460.out 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:461 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:461.out 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:462 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:462.out 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:463 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:463.out 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:464 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:464.out 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:465 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:465.out 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:466 2024-03-31T16:38:17.469 INFO:teuthology.orchestra.run.smithi120.stdout:466.out 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:467 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:467.out 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:468 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:468.out 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:469 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:469.out 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:470 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:470.out 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:471 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:471.out 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:472 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:472.out 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:473 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:473.out 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:474 2024-03-31T16:38:17.470 INFO:teuthology.orchestra.run.smithi120.stdout:474.out 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:475 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:475.out 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:476 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:476.out 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:477 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:477.out 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:478 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:478.out 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:479 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:479.out 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:480 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:480.out 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:481 2024-03-31T16:38:17.471 INFO:teuthology.orchestra.run.smithi120.stdout:481.out 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:482 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:482.out 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:483 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:483.out 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:484 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:484.out 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:485 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:485.out 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:486 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:486.out 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:487 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:487.out 2024-03-31T16:38:17.472 INFO:teuthology.orchestra.run.smithi120.stdout:488 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:488.out 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:489 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:489.out 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:490 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:490.out 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:491 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:491.out 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:492 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:492.out 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:493 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:493.out 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:494 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:494.out 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:495 2024-03-31T16:38:17.473 INFO:teuthology.orchestra.run.smithi120.stdout:495.out 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:496 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:496.out 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:497 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:497.out 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:498 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:498.out 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:499 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:499.out 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:500 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:500.out 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:501 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:501.out 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:502 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:502.out 2024-03-31T16:38:17.474 INFO:teuthology.orchestra.run.smithi120.stdout:503 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:503.out 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:504 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:504.out 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:505 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:505.out 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:506 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:506.out 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:507 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:507.out 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:508 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:508.out 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:509 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:509.out 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:510 2024-03-31T16:38:17.475 INFO:teuthology.orchestra.run.smithi120.stdout:510.out 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:511 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:511.out 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:512 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:512.out 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:513 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:513.out 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:514 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:514.out 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:515 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:515.out 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:516 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:516.out 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:517 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:517.out 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:518 2024-03-31T16:38:17.476 INFO:teuthology.orchestra.run.smithi120.stdout:518.out 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:519 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:519.out 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:520 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:520.out 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:521 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:521.out 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:522 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:522.out 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:523 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:523.out 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:524 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:524.out 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:525 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:525.out 2024-03-31T16:38:17.477 INFO:teuthology.orchestra.run.smithi120.stdout:526 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:526.out 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:527 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:527.out 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:528 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:528.out 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:529 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:529.out 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:530 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:530.out 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:531 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:531.out 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:532 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:532.out 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:533 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:533.out 2024-03-31T16:38:17.478 INFO:teuthology.orchestra.run.smithi120.stdout:534 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:534.out 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:535 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:535.out 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:536 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:536.out 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:537 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:537.out 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:538 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:538.out 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:539 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:539.out 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:540 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:540.out 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:541 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:541.out 2024-03-31T16:38:17.479 INFO:teuthology.orchestra.run.smithi120.stdout:542 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:542.out 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:543 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:543.out 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:544 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:544.out 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:545 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:545.out 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:546 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:546.out 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:547 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:547.out 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:548 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:548.out 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:549 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:549.out 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:550 2024-03-31T16:38:17.480 INFO:teuthology.orchestra.run.smithi120.stdout:550.out 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:551 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:551.out 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:552 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:552.out 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:553 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:553.out 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:554 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:554.out 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:555 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:555.out 2024-03-31T16:38:17.481 INFO:teuthology.orchestra.run.smithi120.stdout:556 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:556.out 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:557 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:557.out 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:558 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:558.out 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:559 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:559.out 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:560 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:560.out 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:561 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:561.out 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:562 2024-03-31T16:38:17.482 INFO:teuthology.orchestra.run.smithi120.stdout:562.out 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:563 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:563.out 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:564 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:564.out 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:565 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:565.out 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:566 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:566.out 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:567 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:567.out 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:568 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:568.out 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:569 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:569.out 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:570 2024-03-31T16:38:17.483 INFO:teuthology.orchestra.run.smithi120.stdout:570.out 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:571 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:571.out 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:572 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:572.out 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:573 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:573.out 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:574 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:574.out 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:575 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:575.out 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:576 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:576.out 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:577 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:577.out 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:578 2024-03-31T16:38:17.484 INFO:teuthology.orchestra.run.smithi120.stdout:578.out 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:579 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:579.out 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:580 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:580.out 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:581 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:581.out 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:582 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:582.out 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:583 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:583.out 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:584 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:584.out 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:585 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:585.out 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:586 2024-03-31T16:38:17.485 INFO:teuthology.orchestra.run.smithi120.stdout:586.out 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:587 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:587.out 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:588 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:588.out 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:589 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:589.out 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:590 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:590.out 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:591 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:591.out 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:592 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:592.out 2024-03-31T16:38:17.486 INFO:teuthology.orchestra.run.smithi120.stdout:593 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:593.out 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:594 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:594.out 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:595 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:595.out 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:596 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:596.out 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:597 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:597.out 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:598 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:598.out 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:599 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:599.out 2024-03-31T16:38:17.487 INFO:teuthology.orchestra.run.smithi120.stdout:600 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:600.out 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:601 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:601.out 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:602 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:602.out 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:603 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:603.out 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:604 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:604.out 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:605 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:605.out 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:606 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:606.out 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:607 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:607.out 2024-03-31T16:38:17.488 INFO:teuthology.orchestra.run.smithi120.stdout:608 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:608.out 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:609 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:609.out 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:610 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:610.out 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:611 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:611.out 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:612 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:612.out 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:613 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:613.out 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:614 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:614.out 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:615 2024-03-31T16:38:17.489 INFO:teuthology.orchestra.run.smithi120.stdout:615.out 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:616 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:616.out 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:617 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:617.out 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:618 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:618.out 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:619 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:619.out 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:620 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:620.out 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:621 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:621.out 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:622 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:622.out 2024-03-31T16:38:17.490 INFO:teuthology.orchestra.run.smithi120.stdout:623 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:623.out 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:624 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:624.out 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:625 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:625.out 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:626 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:626.out 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:627 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:627.out 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:628 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:628.out 2024-03-31T16:38:17.491 INFO:teuthology.orchestra.run.smithi120.stdout:629 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:629.out 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:630 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:630.out 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:631 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:631.out 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:632 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:632.out 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:633 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:633.out 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:634 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:634.out 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:635 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:635.out 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:636 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:636.out 2024-03-31T16:38:17.492 INFO:teuthology.orchestra.run.smithi120.stdout:637 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:637.out 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:638 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:638.out 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:639 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:639.out 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:640 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:640.out 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:641 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:641.out 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:642 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:642.out 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:643 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:643.out 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:644 2024-03-31T16:38:17.493 INFO:teuthology.orchestra.run.smithi120.stdout:644.out 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:645 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:645.out 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:646 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:646.out 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:647 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:647.out 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:648 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:648.out 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:649 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:649.out 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:650 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:650.out 2024-03-31T16:38:17.494 INFO:teuthology.orchestra.run.smithi120.stdout:651 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:651.out 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:652 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:652.out 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:653 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:653.out 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:654 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:654.out 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:655 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:655.out 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:656 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:656.out 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:657 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:657.out 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:658 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:658.out 2024-03-31T16:38:17.495 INFO:teuthology.orchestra.run.smithi120.stdout:659 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:659.out 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:660 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:660.out 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:661 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:661.out 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:662 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:662.out 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:663 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:663.out 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:664 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:664.out 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:665 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:665.out 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:666 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:666.out 2024-03-31T16:38:17.496 INFO:teuthology.orchestra.run.smithi120.stdout:667 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:667.out 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:668 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:668.out 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:669 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:669.out 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:670 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:670.out 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:671 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:671.out 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:672 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:672.out 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:673 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:673.out 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:674 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:674.out 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:675 2024-03-31T16:38:17.497 INFO:teuthology.orchestra.run.smithi120.stdout:675.out 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:676 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:676.out 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:677 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:677.out 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:678 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:678.out 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:679 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:679.out 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:680 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:680.out 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:681 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:681.out 2024-03-31T16:38:17.498 INFO:teuthology.orchestra.run.smithi120.stdout:682 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:682.out 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:683 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:683.out 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:684 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:684.out 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:685 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:685.out 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:686 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:686.out 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:687 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:687.out 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:688 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:688.out 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:689 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:689.out 2024-03-31T16:38:17.499 INFO:teuthology.orchestra.run.smithi120.stdout:690 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:690.out 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:691 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:691.out 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:692 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:692.out 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:693 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:693.out 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:694 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:694.out 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:695 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:695.out 2024-03-31T16:38:17.500 INFO:teuthology.orchestra.run.smithi120.stdout:696 2024-03-31T16:38:17.501 INFO:teuthology.orchestra.run.smithi120.stdout:696.out 2024-03-31T16:38:17.501 INFO:teuthology.orchestra.run.smithi120.stdout:697 2024-03-31T16:38:17.501 INFO:teuthology.orchestra.run.smithi120.stdout:697.out 2024-03-31T16:38:17.501 INFO:teuthology.orchestra.run.smithi120.stdout:698 2024-03-31T16:38:17.501 INFO:teuthology.orchestra.run.smithi120.stdout:698.out 2024-03-31T16:38:17.501 INFO:teuthology.orchestra.run.smithi120.stdout:699 2024-03-31T16:38:17.501 INFO:teuthology.orchestra.run.smithi120.stdout:699.out 2024-03-31T16:38:17.501 INFO:teuthology.orchestra.run.smithi120.stdout:700 2024-03-31T16:38:17.502 INFO:teuthology.orchestra.run.smithi120.stdout:700.out 2024-03-31T16:38:17.502 INFO:teuthology.orchestra.run.smithi120.stdout:701 2024-03-31T16:38:17.502 INFO:teuthology.orchestra.run.smithi120.stdout:701.out 2024-03-31T16:38:17.502 INFO:teuthology.orchestra.run.smithi120.stdout:702 2024-03-31T16:38:17.502 INFO:teuthology.orchestra.run.smithi120.stdout:702.out 2024-03-31T16:38:17.502 INFO:teuthology.orchestra.run.smithi120.stdout:703 2024-03-31T16:38:17.503 INFO:teuthology.orchestra.run.smithi120.stdout:703.out 2024-03-31T16:38:17.503 INFO:teuthology.orchestra.run.smithi120.stdout:704 2024-03-31T16:38:17.503 INFO:teuthology.orchestra.run.smithi120.stdout:704.out 2024-03-31T16:38:17.503 INFO:teuthology.orchestra.run.smithi120.stdout:705 2024-03-31T16:38:17.503 INFO:teuthology.orchestra.run.smithi120.stdout:705.out 2024-03-31T16:38:17.503 INFO:teuthology.orchestra.run.smithi120.stdout:706 2024-03-31T16:38:17.504 INFO:teuthology.orchestra.run.smithi120.stdout:706.out 2024-03-31T16:38:17.504 INFO:teuthology.orchestra.run.smithi120.stdout:707 2024-03-31T16:38:17.504 INFO:teuthology.orchestra.run.smithi120.stdout:707.out 2024-03-31T16:38:17.504 INFO:teuthology.orchestra.run.smithi120.stdout:708 2024-03-31T16:38:17.504 INFO:teuthology.orchestra.run.smithi120.stdout:708.out 2024-03-31T16:38:17.504 INFO:teuthology.orchestra.run.smithi120.stdout:709 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:709.out 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:710 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:710.out 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:711 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:711.out 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:712 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:712.out 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:713 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:713.out 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:714 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:714.out 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:715 2024-03-31T16:38:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:715.out 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:716 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:716.out 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:717 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:717.out 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:718 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:718.out 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:719 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:719.out 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:720 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:720.out 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:721 2024-03-31T16:38:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:721.out 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:722 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:722.out 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:723 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:723.out 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:724 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:724.out 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:725 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:725.out 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:726 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:726.out 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:727 2024-03-31T16:38:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:727.out 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:728 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:728.out 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:729 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:729.out 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:730 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:730.out 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:731 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:731.out 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:732 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:732.out 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:733 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:733.out 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:734 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:734.out 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:735 2024-03-31T16:38:17.508 INFO:teuthology.orchestra.run.smithi120.stdout:735.out 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:736 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:736.out 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:737 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:737.out 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:738 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:738.out 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:739 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:739.out 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:group.list 2024-03-31T16:38:17.509 INFO:teuthology.orchestra.run.smithi120.stdout:Makefile 2024-03-31T16:38:17.509 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-03-31T16:38:17.693 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:38:17.696 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:38:17.697 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:38:17.698 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:38:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:22.724 INFO:teuthology.orchestra.run.smithi120.stdout:generic/001 5s 2024-03-31T16:38:22.730 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/001 2024-03-31T16:38:22.730 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:38:22.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:23.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:38:23.007 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-03-31T16:38:23.185 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:38:23.189 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:38:23.189 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:38:23.190 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:38:23.190 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:23.544 INFO:teuthology.orchestra.run.smithi120.stdout:generic/002 0s 2024-03-31T16:38:23.549 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/002 2024-03-31T16:38:23.549 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:38:23.551 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:23.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:38:23.590 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-03-31T16:38:23.773 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:38:23.776 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:38:23.777 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:38:23.778 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:38:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:24.018 INFO:teuthology.orchestra.run.smithi120.stdout:generic/003 [not run] atime not maintained by ceph 2024-03-31T16:38:24.024 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/003 2024-03-31T16:38:24.024 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/003 2024-03-31T16:38:24.024 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:38:24.028 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:24.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:38:24.135 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-03-31T16:38:24.305 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:38:24.309 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:38:24.309 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:38:24.310 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:38:24.310 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-03-31T16:38:24.521 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/004 2024-03-31T16:38:24.521 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/004 2024-03-31T16:38:24.522 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:38:24.524 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:24.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:38:24.534 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-03-31T16:38:24.709 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:38:24.713 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:38:24.713 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:38:24.714 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:38:24.714 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:25.078 INFO:teuthology.orchestra.run.smithi120.stdout:generic/005 1s 2024-03-31T16:38:25.085 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/005 2024-03-31T16:38:25.085 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:38:25.087 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:25.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:38:25.124 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-03-31T16:38:25.303 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:38:25.307 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:38:25.307 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:38:25.308 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:38:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:32.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:38:32.108 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:38:51.852 INFO:teuthology.orchestra.run.smithi120.stdout:generic/006 26s 2024-03-31T16:38:51.858 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/006 2024-03-31T16:38:51.858 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:38:51.861 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:38:52.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:38:52.053 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-03-31T16:38:52.285 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:38:52.294 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:38:52.294 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:38:52.294 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:38:52.294 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:39:02.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:39:02.371 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:39:32.441 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:39:32.444 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:39:44.921 INFO:teuthology.orchestra.run.smithi120.stdout:generic/007 52s 2024-03-31T16:39:45.067 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/007 2024-03-31T16:39:45.068 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:39:45.070 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:39:45.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:39:45.149 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-03-31T16:39:45.329 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:39:45.332 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:39:45.333 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:39:45.334 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:39:45.334 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:39:45.584 INFO:teuthology.orchestra.run.smithi120.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-31T16:39:45.588 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/008 2024-03-31T16:39:45.588 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/008 2024-03-31T16:39:45.588 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:39:45.590 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:39:45.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:39:45.604 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-03-31T16:39:45.778 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:39:45.781 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:39:45.782 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:39:45.783 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:39:45.783 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:39:46.070 INFO:teuthology.orchestra.run.smithi120.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-31T16:39:46.072 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/009 2024-03-31T16:39:46.073 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/009 2024-03-31T16:39:46.073 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:39:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:39:46.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:39:46.089 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-03-31T16:39:46.266 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:39:46.270 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:39:46.270 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:39:46.271 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:39:46.272 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:39:46.816 INFO:teuthology.orchestra.run.smithi120.stdout:generic/010 0s 2024-03-31T16:39:46.963 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/010 2024-03-31T16:39:46.964 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:39:46.966 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:39:47.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:39:47.000 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-03-31T16:39:47.196 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:39:47.199 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:39:47.200 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:39:47.201 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:39:47.201 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:40:02.789 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:40:02.793 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:40:16.549 INFO:teuthology.orchestra.run.smithi120.stdout:generic/011 29s 2024-03-31T16:40:16.555 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/011 2024-03-31T16:40:16.555 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:40:16.557 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:40:16.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:40:16.602 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-03-31T16:40:16.791 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:40:16.795 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:40:16.795 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:40:16.796 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:40:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:40:17.081 INFO:teuthology.orchestra.run.smithi120.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:40:17.085 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/012 2024-03-31T16:40:17.085 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/012 2024-03-31T16:40:17.085 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:40:17.087 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:40:17.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:40:17.131 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-03-31T16:40:17.344 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:40:17.348 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:40:17.348 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:40:17.349 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:40:17.349 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:40:32.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:40:32.858 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:41:02.998 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:41:03.001 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:41:22.529 INFO:teuthology.orchestra.run.smithi120.stdout:generic/013 65s 2024-03-31T16:41:22.537 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/013 2024-03-31T16:41:22.537 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:22.540 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:22.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:22.564 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-03-31T16:41:22.819 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:22.824 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:22.825 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:22.827 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:22.827 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:23.134 INFO:teuthology.orchestra.run.smithi120.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-03-31T16:41:23.140 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/014 2024-03-31T16:41:23.140 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/014 2024-03-31T16:41:23.140 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:23.143 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:23.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:23.165 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-03-31T16:41:23.420 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:23.426 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:23.427 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:23.428 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:23.428 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:23.705 INFO:teuthology.orchestra.run.smithi120.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T16:41:23.710 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/015 2024-03-31T16:41:23.710 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/015 2024-03-31T16:41:23.710 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:23.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:23.731 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-03-31T16:41:23.994 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:23.999 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:23.999 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:24.000 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:24.001 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:24.388 INFO:teuthology.orchestra.run.smithi120.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:41:24.393 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/016 2024-03-31T16:41:24.393 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/016 2024-03-31T16:41:24.393 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:24.397 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:24.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:24.432 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-03-31T16:41:24.718 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:24.723 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:24.724 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:24.725 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:24.725 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:25.029 INFO:teuthology.orchestra.run.smithi120.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-31T16:41:25.034 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/017 2024-03-31T16:41:25.034 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/017 2024-03-31T16:41:25.034 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:25.038 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:25.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:25.060 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-03-31T16:41:25.318 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:25.324 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:25.324 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:25.325 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:25.701 INFO:teuthology.orchestra.run.smithi120.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-03-31T16:41:25.710 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/018 2024-03-31T16:41:25.710 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/018 2024-03-31T16:41:25.710 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:25.713 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:25.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:25.728 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-03-31T16:41:25.994 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:25.998 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:25.999 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:26.000 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:26.000 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:26.279 INFO:teuthology.orchestra.run.smithi120.stdout:generic/019 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:41:26.284 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/019 2024-03-31T16:41:26.284 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/019 2024-03-31T16:41:26.284 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:26.287 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:26.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:26.302 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-03-31T16:41:26.564 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:26.570 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:26.570 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:26.572 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:30.840 INFO:teuthology.orchestra.run.smithi120.stdout:generic/020 4s 2024-03-31T16:41:30.893 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/020 2024-03-31T16:41:30.893 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:30.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:30.928 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-03-31T16:41:31.232 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:31.238 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:31.239 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:31.240 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:31.646 INFO:teuthology.orchestra.run.smithi120.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:41:31.652 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/021 2024-03-31T16:41:31.652 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/021 2024-03-31T16:41:31.652 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:31.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:31.684 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-03-31T16:41:31.986 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:31.991 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:31.993 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:31.995 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:32.395 INFO:teuthology.orchestra.run.smithi120.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:41:32.401 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/022 2024-03-31T16:41:32.401 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/022 2024-03-31T16:41:32.402 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:32.405 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:32.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:32.433 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-03-31T16:41:32.727 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:32.732 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:32.733 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:32.734 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:33.261 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:41:33.264 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:41:33.995 INFO:teuthology.orchestra.run.smithi120.stdout:generic/023 1s 2024-03-31T16:41:34.066 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/023 2024-03-31T16:41:34.067 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:34.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:34.148 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-03-31T16:41:34.436 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:34.443 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:34.443 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:34.445 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:34.445 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:34.758 INFO:teuthology.orchestra.run.smithi120.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-03-31T16:41:34.763 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/024 2024-03-31T16:41:34.763 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/024 2024-03-31T16:41:34.763 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:34.766 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:34.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:34.798 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-03-31T16:41:35.102 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:35.107 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:35.107 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:35.109 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:35.109 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:35.418 INFO:teuthology.orchestra.run.smithi120.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-03-31T16:41:35.424 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/025 2024-03-31T16:41:35.424 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/025 2024-03-31T16:41:35.425 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:35.428 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:35.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:35.465 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-03-31T16:41:35.767 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:35.772 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:35.773 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:35.775 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:35.775 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:36.091 INFO:teuthology.orchestra.run.smithi120.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-03-31T16:41:36.096 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/026 2024-03-31T16:41:36.096 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/026 2024-03-31T16:41:36.096 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:36.099 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:36.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:36.124 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-03-31T16:41:36.384 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:36.390 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:36.390 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:36.391 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:36.392 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:36.670 INFO:teuthology.orchestra.run.smithi120.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T16:41:36.676 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/027 2024-03-31T16:41:36.676 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/027 2024-03-31T16:41:36.676 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:36.679 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:36.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:36.694 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-03-31T16:41:36.952 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:36.957 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:36.958 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:36.959 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:42.255 INFO:teuthology.orchestra.run.smithi120.stdout:generic/028 5s 2024-03-31T16:41:42.262 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/028 2024-03-31T16:41:42.262 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:42.266 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:42.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:42.286 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-03-31T16:41:42.551 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:42.556 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:42.558 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:42.559 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:42.559 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:46.792 INFO:teuthology.orchestra.run.smithi120.stdout:generic/029 4s 2024-03-31T16:41:46.800 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/029 2024-03-31T16:41:46.800 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:46.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:46.815 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-03-31T16:41:47.072 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:47.078 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:47.078 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:47.080 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:48.764 INFO:teuthology.orchestra.run.smithi120.stdout:generic/030 1s 2024-03-31T16:41:48.772 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/030 2024-03-31T16:41:48.772 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:48.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:48.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:48.785 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-03-31T16:41:49.037 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:49.042 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:49.043 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:49.044 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:49.044 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:49.417 INFO:teuthology.orchestra.run.smithi120.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-31T16:41:49.422 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/031 2024-03-31T16:41:49.422 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/031 2024-03-31T16:41:49.422 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:49.426 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:49.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:49.447 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-03-31T16:41:49.712 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:49.717 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:49.718 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:49.719 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:50.011 INFO:teuthology.orchestra.run.smithi120.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:41:50.017 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/032 2024-03-31T16:41:50.017 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/032 2024-03-31T16:41:50.017 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:50.020 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:50.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:50.039 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-03-31T16:41:50.302 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:50.308 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:50.308 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:50.309 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:50.309 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:50.657 INFO:teuthology.orchestra.run.smithi120.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-31T16:41:50.663 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/033 2024-03-31T16:41:50.664 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/033 2024-03-31T16:41:50.664 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:50.666 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:50.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:50.687 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-03-31T16:41:50.953 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:50.962 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:50.962 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:50.963 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:50.964 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:51.249 INFO:teuthology.orchestra.run.smithi120.stdout:generic/034 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:41:51.253 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/034 2024-03-31T16:41:51.254 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/034 2024-03-31T16:41:51.254 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:51.257 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:51.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:51.276 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-03-31T16:41:51.534 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:51.538 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:51.539 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:51.540 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:51.540 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:51.915 INFO:teuthology.orchestra.run.smithi120.stdout:generic/035 0s 2024-03-31T16:41:51.921 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/035 2024-03-31T16:41:51.921 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:41:51.923 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:41:51.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:41:51.973 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-03-31T16:41:52.261 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:41:52.266 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:41:52.266 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:41:52.267 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:41:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:02.654 INFO:teuthology.orchestra.run.smithi120.stdout:generic/036 10s 2024-03-31T16:42:02.662 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/036 2024-03-31T16:42:02.662 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:02.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:02.692 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-03-31T16:42:02.992 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:02.997 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:02.997 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:02.999 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:02.999 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:03.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:42:03.625 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:42:08.418 INFO:teuthology.orchestra.run.smithi120.stdout:generic/037 5s 2024-03-31T16:42:08.426 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/037 2024-03-31T16:42:08.427 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:08.430 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:08.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:08.441 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-03-31T16:42:08.721 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:08.727 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:08.728 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:08.729 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:08.729 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:09.031 INFO:teuthology.orchestra.run.smithi120.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:42:09.037 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/038 2024-03-31T16:42:09.037 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/038 2024-03-31T16:42:09.037 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:09.040 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:09.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:09.059 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-03-31T16:42:09.312 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:09.318 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:09.318 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:09.319 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:09.319 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:09.628 INFO:teuthology.orchestra.run.smithi120.stdout:generic/039 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:09.633 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/039 2024-03-31T16:42:09.633 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/039 2024-03-31T16:42:09.634 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:09.637 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:09.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:09.659 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-03-31T16:42:09.918 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:09.924 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:09.926 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:09.928 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:09.928 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:10.240 INFO:teuthology.orchestra.run.smithi120.stdout:generic/040 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:10.245 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/040 2024-03-31T16:42:10.245 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/040 2024-03-31T16:42:10.245 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:10.250 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:10.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:10.275 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-03-31T16:42:10.538 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:10.543 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:10.544 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:10.545 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:10.861 INFO:teuthology.orchestra.run.smithi120.stdout:generic/041 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:10.867 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/041 2024-03-31T16:42:10.867 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/041 2024-03-31T16:42:10.867 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:10.870 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:10.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:10.890 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-03-31T16:42:11.165 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:11.171 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:11.172 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:11.173 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:11.173 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:11.554 INFO:teuthology.orchestra.run.smithi120.stdout:generic/042 [not run] ceph does not support shutdown 2024-03-31T16:42:11.566 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/042 2024-03-31T16:42:11.567 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/042 2024-03-31T16:42:11.567 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:11.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:11.585 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-03-31T16:42:11.838 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:11.843 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:11.843 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:11.844 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:12.212 INFO:teuthology.orchestra.run.smithi120.stdout:generic/043 [not run] ceph does not support shutdown 2024-03-31T16:42:12.221 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/043 2024-03-31T16:42:12.221 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/043 2024-03-31T16:42:12.221 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:12.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:12.240 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-03-31T16:42:12.507 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:12.512 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:12.512 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:12.513 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:12.513 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:12.886 INFO:teuthology.orchestra.run.smithi120.stdout:generic/044 [not run] ceph does not support shutdown 2024-03-31T16:42:12.892 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/044 2024-03-31T16:42:12.893 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/044 2024-03-31T16:42:12.893 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:12.895 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:12.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:12.909 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-03-31T16:42:13.169 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:13.176 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:13.177 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:13.178 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:13.178 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:13.544 INFO:teuthology.orchestra.run.smithi120.stdout:generic/045 [not run] ceph does not support shutdown 2024-03-31T16:42:13.554 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/045 2024-03-31T16:42:13.554 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/045 2024-03-31T16:42:13.554 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:13.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:13.572 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-03-31T16:42:13.831 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:13.838 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:13.838 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:13.840 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:13.840 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:14.201 INFO:teuthology.orchestra.run.smithi120.stdout:generic/046 [not run] ceph does not support shutdown 2024-03-31T16:42:14.221 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/046 2024-03-31T16:42:14.221 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/046 2024-03-31T16:42:14.221 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:14.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:14.239 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-03-31T16:42:14.511 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:14.516 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:14.517 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:14.520 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:14.887 INFO:teuthology.orchestra.run.smithi120.stdout:generic/047 [not run] ceph does not support shutdown 2024-03-31T16:42:14.907 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/047 2024-03-31T16:42:14.907 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/047 2024-03-31T16:42:14.907 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:14.910 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:14.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:14.925 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-03-31T16:42:15.180 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:15.186 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:15.186 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:15.188 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:15.188 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:15.555 INFO:teuthology.orchestra.run.smithi120.stdout:generic/048 [not run] ceph does not support shutdown 2024-03-31T16:42:15.575 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/048 2024-03-31T16:42:15.575 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/048 2024-03-31T16:42:15.575 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:15.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:15.594 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-03-31T16:42:15.858 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:15.863 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:15.863 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:15.864 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:15.865 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:16.233 INFO:teuthology.orchestra.run.smithi120.stdout:generic/049 [not run] ceph does not support shutdown 2024-03-31T16:42:16.242 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/049 2024-03-31T16:42:16.243 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/049 2024-03-31T16:42:16.243 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:16.245 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:16.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:16.260 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-03-31T16:42:16.522 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:16.527 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:16.528 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:16.530 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:16.530 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:16.899 INFO:teuthology.orchestra.run.smithi120.stdout:generic/050 [not run] ceph does not support shutdown 2024-03-31T16:42:16.917 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/050 2024-03-31T16:42:16.917 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/050 2024-03-31T16:42:16.917 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:16.919 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:16.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:16.934 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-03-31T16:42:17.197 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:17.202 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:17.203 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:17.204 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:17.204 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:17.593 INFO:teuthology.orchestra.run.smithi120.stdout:generic/051 [not run] ceph does not support shutdown 2024-03-31T16:42:17.598 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/051 2024-03-31T16:42:17.598 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/051 2024-03-31T16:42:17.598 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:17.601 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:17.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:17.616 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-03-31T16:42:17.871 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:17.876 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:17.876 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:17.878 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:18.258 INFO:teuthology.orchestra.run.smithi120.stdout:generic/052 [not run] ceph does not support shutdown 2024-03-31T16:42:18.270 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/052 2024-03-31T16:42:18.270 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/052 2024-03-31T16:42:18.270 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:18.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:18.287 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-03-31T16:42:18.548 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:18.553 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:18.554 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:18.555 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:18.555 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:19.249 INFO:teuthology.orchestra.run.smithi120.stdout:generic/053 1s 2024-03-31T16:42:19.285 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/053 2024-03-31T16:42:19.285 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:19.289 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:19.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:19.301 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-03-31T16:42:19.574 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:19.580 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:19.581 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:19.582 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:19.583 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:19.983 INFO:teuthology.orchestra.run.smithi120.stdout:generic/054 [not run] ceph does not support shutdown 2024-03-31T16:42:19.999 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/054 2024-03-31T16:42:19.999 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/054 2024-03-31T16:42:19.999 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:20.002 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:20.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:20.018 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-03-31T16:42:20.287 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:20.294 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:20.295 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:20.296 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:20.672 INFO:teuthology.orchestra.run.smithi120.stdout:generic/055 [not run] ceph does not support shutdown 2024-03-31T16:42:20.683 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/055 2024-03-31T16:42:20.683 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/055 2024-03-31T16:42:20.683 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:20.687 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:20.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:20.701 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-03-31T16:42:20.959 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:20.964 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:20.965 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:20.966 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:20.966 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:21.287 INFO:teuthology.orchestra.run.smithi120.stdout:generic/056 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:21.293 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/056 2024-03-31T16:42:21.293 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/056 2024-03-31T16:42:21.293 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:21.296 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:21.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:21.320 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-03-31T16:42:21.578 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:21.582 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:21.583 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:21.584 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:21.584 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:21.902 INFO:teuthology.orchestra.run.smithi120.stdout:generic/057 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:21.908 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/057 2024-03-31T16:42:21.908 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/057 2024-03-31T16:42:21.908 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:21.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:21.934 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-03-31T16:42:22.192 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:22.200 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:22.200 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:22.201 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:22.201 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:22.591 INFO:teuthology.orchestra.run.smithi120.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:42:22.597 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/058 2024-03-31T16:42:22.597 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/058 2024-03-31T16:42:22.597 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:22.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:22.635 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-03-31T16:42:22.963 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:22.968 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:22.969 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:22.970 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:23.259 INFO:teuthology.orchestra.run.smithi120.stdout:generic/059 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:23.264 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/059 2024-03-31T16:42:23.264 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/059 2024-03-31T16:42:23.264 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:23.269 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:23.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:23.285 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-03-31T16:42:23.535 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:23.540 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:23.540 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:23.542 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:23.542 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:23.926 INFO:teuthology.orchestra.run.smithi120.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:42:23.930 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/060 2024-03-31T16:42:23.931 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/060 2024-03-31T16:42:23.931 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:23.934 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:23.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:23.961 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-03-31T16:42:24.274 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:24.280 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:24.280 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:24.282 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:24.282 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:24.696 INFO:teuthology.orchestra.run.smithi120.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:42:24.701 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/061 2024-03-31T16:42:24.701 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/061 2024-03-31T16:42:24.701 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:24.705 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:24.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:24.737 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-03-31T16:42:25.060 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:25.065 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:25.065 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:25.067 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:25.068 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:26.994 INFO:teuthology.orchestra.run.smithi120.stdout:generic/062 1s 2024-03-31T16:42:27.002 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/062 2024-03-31T16:42:27.002 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:27.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:27.019 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-03-31T16:42:27.268 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:27.274 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:27.274 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:27.275 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:27.276 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:27.738 INFO:teuthology.orchestra.run.smithi120.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:42:27.743 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/063 2024-03-31T16:42:27.743 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/063 2024-03-31T16:42:27.743 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:27.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:27.782 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-03-31T16:42:28.091 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:28.096 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:28.097 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:28.098 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:28.398 INFO:teuthology.orchestra.run.smithi120.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-31T16:42:28.403 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/064 2024-03-31T16:42:28.403 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/064 2024-03-31T16:42:28.403 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:28.406 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:28.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:28.426 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-03-31T16:42:28.676 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:28.680 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:28.682 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:28.682 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:28.984 INFO:teuthology.orchestra.run.smithi120.stdout:generic/065 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:28.989 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/065 2024-03-31T16:42:28.989 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/065 2024-03-31T16:42:28.989 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:28.992 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:29.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:29.012 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-03-31T16:42:29.274 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:29.281 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:29.282 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:29.283 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:29.283 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:29.567 INFO:teuthology.orchestra.run.smithi120.stdout:generic/066 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:29.571 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/066 2024-03-31T16:42:29.572 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/066 2024-03-31T16:42:29.572 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:29.575 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:29.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:29.593 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-03-31T16:42:29.849 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:29.855 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:29.856 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:29.857 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:29.857 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:30.167 INFO:teuthology.orchestra.run.smithi120.stdout:generic/067 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:42:30.173 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/067 2024-03-31T16:42:30.173 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/067 2024-03-31T16:42:30.173 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:30.177 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:30.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:30.196 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-03-31T16:42:30.450 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:30.454 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:30.455 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:30.456 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:30.746 INFO:teuthology.orchestra.run.smithi120.stdout:generic/068 [not run] ceph does not support freezing 2024-03-31T16:42:30.752 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/068 2024-03-31T16:42:30.752 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/068 2024-03-31T16:42:30.752 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:30.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:30.771 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-03-31T16:42:31.027 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:31.032 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:31.033 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:31.034 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:33.998 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:42:34.001 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:42:38.165 INFO:teuthology.orchestra.run.smithi120.stdout:generic/069 7s 2024-03-31T16:42:38.175 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/069 2024-03-31T16:42:38.175 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:42:38.182 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:42:38.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:42:38.203 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-03-31T16:42:38.491 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:42:38.497 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:42:38.497 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:42:38.498 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:42:38.498 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:01.723 INFO:teuthology.orchestra.run.smithi120.stdout:generic/070 23s 2024-03-31T16:43:01.730 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/070 2024-03-31T16:43:01.730 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:01.734 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:01.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:01.837 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-03-31T16:43:02.143 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:02.148 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:02.149 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:02.150 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:02.439 INFO:teuthology.orchestra.run.smithi120.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-31T16:43:02.444 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/071 2024-03-31T16:43:02.444 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/071 2024-03-31T16:43:02.444 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:02.448 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:02.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:02.465 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-03-31T16:43:02.717 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:02.725 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:02.726 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:02.727 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:03.097 INFO:teuthology.orchestra.run.smithi120.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-31T16:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/072 2024-03-31T16:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/072 2024-03-31T16:43:03.102 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:03.106 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:03.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:03.123 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-03-31T16:43:03.387 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:03.393 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:03.394 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:03.395 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:03.685 INFO:teuthology.orchestra.run.smithi120.stdout:generic/073 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/073 2024-03-31T16:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/073 2024-03-31T16:43:03.690 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:03.695 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:03.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:03.710 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-03-31T16:43:03.976 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:03.981 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:03.982 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:03.983 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:04.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:43:04.232 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:43:04.295 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T16:43:04.292+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159176) UID: 0 2024-03-31T16:43:04.296 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T16:43:04.293+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159176) UID: 0 2024-03-31T16:43:20.804 INFO:teuthology.orchestra.run.smithi120.stdout:generic/074 16s 2024-03-31T16:43:20.812 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/074 2024-03-31T16:43:20.812 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:20.816 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:21.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:21.817 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-03-31T16:43:22.197 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:22.203 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:22.203 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:22.207 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:22.207 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:45.404 INFO:teuthology.orchestra.run.smithi120.stdout:generic/075 23s 2024-03-31T16:43:45.475 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/075 2024-03-31T16:43:45.475 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:45.478 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:45.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:45.539 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-03-31T16:43:45.911 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:45.917 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:45.918 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:45.919 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:45.920 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:46.214 INFO:teuthology.orchestra.run.smithi120.stdout:generic/076 [not run] require 172.21.15.120:6789:/scratch to be local device 2024-03-31T16:43:46.222 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/076 2024-03-31T16:43:46.222 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/076 2024-03-31T16:43:46.222 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:46.226 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:46.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:46.243 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-03-31T16:43:46.527 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:46.532 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:46.533 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:46.534 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:46.534 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:47.783 INFO:teuthology.orchestra.run.smithi120.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T16:43:47.788 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/077 2024-03-31T16:43:47.788 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/077 2024-03-31T16:43:47.788 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:47.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:47.833 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-03-31T16:43:48.185 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:48.191 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:48.191 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:48.193 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:48.193 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:48.523 INFO:teuthology.orchestra.run.smithi120.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-03-31T16:43:48.528 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/078 2024-03-31T16:43:48.528 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/078 2024-03-31T16:43:48.528 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:48.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:48.592 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-03-31T16:43:48.975 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:48.980 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:48.981 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:48.982 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:48.982 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:49.298 INFO:teuthology.orchestra.run.smithi120.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-03-31T16:43:49.303 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/079 2024-03-31T16:43:49.303 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/079 2024-03-31T16:43:49.304 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:49.306 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:49.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:49.325 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-03-31T16:43:49.605 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:49.610 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:49.610 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:49.611 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:49.611 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:51.974 INFO:teuthology.orchestra.run.smithi120.stdout:generic/080 2s 2024-03-31T16:43:51.984 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/080 2024-03-31T16:43:51.984 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:51.987 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:52.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:52.011 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-03-31T16:43:52.314 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:52.321 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:52.322 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:52.325 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:52.325 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:52.691 INFO:teuthology.orchestra.run.smithi120.stdout:generic/081 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:43:52.697 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/081 2024-03-31T16:43:52.697 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/081 2024-03-31T16:43:52.697 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:52.700 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:52.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:52.715 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-03-31T16:43:52.993 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:52.997 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:52.997 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:52.998 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:53.298 INFO:teuthology.orchestra.run.smithi120.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T16:43:53.304 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/082 2024-03-31T16:43:53.304 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/082 2024-03-31T16:43:53.304 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:53.307 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:53.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:53.322 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-03-31T16:43:53.617 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:53.622 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:53.622 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:53.625 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:53.943 INFO:teuthology.orchestra.run.smithi120.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T16:43:53.949 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/083 2024-03-31T16:43:53.949 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/083 2024-03-31T16:43:53.949 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:53.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:53.969 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-03-31T16:43:54.263 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:43:54.270 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:43:54.271 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:43:54.276 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:43:54.276 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:59.796 INFO:teuthology.orchestra.run.smithi120.stdout:generic/084 5s 2024-03-31T16:43:59.803 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/084 2024-03-31T16:43:59.803 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:43:59.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:43:59.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:43:59.819 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-03-31T16:44:00.184 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:44:00.192 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:44:00.194 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:44:00.194 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:44:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:44:00.531 INFO:teuthology.orchestra.run.smithi120.stdout:generic/085 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:44:00.537 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/085 2024-03-31T16:44:00.537 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/085 2024-03-31T16:44:00.537 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:44:00.540 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:44:00.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:44:00.556 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-03-31T16:44:00.857 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:44:00.863 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:44:00.864 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:44:00.865 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:44:00.866 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:44:01.177 INFO:teuthology.orchestra.run.smithi120.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:44:01.184 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/086 2024-03-31T16:44:01.185 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/086 2024-03-31T16:44:01.185 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:44:01.188 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:44:01.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:44:01.214 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-03-31T16:44:01.491 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:44:01.499 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:44:01.500 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:44:01.501 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:44:01.501 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:44:01.909 INFO:teuthology.orchestra.run.smithi120.stdout:generic/087 0s 2024-03-31T16:44:01.917 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/087 2024-03-31T16:44:01.917 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:44:01.921 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:44:02.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:44:02.000 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-03-31T16:44:02.375 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:44:02.380 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:44:02.380 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:44:02.382 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:44:02.382 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:44:02.731 INFO:teuthology.orchestra.run.smithi120.stdout:generic/088 0s 2024-03-31T16:44:02.739 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/088 2024-03-31T16:44:02.739 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:44:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:44:02.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:44:02.784 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-03-31T16:44:03.172 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:44:03.179 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:44:03.180 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:44:03.181 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:44:03.181 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:46:11.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:46:11.654 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:46:42.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:46:42.096 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:47:12.162 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:47:12.165 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:47:42.264 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:47:42.270 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:48:12.407 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:48:12.410 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:48:12.457 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T16:48:12.454+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169698) UID: 0 2024-03-31T16:48:12.458 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T16:48:12.454+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169698) UID: 0 2024-03-31T16:51:15.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:51:15.929 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:51:46.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:51:46.159 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:51:46.191 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T16:51:46.188+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 171749) UID: 0 2024-03-31T16:51:46.191 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T16:51:46.188+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 171749) UID: 0 2024-03-31T16:52:56.664 INFO:teuthology.orchestra.run.smithi120.stdout:generic/089 533s 2024-03-31T16:52:56.672 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/089 2024-03-31T16:52:56.672 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:52:56.674 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:52:57.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:52:57.768 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-03-31T16:52:58.489 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:52:58.497 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:52:58.497 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:52:58.498 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:52:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:52:58.963 INFO:teuthology.orchestra.run.smithi120.stdout:generic/090 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:52:58.969 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/090 2024-03-31T16:52:58.969 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/090 2024-03-31T16:52:58.969 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:52:58.977 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:52:59.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:52:59.009 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-03-31T16:52:59.217 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:52:59.221 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:52:59.221 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:52:59.222 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:52:59.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:35.634 INFO:teuthology.orchestra.run.smithi120.stdout:generic/091 96s 2024-03-31T16:54:35.639 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/091 2024-03-31T16:54:35.639 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:35.641 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:35.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:35.688 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-03-31T16:54:36.087 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:36.094 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:36.094 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:36.094 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:36.095 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:36.326 INFO:teuthology.orchestra.run.smithi120.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:54:36.330 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/092 2024-03-31T16:54:36.330 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/092 2024-03-31T16:54:36.330 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:36.332 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:36.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:36.348 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-03-31T16:54:36.529 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:36.533 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:36.533 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:36.535 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:36.535 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:37.183 INFO:teuthology.orchestra.run.smithi120.stdout:generic/093 1s 2024-03-31T16:54:37.189 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/093 2024-03-31T16:54:37.189 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:37.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:37.253 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-03-31T16:54:37.645 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:37.649 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:37.650 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:37.651 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:37.651 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:37.909 INFO:teuthology.orchestra.run.smithi120.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-31T16:54:37.913 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/094 2024-03-31T16:54:37.913 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/094 2024-03-31T16:54:37.913 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:37.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:37.966 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-03-31T16:54:38.379 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:38.382 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:38.383 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:38.384 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:38.384 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:44.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:54:44.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:54:49.066 INFO:teuthology.orchestra.run.smithi120.stdout:generic/095 11s 2024-03-31T16:54:49.074 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/095 2024-03-31T16:54:49.075 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:49.078 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:49.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:49.088 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-03-31T16:54:49.276 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:49.280 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:49.280 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:49.281 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:49.281 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:49.569 INFO:teuthology.orchestra.run.smithi120.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-31T16:54:49.572 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/096 2024-03-31T16:54:49.572 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/096 2024-03-31T16:54:49.573 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:49.575 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:49.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:49.593 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-03-31T16:54:49.777 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:49.780 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:49.781 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:49.782 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:49.782 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:50.466 INFO:teuthology.orchestra.run.smithi120.stdout:generic/097 1s 2024-03-31T16:54:50.479 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/097 2024-03-31T16:54:50.479 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:50.481 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:50.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:50.493 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-03-31T16:54:50.680 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:50.683 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:50.684 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:50.685 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:50.685 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:51.897 INFO:teuthology.orchestra.run.smithi120.stdout:generic/098 1s 2024-03-31T16:54:51.903 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/098 2024-03-31T16:54:51.903 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:51.905 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:51.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:51.915 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-31T16:54:52.098 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:52.102 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:52.102 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:52.103 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:52.103 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:52.889 INFO:teuthology.orchestra.run.smithi120.stdout:generic/099 0s 2024-03-31T16:54:52.895 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/099 2024-03-31T16:54:52.895 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:54:52.897 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:54:52.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:54:52.954 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-03-31T16:54:53.359 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:54:53.363 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:54:53.363 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:54:53.364 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:54:53.364 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:04.612 INFO:teuthology.orchestra.run.smithi120.stdout:generic/100 11s 2024-03-31T16:55:04.617 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/100 2024-03-31T16:55:04.618 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:04.620 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:07.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:07.911 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-03-31T16:55:08.242 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:08.246 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:08.247 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:08.248 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:08.248 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:08.471 INFO:teuthology.orchestra.run.smithi120.stdout:generic/101 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:55:08.475 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/101 2024-03-31T16:55:08.475 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/101 2024-03-31T16:55:08.475 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:08.477 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:08.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:08.490 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-03-31T16:55:08.675 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:08.679 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:08.679 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:08.680 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:08.681 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:08.883 INFO:teuthology.orchestra.run.smithi120.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T16:55:08.887 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/102 2024-03-31T16:55:08.887 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/102 2024-03-31T16:55:08.887 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:08.889 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:08.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:08.900 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-03-31T16:55:09.083 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:09.086 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:09.087 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:09.088 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:09.088 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:09.306 INFO:teuthology.orchestra.run.smithi120.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T16:55:09.309 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/103 2024-03-31T16:55:09.310 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/103 2024-03-31T16:55:09.310 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:09.312 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:09.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:09.362 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-03-31T16:55:09.751 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:09.755 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:09.755 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:09.756 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:09.756 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:09.990 INFO:teuthology.orchestra.run.smithi120.stdout:generic/104 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:55:09.994 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/104 2024-03-31T16:55:09.994 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/104 2024-03-31T16:55:09.994 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:09.996 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:10.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:10.011 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-03-31T16:55:10.200 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:10.203 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:10.204 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:10.205 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:10.205 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:10.628 INFO:teuthology.orchestra.run.smithi120.stdout:generic/105 0s 2024-03-31T16:55:10.639 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/105 2024-03-31T16:55:10.639 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:10.641 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:10.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:10.657 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-03-31T16:55:11.015 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:11.019 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:11.020 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:11.021 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:11.242 INFO:teuthology.orchestra.run.smithi120.stdout:generic/106 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:55:11.246 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/106 2024-03-31T16:55:11.246 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/106 2024-03-31T16:55:11.246 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:11.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:11.262 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-03-31T16:55:11.458 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:11.462 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:11.462 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:11.464 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:11.464 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:11.700 INFO:teuthology.orchestra.run.smithi120.stdout:generic/107 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:55:11.704 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/107 2024-03-31T16:55:11.704 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/107 2024-03-31T16:55:11.704 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:11.706 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:11.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:11.720 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-03-31T16:55:11.894 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:11.897 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:11.898 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:11.899 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:12.301 INFO:teuthology.orchestra.run.smithi120.stdout:generic/108 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T16:55:12.305 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/108 2024-03-31T16:55:12.305 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/108 2024-03-31T16:55:12.305 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:12.310 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:12.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:12.320 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-03-31T16:55:12.512 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:12.516 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:12.516 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:12.517 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:12.517 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:14.746 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:55:14.748 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:55:23.370 INFO:teuthology.orchestra.run.smithi120.stdout:generic/109 11s 2024-03-31T16:55:23.377 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/109 2024-03-31T16:55:23.377 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:23.379 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:23.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:23.388 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-03-31T16:55:24.204 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:24.208 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:24.208 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:24.209 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:42.637 INFO:teuthology.orchestra.run.smithi120.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T16:55:42.641 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/110 2024-03-31T16:55:42.641 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/110 2024-03-31T16:55:42.642 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:42.644 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:42.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:42.752 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-03-31T16:55:43.234 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:43.241 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:43.242 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:43.243 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:43.243 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:43.787 INFO:teuthology.orchestra.run.smithi120.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T16:55:43.794 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/111 2024-03-31T16:55:43.794 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/111 2024-03-31T16:55:43.794 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:43.796 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:43.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:43.885 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-03-31T16:55:44.374 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:55:44.378 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:55:44.378 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:55:44.379 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:55:44.379 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:45.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:55:45.022 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:55:59.534 INFO:teuthology.orchestra.run.smithi120.stdout:generic/112 15s 2024-03-31T16:55:59.539 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/112 2024-03-31T16:55:59.539 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:55:59.541 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:55:59.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:55:59.596 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-03-31T16:56:00.012 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:00.016 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:00.016 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:00.018 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:00.018 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:14.877 INFO:teuthology.orchestra.run.smithi120.stdout:generic/113 14s 2024-03-31T16:56:14.882 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/113 2024-03-31T16:56:14.882 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:14.884 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:14.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:14.947 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-03-31T16:56:15.283 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:56:15.286 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:56:15.325 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:15.329 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:15.330 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:15.331 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:15.331 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:15.558 INFO:teuthology.orchestra.run.smithi120.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-03-31T16:56:15.562 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/114 2024-03-31T16:56:15.562 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/114 2024-03-31T16:56:15.562 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:15.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:15.585 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-03-31T16:56:15.911 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:15.915 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:15.915 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:15.916 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:15.916 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:16.144 INFO:teuthology.orchestra.run.smithi120.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T16:56:16.147 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/115 2024-03-31T16:56:16.148 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/115 2024-03-31T16:56:16.148 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:16.150 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:16.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:16.201 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-03-31T16:56:16.614 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:16.618 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:16.618 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:16.619 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:16.850 INFO:teuthology.orchestra.run.smithi120.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T16:56:16.854 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/116 2024-03-31T16:56:16.854 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/116 2024-03-31T16:56:16.854 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:16.856 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:16.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:16.910 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-03-31T16:56:17.335 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:17.339 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:17.339 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:17.340 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:17.340 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:29.590 INFO:teuthology.orchestra.run.smithi120.stdout:generic/117 12s 2024-03-31T16:56:29.598 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/117 2024-03-31T16:56:29.598 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:29.602 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:29.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:29.612 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-03-31T16:56:29.823 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:29.827 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:29.828 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:29.829 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:29.829 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:30.405 INFO:teuthology.orchestra.run.smithi120.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T16:56:30.409 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/118 2024-03-31T16:56:30.409 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/118 2024-03-31T16:56:30.409 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:30.411 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:30.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:30.469 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-03-31T16:56:30.833 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:30.843 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:30.843 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:30.848 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:31.171 INFO:teuthology.orchestra.run.smithi120.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T16:56:31.175 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/119 2024-03-31T16:56:31.175 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/119 2024-03-31T16:56:31.175 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:31.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:31.239 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-03-31T16:56:31.595 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:31.599 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:31.601 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:31.601 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:31.815 INFO:teuthology.orchestra.run.smithi120.stdout:generic/120 [not run] atime not maintained by ceph 2024-03-31T16:56:31.819 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/120 2024-03-31T16:56:31.820 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/120 2024-03-31T16:56:31.820 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:31.822 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:31.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:31.833 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-03-31T16:56:32.008 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:32.012 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:32.012 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:32.013 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:32.255 INFO:teuthology.orchestra.run.smithi120.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-31T16:56:32.258 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/121 2024-03-31T16:56:32.259 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/121 2024-03-31T16:56:32.259 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:32.261 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:32.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:32.303 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-03-31T16:56:32.706 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:32.710 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:32.710 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:32.711 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:32.939 INFO:teuthology.orchestra.run.smithi120.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-31T16:56:32.943 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/122 2024-03-31T16:56:32.943 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/122 2024-03-31T16:56:32.943 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:33.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:33.018 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-03-31T16:56:33.369 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:33.373 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:33.374 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:33.374 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:33.375 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:33.913 INFO:teuthology.orchestra.run.smithi120.stdout:generic/123 0s 2024-03-31T16:56:33.918 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/123 2024-03-31T16:56:33.919 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:33.921 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:33.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:33.973 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-03-31T16:56:34.392 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:34.395 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:34.396 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:34.397 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:34.397 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:36.262 INFO:teuthology.orchestra.run.smithi120.stdout:generic/124 2s 2024-03-31T16:56:36.276 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/124 2024-03-31T16:56:36.276 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:56:36.284 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:36.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:56:36.869 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-03-31T16:56:37.239 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:56:37.243 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:56:37.244 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:56:37.245 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:56:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:56:45.347 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:56:45.349 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:57:15.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:57:15.670 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:57:38.631 INFO:teuthology.orchestra.run.smithi120.stdout:generic/125 61s 2024-03-31T16:57:38.636 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/125 2024-03-31T16:57:38.636 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:57:38.638 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:57:38.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:57:38.681 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-03-31T16:57:39.061 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:57:39.065 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:57:39.066 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:57:39.067 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:57:39.067 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:57:39.453 INFO:teuthology.orchestra.run.smithi120.stdout:generic/126 0s 2024-03-31T16:57:39.459 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/126 2024-03-31T16:57:39.459 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T16:57:39.461 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:57:39.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T16:57:39.538 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-03-31T16:57:39.934 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T16:57:39.941 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T16:57:39.942 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T16:57:39.944 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T16:57:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T16:57:45.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:57:45.791 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:58:15.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:58:15.867 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:58:45.932 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:58:45.934 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:59:16.029 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:59:16.032 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:59:46.134 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T16:59:46.137 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:00:16.241 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:00:16.244 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:00:46.364 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:00:46.367 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:01:16.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:01:16.770 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:01:46.898 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:01:46.902 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:02:17.039 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:02:17.042 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:02:47.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:02:47.271 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:03:17.392 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:03:17.395 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:03:47.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:03:47.787 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:04:17.843 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:04:17.846 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:04:47.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:04:47.953 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:05:18.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:05:18.093 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:05:48.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:05:48.198 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:06:18.277 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:06:18.280 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:06:35.011 INFO:teuthology.orchestra.run.smithi120.stdout:generic/127 535s 2024-03-31T17:06:35.016 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/127 2024-03-31T17:06:35.016 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:06:35.018 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:35.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:06:35.067 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-03-31T17:06:35.454 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:06:35.457 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:06:35.458 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:06:35.460 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:06:35.460 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:36.370 INFO:teuthology.orchestra.run.smithi120.stdout:generic/128 1s 2024-03-31T17:06:36.379 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/128 2024-03-31T17:06:36.379 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:06:36.383 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:36.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:06:36.397 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-03-31T17:06:36.621 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:06:36.625 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:06:36.625 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:06:36.626 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:06:36.626 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:36.844 INFO:teuthology.orchestra.run.smithi120.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-03-31T17:06:36.848 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/129 2024-03-31T17:06:36.848 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/129 2024-03-31T17:06:36.848 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:06:36.850 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:36.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:06:36.871 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-03-31T17:06:37.068 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:06:37.072 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:06:37.073 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:06:37.074 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:06:37.074 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:37.296 INFO:teuthology.orchestra.run.smithi120.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-03-31T17:06:37.299 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/130 2024-03-31T17:06:37.299 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/130 2024-03-31T17:06:37.299 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:06:37.301 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:37.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:06:37.325 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-03-31T17:06:37.516 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:06:37.520 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:06:37.521 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:06:37.522 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:06:37.522 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:38.881 INFO:teuthology.orchestra.run.smithi120.stdout:generic/131 1s 2024-03-31T17:06:38.886 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/131 2024-03-31T17:06:38.887 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:06:38.889 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:38.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:06:38.941 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-03-31T17:06:39.344 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:06:39.348 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:06:39.349 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:06:39.349 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:06:39.350 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:48.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:06:48.670 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:06:52.391 INFO:teuthology.orchestra.run.smithi120.stdout:generic/132 13s 2024-03-31T17:06:52.396 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/132 2024-03-31T17:06:52.396 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:06:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:06:52.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:06:52.408 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-03-31T17:06:52.592 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:06:52.596 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:06:52.596 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:06:52.597 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:06:52.597 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:07:18.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:07:18.735 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:07:48.909 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:07:48.912 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:08:19.064 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:08:19.067 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:08:49.127 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:08:49.130 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:09:19.216 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:09:19.219 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:09:49.395 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:09:49.399 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:10:19.484 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:10:19.487 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:10:26.447 INFO:teuthology.orchestra.run.smithi120.stdout:generic/133 214s 2024-03-31T17:10:26.452 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/133 2024-03-31T17:10:26.452 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:26.455 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:26.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:26.502 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-03-31T17:10:26.863 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:26.867 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:26.867 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:26.869 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:26.869 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:27.202 INFO:teuthology.orchestra.run.smithi120.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:27.206 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/134 2024-03-31T17:10:27.207 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/134 2024-03-31T17:10:27.207 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:27.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:27.274 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-03-31T17:10:27.642 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:27.647 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:27.649 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:27.649 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:28.531 INFO:teuthology.orchestra.run.smithi120.stdout:generic/135 1s 2024-03-31T17:10:28.621 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/135 2024-03-31T17:10:28.622 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:28.623 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:28.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:28.632 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-03-31T17:10:28.812 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:28.816 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:28.816 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:28.817 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:28.817 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:29.054 INFO:teuthology.orchestra.run.smithi120.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-31T17:10:29.058 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/136 2024-03-31T17:10:29.058 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/136 2024-03-31T17:10:29.058 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:29.060 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:29.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:29.123 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-03-31T17:10:29.518 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:29.522 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:29.522 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:29.523 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:29.523 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:29.769 INFO:teuthology.orchestra.run.smithi120.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:29.773 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/137 2024-03-31T17:10:29.774 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/137 2024-03-31T17:10:29.774 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:29.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:29.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:29.830 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-03-31T17:10:30.213 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:30.220 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:30.220 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:30.464 INFO:teuthology.orchestra.run.smithi120.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:30.468 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/138 2024-03-31T17:10:30.468 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/138 2024-03-31T17:10:30.468 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:30.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:30.531 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-03-31T17:10:30.893 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:30.899 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:30.900 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:30.900 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:31.150 INFO:teuthology.orchestra.run.smithi120.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:31.154 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/139 2024-03-31T17:10:31.154 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/139 2024-03-31T17:10:31.155 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:31.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:31.206 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-03-31T17:10:31.612 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:31.616 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:31.617 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:31.855 INFO:teuthology.orchestra.run.smithi120.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/140 2024-03-31T17:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/140 2024-03-31T17:10:31.860 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:31.862 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:31.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:31.921 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-03-31T17:10:32.311 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:32.315 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:32.316 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:32.669 INFO:teuthology.orchestra.run.smithi120.stdout:generic/141 0s 2024-03-31T17:10:32.675 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/141 2024-03-31T17:10:32.675 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:32.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:32.686 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-03-31T17:10:32.866 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:32.870 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:32.870 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:32.874 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:32.874 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:33.104 INFO:teuthology.orchestra.run.smithi120.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:33.107 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/142 2024-03-31T17:10:33.108 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/142 2024-03-31T17:10:33.108 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:33.110 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:33.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:33.157 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-03-31T17:10:33.549 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:33.554 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:33.555 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:33.556 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:33.795 INFO:teuthology.orchestra.run.smithi120.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:33.799 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/143 2024-03-31T17:10:33.800 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/143 2024-03-31T17:10:33.800 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:33.802 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:33.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:33.856 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-03-31T17:10:34.240 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:34.244 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:34.245 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:34.246 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:34.246 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:34.487 INFO:teuthology.orchestra.run.smithi120.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:34.491 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/144 2024-03-31T17:10:34.491 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/144 2024-03-31T17:10:34.491 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:34.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:34.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:34.542 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-03-31T17:10:34.925 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:34.931 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:34.931 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:34.932 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:35.171 INFO:teuthology.orchestra.run.smithi120.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:35.175 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/145 2024-03-31T17:10:35.175 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/145 2024-03-31T17:10:35.175 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:35.177 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:35.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:35.234 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-03-31T17:10:35.632 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:35.635 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:35.636 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:35.637 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:35.637 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:35.883 INFO:teuthology.orchestra.run.smithi120.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:35.887 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/146 2024-03-31T17:10:35.887 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/146 2024-03-31T17:10:35.887 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:35.889 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:35.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:35.940 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-03-31T17:10:36.346 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:36.349 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:36.350 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:36.351 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:36.351 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:36.595 INFO:teuthology.orchestra.run.smithi120.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:36.599 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/147 2024-03-31T17:10:36.599 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/147 2024-03-31T17:10:36.599 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:36.601 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:36.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:36.657 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-03-31T17:10:37.026 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:37.035 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:37.036 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:37.292 INFO:teuthology.orchestra.run.smithi120.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:37.296 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/148 2024-03-31T17:10:37.296 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/148 2024-03-31T17:10:37.296 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:37.298 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:37.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:37.358 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-03-31T17:10:37.746 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:37.750 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:37.750 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:37.751 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:37.752 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:37.996 INFO:teuthology.orchestra.run.smithi120.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:38.000 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/149 2024-03-31T17:10:38.000 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/149 2024-03-31T17:10:38.000 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:38.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:38.054 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-03-31T17:10:38.450 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:38.454 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:38.455 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:38.456 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:38.456 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:38.686 INFO:teuthology.orchestra.run.smithi120.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:38.690 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/150 2024-03-31T17:10:38.690 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/150 2024-03-31T17:10:38.690 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:38.693 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:38.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:38.742 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-03-31T17:10:39.125 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:39.131 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:39.132 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:39.133 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:39.133 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:39.376 INFO:teuthology.orchestra.run.smithi120.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:39.380 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/151 2024-03-31T17:10:39.380 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/151 2024-03-31T17:10:39.380 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:39.382 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:39.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:39.433 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-03-31T17:10:39.828 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:39.833 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:39.833 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:39.834 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:39.834 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:40.073 INFO:teuthology.orchestra.run.smithi120.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:40.077 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/152 2024-03-31T17:10:40.077 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/152 2024-03-31T17:10:40.077 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:40.079 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:40.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:40.127 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-03-31T17:10:40.531 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:40.536 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:40.537 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:40.538 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:40.538 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:40.776 INFO:teuthology.orchestra.run.smithi120.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:40.780 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/153 2024-03-31T17:10:40.780 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/153 2024-03-31T17:10:40.780 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:40.782 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:40.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:40.840 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-03-31T17:10:41.238 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:41.242 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:41.243 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:41.244 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:41.244 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:41.481 INFO:teuthology.orchestra.run.smithi120.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:41.485 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/154 2024-03-31T17:10:41.485 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/154 2024-03-31T17:10:41.485 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:41.487 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:41.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:41.539 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-03-31T17:10:41.922 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:41.926 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:41.926 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:41.927 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:41.927 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:42.182 INFO:teuthology.orchestra.run.smithi120.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:42.186 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/155 2024-03-31T17:10:42.186 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/155 2024-03-31T17:10:42.186 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:42.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:42.249 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-03-31T17:10:42.654 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:42.657 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:42.658 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:42.659 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:42.659 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:42.891 INFO:teuthology.orchestra.run.smithi120.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:42.895 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/156 2024-03-31T17:10:42.895 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/156 2024-03-31T17:10:42.895 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:42.897 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:42.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:42.956 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-03-31T17:10:43.323 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:43.329 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:43.329 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:43.331 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:43.584 INFO:teuthology.orchestra.run.smithi120.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:43.588 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/157 2024-03-31T17:10:43.588 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/157 2024-03-31T17:10:43.588 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:43.590 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:43.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:43.645 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-03-31T17:10:44.033 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:44.039 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:44.040 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:44.041 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:44.041 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:44.278 INFO:teuthology.orchestra.run.smithi120.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-31T17:10:44.282 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/158 2024-03-31T17:10:44.282 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/158 2024-03-31T17:10:44.282 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:44.285 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:44.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:44.340 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-03-31T17:10:44.708 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:44.715 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:44.716 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:44.717 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:44.717 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:44.966 INFO:teuthology.orchestra.run.smithi120.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-03-31T17:10:44.970 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/159 2024-03-31T17:10:44.970 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/159 2024-03-31T17:10:44.971 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:45.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:45.006 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-03-31T17:10:45.186 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:45.189 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:45.190 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:45.191 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:45.191 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:45.414 INFO:teuthology.orchestra.run.smithi120.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-03-31T17:10:45.417 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/160 2024-03-31T17:10:45.417 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/160 2024-03-31T17:10:45.418 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:45.420 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:45.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:45.437 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-03-31T17:10:45.613 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:45.617 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:45.617 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:45.618 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:45.618 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:45.952 INFO:teuthology.orchestra.run.smithi120.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:45.958 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/161 2024-03-31T17:10:45.958 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/161 2024-03-31T17:10:45.958 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:45.963 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:46.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:46.235 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-03-31T17:10:46.457 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:46.461 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:46.461 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:46.462 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:46.462 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:46.765 INFO:teuthology.orchestra.run.smithi120.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-31T17:10:46.810 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/162 2024-03-31T17:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/162 2024-03-31T17:10:46.811 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:47.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:47.051 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-03-31T17:10:47.303 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:47.307 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:47.308 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:47.309 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:47.618 INFO:teuthology.orchestra.run.smithi120.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-31T17:10:47.669 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/163 2024-03-31T17:10:47.670 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/163 2024-03-31T17:10:47.670 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:47.672 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:47.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:47.928 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-03-31T17:10:48.168 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:48.172 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:48.172 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:48.174 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:48.174 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:48.519 INFO:teuthology.orchestra.run.smithi120.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:48.524 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/164 2024-03-31T17:10:48.524 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/164 2024-03-31T17:10:48.525 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:48.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:48.738 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-03-31T17:10:48.997 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:49.001 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:49.002 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:49.003 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:49.003 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:49.360 INFO:teuthology.orchestra.run.smithi120.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:49.367 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/165 2024-03-31T17:10:49.367 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/165 2024-03-31T17:10:49.367 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:49.374 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:49.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:49.550 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-03-31T17:10:49.582 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:10:49.597 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:10:49.825 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:49.829 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:49.829 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:49.830 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:49.830 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:50.175 INFO:teuthology.orchestra.run.smithi120.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:50.180 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/166 2024-03-31T17:10:50.180 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/166 2024-03-31T17:10:50.181 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:50.185 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:50.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:50.381 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-03-31T17:10:50.646 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:50.649 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:50.650 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:50.650 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:50.650 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:51.016 INFO:teuthology.orchestra.run.smithi120.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:51.023 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/167 2024-03-31T17:10:51.023 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/167 2024-03-31T17:10:51.023 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:51.027 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:51.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:51.248 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-03-31T17:10:51.492 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:51.495 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:51.496 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:51.497 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:51.497 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:51.840 INFO:teuthology.orchestra.run.smithi120.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/168 2024-03-31T17:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/168 2024-03-31T17:10:51.848 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:51.850 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:52.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:52.073 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-03-31T17:10:52.340 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:52.344 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:52.345 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:52.346 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:52.346 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:52.776 INFO:teuthology.orchestra.run.smithi120.stdout:generic/169 0s 2024-03-31T17:10:52.782 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/169 2024-03-31T17:10:52.782 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:52.784 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:52.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:52.793 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-03-31T17:10:52.968 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:52.972 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:52.972 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:52.973 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:53.347 INFO:teuthology.orchestra.run.smithi120.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:53.356 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/170 2024-03-31T17:10:53.356 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/170 2024-03-31T17:10:53.356 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:53.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:53.543 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-03-31T17:10:53.815 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:53.819 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:53.820 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:53.821 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:53.821 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:54.184 INFO:teuthology.orchestra.run.smithi120.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:54.191 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/171 2024-03-31T17:10:54.191 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/171 2024-03-31T17:10:54.191 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:54.194 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:54.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:54.330 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-03-31T17:10:54.641 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:54.644 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:54.645 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:54.646 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:55.019 INFO:teuthology.orchestra.run.smithi120.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/172 2024-03-31T17:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/172 2024-03-31T17:10:55.028 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:55.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:55.171 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-03-31T17:10:55.444 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:55.448 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:55.448 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:55.449 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:55.449 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:55.807 INFO:teuthology.orchestra.run.smithi120.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:55.812 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/173 2024-03-31T17:10:55.812 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/173 2024-03-31T17:10:55.812 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:55.817 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:55.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:55.999 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-03-31T17:10:56.286 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:56.290 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:56.290 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:56.291 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:56.291 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:56.654 INFO:teuthology.orchestra.run.smithi120.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:56.659 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/174 2024-03-31T17:10:56.659 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/174 2024-03-31T17:10:56.659 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:56.663 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:56.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:56.863 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-03-31T17:10:57.128 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:57.132 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:57.132 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:57.133 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:57.133 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:57.489 INFO:teuthology.orchestra.run.smithi120.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:57.496 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/175 2024-03-31T17:10:57.496 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/175 2024-03-31T17:10:57.496 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:57.498 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:57.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:57.706 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-03-31T17:10:57.961 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:57.965 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:57.965 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:57.966 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:58.337 INFO:teuthology.orchestra.run.smithi120.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:10:58.346 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/176 2024-03-31T17:10:58.346 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/176 2024-03-31T17:10:58.346 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:58.350 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:58.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:58.528 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-03-31T17:10:58.812 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:58.815 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:58.816 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:58.817 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:58.817 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:59.169 INFO:teuthology.orchestra.run.smithi120.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-31T17:10:59.173 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/177 2024-03-31T17:10:59.173 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/177 2024-03-31T17:10:59.173 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:59.175 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:59.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:59.235 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-03-31T17:10:59.615 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:10:59.622 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:10:59.623 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:10:59.624 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:10:59.624 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:59.873 INFO:teuthology.orchestra.run.smithi120.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:10:59.875 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/178 2024-03-31T17:10:59.876 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/178 2024-03-31T17:10:59.876 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:10:59.878 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:10:59.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:10:59.937 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-03-31T17:11:00.313 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:00.328 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:00.329 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:00.332 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:00.332 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:00.576 INFO:teuthology.orchestra.run.smithi120.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:11:00.580 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/179 2024-03-31T17:11:00.580 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/179 2024-03-31T17:11:00.580 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:00.582 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:00.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:00.633 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-03-31T17:11:01.036 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:01.040 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:01.041 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:01.042 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:01.287 INFO:teuthology.orchestra.run.smithi120.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:11:01.291 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/180 2024-03-31T17:11:01.291 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/180 2024-03-31T17:11:01.291 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:01.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:01.365 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-03-31T17:11:01.772 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:01.776 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:01.776 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:01.777 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:01.777 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:02.013 INFO:teuthology.orchestra.run.smithi120.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/181 2024-03-31T17:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/181 2024-03-31T17:11:02.017 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:02.020 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:02.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:02.069 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-03-31T17:11:02.461 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:02.465 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:02.466 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:02.467 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:02.467 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:02.725 INFO:teuthology.orchestra.run.smithi120.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-31T17:11:02.729 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/182 2024-03-31T17:11:02.729 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/182 2024-03-31T17:11:02.729 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:02.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:02.781 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-03-31T17:11:03.208 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:03.212 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:03.213 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:03.214 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:03.214 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:03.575 INFO:teuthology.orchestra.run.smithi120.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:03.590 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/183 2024-03-31T17:11:03.590 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/183 2024-03-31T17:11:03.590 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:03.596 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:03.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:03.796 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-03-31T17:11:04.054 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:04.058 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:04.058 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:04.059 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:04.059 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:04.301 INFO:teuthology.orchestra.run.smithi120.stdout:generic/184 0s 2024-03-31T17:11:04.306 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/184 2024-03-31T17:11:04.306 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:04.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:04.325 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-03-31T17:11:04.513 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:04.518 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:04.518 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:04.519 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:04.519 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:04.844 INFO:teuthology.orchestra.run.smithi120.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/185 2024-03-31T17:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/185 2024-03-31T17:11:04.849 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:04.854 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:05.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:05.092 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-03-31T17:11:05.348 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:05.352 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:05.353 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:05.353 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:05.353 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:05.711 INFO:teuthology.orchestra.run.smithi120.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:05.717 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/186 2024-03-31T17:11:05.717 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/186 2024-03-31T17:11:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:05.719 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:05.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:05.881 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-03-31T17:11:06.177 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:06.181 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:06.181 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:06.182 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:06.182 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:06.520 INFO:teuthology.orchestra.run.smithi120.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:06.526 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/187 2024-03-31T17:11:06.527 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/187 2024-03-31T17:11:06.527 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:06.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:06.736 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-03-31T17:11:07.005 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:07.009 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:07.009 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:07.010 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:07.010 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:07.373 INFO:teuthology.orchestra.run.smithi120.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/188 2024-03-31T17:11:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/188 2024-03-31T17:11:07.380 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:07.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:07.636 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-03-31T17:11:07.865 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:07.869 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:07.869 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:07.870 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:07.870 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:08.223 INFO:teuthology.orchestra.run.smithi120.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:08.229 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/189 2024-03-31T17:11:08.229 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/189 2024-03-31T17:11:08.229 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:08.234 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:08.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:08.386 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-03-31T17:11:08.688 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:08.691 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:08.692 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:08.693 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:08.693 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:09.051 INFO:teuthology.orchestra.run.smithi120.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:09.058 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/190 2024-03-31T17:11:09.058 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/190 2024-03-31T17:11:09.058 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:09.060 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:09.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:09.197 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-03-31T17:11:09.508 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:09.511 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:09.512 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:09.513 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:09.513 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:09.871 INFO:teuthology.orchestra.run.smithi120.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:09.878 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/191 2024-03-31T17:11:09.878 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/191 2024-03-31T17:11:09.878 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:10.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:10.064 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-03-31T17:11:10.352 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:10.355 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:10.356 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:10.357 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:10.583 INFO:teuthology.orchestra.run.smithi120.stdout:generic/192 [not run] atime not maintained by ceph 2024-03-31T17:11:10.587 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/192 2024-03-31T17:11:10.587 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/192 2024-03-31T17:11:10.587 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:10.590 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:10.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:10.603 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-03-31T17:11:10.785 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:10.789 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:10.789 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:10.790 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:10.790 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:11.749 INFO:teuthology.orchestra.run.smithi120.stdout:generic/193 1s 2024-03-31T17:11:11.754 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/193 2024-03-31T17:11:11.754 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:11.756 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:11.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:11.836 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-03-31T17:11:12.220 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:12.226 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:12.227 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:12.228 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:12.592 INFO:teuthology.orchestra.run.smithi120.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:12.598 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/194 2024-03-31T17:11:12.598 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/194 2024-03-31T17:11:12.598 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:12.601 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:12.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:12.862 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-03-31T17:11:13.094 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:13.098 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:13.098 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:13.099 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:13.099 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:13.479 INFO:teuthology.orchestra.run.smithi120.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:13.485 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/195 2024-03-31T17:11:13.485 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/195 2024-03-31T17:11:13.486 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:13.487 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:13.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:13.705 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-03-31T17:11:13.956 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:13.960 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:13.961 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:13.962 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:14.316 INFO:teuthology.orchestra.run.smithi120.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/196 2024-03-31T17:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/196 2024-03-31T17:11:14.322 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:14.325 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:14.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:14.579 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-03-31T17:11:14.819 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:14.823 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:15.184 INFO:teuthology.orchestra.run.smithi120.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:15.196 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/197 2024-03-31T17:11:15.196 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/197 2024-03-31T17:11:15.197 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:15.198 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:15.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:15.396 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-03-31T17:11:15.664 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:15.668 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:15.668 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:15.669 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:15.669 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:16.298 INFO:teuthology.orchestra.run.smithi120.stdout:generic/198 1s 2024-03-31T17:11:16.303 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/198 2024-03-31T17:11:16.303 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:16.306 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:16.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:16.348 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-03-31T17:11:16.745 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:16.750 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:16.750 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:16.752 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:16.752 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:17.114 INFO:teuthology.orchestra.run.smithi120.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:17.120 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/199 2024-03-31T17:11:17.121 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/199 2024-03-31T17:11:17.121 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:17.128 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:17.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:17.341 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-03-31T17:11:17.636 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:17.639 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:17.640 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:17.641 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:18.017 INFO:teuthology.orchestra.run.smithi120.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:18.028 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/200 2024-03-31T17:11:18.028 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/200 2024-03-31T17:11:18.028 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:18.030 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:18.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:18.232 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-03-31T17:11:18.504 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:18.508 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:18.508 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:18.509 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:18.509 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:18.861 INFO:teuthology.orchestra.run.smithi120.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:18.866 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/201 2024-03-31T17:11:18.867 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/201 2024-03-31T17:11:18.867 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:19.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:19.083 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-03-31T17:11:19.367 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:19.371 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:19.371 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:19.372 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:19.372 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:19.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:11:19.709 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:11:19.741 INFO:teuthology.orchestra.run.smithi120.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:19.746 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/202 2024-03-31T17:11:19.747 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/202 2024-03-31T17:11:19.747 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:19.750 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:19.789 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T17:11:19.786+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 242044) UID: 0 2024-03-31T17:11:19.790 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T17:11:19.786+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 242044) UID: 0 2024-03-31T17:11:19.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:19.981 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-03-31T17:11:20.337 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:20.340 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:20.341 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:20.342 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:20.727 INFO:teuthology.orchestra.run.smithi120.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:20.733 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/203 2024-03-31T17:11:20.734 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/203 2024-03-31T17:11:20.734 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:20.736 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:20.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:20.896 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-03-31T17:11:21.249 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:21.252 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:21.253 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:21.254 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:21.254 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:23.304 INFO:teuthology.orchestra.run.smithi120.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:11:23.308 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/204 2024-03-31T17:11:23.308 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/204 2024-03-31T17:11:23.308 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:23.310 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:23.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:23.332 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-03-31T17:11:23.516 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:23.519 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:23.520 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:23.521 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:23.521 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:23.863 INFO:teuthology.orchestra.run.smithi120.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:23.870 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/205 2024-03-31T17:11:23.870 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/205 2024-03-31T17:11:23.870 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:23.872 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:24.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:24.091 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-03-31T17:11:24.393 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:24.397 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:24.397 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:24.398 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:24.398 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:24.750 INFO:teuthology.orchestra.run.smithi120.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/206 2024-03-31T17:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/206 2024-03-31T17:11:24.757 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:24.759 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:24.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:24.957 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-03-31T17:11:25.277 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:25.281 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:25.281 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:25.282 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:33.866 INFO:teuthology.orchestra.run.smithi120.stdout:generic/207 8s 2024-03-31T17:11:33.871 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/207 2024-03-31T17:11:33.872 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:11:33.874 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:11:33.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:11:33.916 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-03-31T17:11:34.355 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:11:34.362 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:11:34.363 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:11:34.364 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:11:34.364 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:14:10.336 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:14:10.340 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:14:40.441 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:14:40.444 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:14:54.913 INFO:teuthology.orchestra.run.smithi120.stdout:generic/208 200s 2024-03-31T17:14:54.919 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/208 2024-03-31T17:14:54.919 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:14:54.921 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:14:54.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:14:54.968 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-03-31T17:14:55.357 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:14:55.362 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:14:55.362 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:14:55.364 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:14:55.364 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:10.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:15:10.770 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:15:30.395 INFO:teuthology.orchestra.run.smithi120.stdout:generic/209 35s 2024-03-31T17:15:30.400 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/209 2024-03-31T17:15:30.400 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:30.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:30.446 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-03-31T17:15:30.850 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:30.855 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:30.856 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:30.857 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:31.188 INFO:teuthology.orchestra.run.smithi120.stdout:generic/210 1s 2024-03-31T17:15:31.194 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/210 2024-03-31T17:15:31.194 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:31.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:31.238 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-03-31T17:15:31.633 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:31.637 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:31.637 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:31.638 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:32.042 INFO:teuthology.orchestra.run.smithi120.stdout:generic/211 1s 2024-03-31T17:15:32.048 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/211 2024-03-31T17:15:32.048 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:32.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:32.068 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-03-31T17:15:32.258 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:32.262 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:32.263 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:32.264 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:32.264 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:32.566 INFO:teuthology.orchestra.run.smithi120.stdout:generic/212 0s 2024-03-31T17:15:32.571 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/212 2024-03-31T17:15:32.571 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:32.574 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:32.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:32.591 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-03-31T17:15:32.778 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:32.782 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:32.783 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:32.784 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:33.022 INFO:teuthology.orchestra.run.smithi120.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:15:33.026 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/213 2024-03-31T17:15:33.026 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/213 2024-03-31T17:15:33.026 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:33.028 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:33.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:33.042 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-03-31T17:15:33.226 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:33.230 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:33.230 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:33.232 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:33.232 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:33.452 INFO:teuthology.orchestra.run.smithi120.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:15:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/214 2024-03-31T17:15:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/214 2024-03-31T17:15:33.456 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:33.458 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:33.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:33.471 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-03-31T17:15:33.661 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:33.665 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:33.665 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:33.666 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:35.918 INFO:teuthology.orchestra.run.smithi120.stdout:generic/215 2s 2024-03-31T17:15:35.923 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/215 2024-03-31T17:15:35.923 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:35.925 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:35.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:35.959 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-03-31T17:15:36.140 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:36.145 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:36.145 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:36.146 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:36.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:36.506 INFO:teuthology.orchestra.run.smithi120.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:15:36.513 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/216 2024-03-31T17:15:36.513 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/216 2024-03-31T17:15:36.513 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:36.515 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:36.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:36.663 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-03-31T17:15:36.963 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:36.967 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:36.967 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:36.968 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:37.307 INFO:teuthology.orchestra.run.smithi120.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:15:37.314 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/217 2024-03-31T17:15:37.314 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/217 2024-03-31T17:15:37.314 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:37.316 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:37.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:37.559 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-03-31T17:15:37.812 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:37.815 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:37.816 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:37.817 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:37.817 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:38.186 INFO:teuthology.orchestra.run.smithi120.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:15:38.193 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/218 2024-03-31T17:15:38.193 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/218 2024-03-31T17:15:38.193 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:38.195 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:38.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:38.370 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-03-31T17:15:38.649 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:38.652 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:38.653 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:38.654 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:38.654 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:38.876 INFO:teuthology.orchestra.run.smithi120.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:15:38.879 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/219 2024-03-31T17:15:38.880 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/219 2024-03-31T17:15:38.880 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:38.882 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:38.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:38.895 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-03-31T17:15:39.084 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:39.088 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:39.089 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:39.090 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:39.091 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:39.445 INFO:teuthology.orchestra.run.smithi120.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:15:39.451 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/220 2024-03-31T17:15:39.451 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/220 2024-03-31T17:15:39.451 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:39.457 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:39.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:39.687 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-03-31T17:15:39.934 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:39.938 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:39.939 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:39.940 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:40.823 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:15:40.825 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:15:41.174 INFO:teuthology.orchestra.run.smithi120.stdout:generic/221 1s 2024-03-31T17:15:41.179 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/221 2024-03-31T17:15:41.179 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:41.181 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:41.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:41.201 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-03-31T17:15:41.428 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:41.432 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:41.432 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:41.433 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:41.433 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:41.778 INFO:teuthology.orchestra.run.smithi120.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:15:41.785 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/222 2024-03-31T17:15:41.785 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/222 2024-03-31T17:15:41.785 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:41.787 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:41.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:41.995 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-03-31T17:15:42.277 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:42.280 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:42.281 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:42.282 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:42.282 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:42.507 INFO:teuthology.orchestra.run.smithi120.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:15:42.511 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/223 2024-03-31T17:15:42.512 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/223 2024-03-31T17:15:42.512 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:42.514 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:42.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:42.531 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-03-31T17:15:42.711 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:42.714 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:42.715 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:42.716 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:42.716 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:42.925 INFO:teuthology.orchestra.run.smithi120.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:15:42.929 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/224 2024-03-31T17:15:42.929 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/224 2024-03-31T17:15:42.929 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:42.932 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:42.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:42.945 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-03-31T17:15:43.132 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:43.136 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:43.136 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:43.138 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:43.138 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:43.399 INFO:teuthology.orchestra.run.smithi120.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-31T17:15:43.403 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/225 2024-03-31T17:15:43.404 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/225 2024-03-31T17:15:43.404 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:43.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:43.459 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-03-31T17:15:43.866 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:43.870 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:43.871 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:43.872 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:43.872 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:44.111 INFO:teuthology.orchestra.run.smithi120.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:15:44.115 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/226 2024-03-31T17:15:44.115 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/226 2024-03-31T17:15:44.115 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:44.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:44.134 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-03-31T17:15:44.321 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:44.325 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:44.325 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:44.326 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:44.326 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:44.680 INFO:teuthology.orchestra.run.smithi120.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:15:44.683 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/227 2024-03-31T17:15:44.685 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/227 2024-03-31T17:15:44.685 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:44.690 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:44.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:44.872 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-03-31T17:15:45.143 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:45.147 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:45.147 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:45.148 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:45.148 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:45.381 INFO:teuthology.orchestra.run.smithi120.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:15:45.385 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/228 2024-03-31T17:15:45.386 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/228 2024-03-31T17:15:45.386 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:45.388 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:45.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:45.401 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-03-31T17:15:45.575 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:45.578 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:45.579 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:45.580 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:45.580 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:45.923 INFO:teuthology.orchestra.run.smithi120.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:15:45.931 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/229 2024-03-31T17:15:45.931 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/229 2024-03-31T17:15:45.931 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:45.933 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:46.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:46.146 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-03-31T17:15:46.404 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:46.408 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:46.409 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:46.410 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:46.410 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:46.629 INFO:teuthology.orchestra.run.smithi120.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:15:46.632 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/230 2024-03-31T17:15:46.633 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/230 2024-03-31T17:15:46.633 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:46.635 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:46.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:46.647 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-03-31T17:15:46.836 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:46.839 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:46.840 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:46.841 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:47.051 INFO:teuthology.orchestra.run.smithi120.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:15:47.055 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/231 2024-03-31T17:15:47.055 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/231 2024-03-31T17:15:47.055 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:47.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:47.072 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-03-31T17:15:47.263 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:47.266 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:47.267 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:47.268 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:47.268 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:47.479 INFO:teuthology.orchestra.run.smithi120.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:15:47.483 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/232 2024-03-31T17:15:47.483 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/232 2024-03-31T17:15:47.483 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:47.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:47.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:47.498 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-03-31T17:15:47.681 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:47.685 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:47.685 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:47.686 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:47.686 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:47.901 INFO:teuthology.orchestra.run.smithi120.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:15:47.906 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/233 2024-03-31T17:15:47.906 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/233 2024-03-31T17:15:47.906 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:47.908 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:47.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:47.932 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-03-31T17:15:48.128 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:48.132 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:48.132 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:48.133 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:48.133 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:48.352 INFO:teuthology.orchestra.run.smithi120.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:15:48.355 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/234 2024-03-31T17:15:48.356 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/234 2024-03-31T17:15:48.356 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:48.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:48.371 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-03-31T17:15:48.552 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:48.555 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:48.556 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:48.557 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:48.557 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:48.762 INFO:teuthology.orchestra.run.smithi120.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:15:48.766 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/235 2024-03-31T17:15:48.767 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/235 2024-03-31T17:15:48.767 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:48.769 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:48.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:48.783 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-03-31T17:15:48.967 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:48.971 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:48.971 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:48.972 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:48.973 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:50.255 INFO:teuthology.orchestra.run.smithi120.stdout:generic/236 1s 2024-03-31T17:15:50.261 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/236 2024-03-31T17:15:50.261 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:50.263 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:50.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:50.319 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-03-31T17:15:50.695 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:50.699 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:50.699 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:50.700 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:50.700 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:51.006 INFO:teuthology.orchestra.run.smithi120.stdout:generic/237 1s 2024-03-31T17:15:51.012 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/237 2024-03-31T17:15:51.012 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:51.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:51.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:51.066 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-03-31T17:15:51.486 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:51.490 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:51.490 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:51.491 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:51.491 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:51.826 INFO:teuthology.orchestra.run.smithi120.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:15:51.833 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/238 2024-03-31T17:15:51.833 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/238 2024-03-31T17:15:51.833 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:52.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:52.089 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-03-31T17:15:52.329 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:52.333 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:52.334 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:52.335 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:52.335 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:52.565 INFO:teuthology.orchestra.run.smithi120.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-03-31T17:15:52.569 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/239 2024-03-31T17:15:52.569 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/239 2024-03-31T17:15:52.569 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:52.571 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:52.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:52.594 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-03-31T17:15:52.774 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:52.777 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:52.778 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:52.779 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:52.779 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:53.002 INFO:teuthology.orchestra.run.smithi120.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-03-31T17:15:53.005 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/240 2024-03-31T17:15:53.006 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/240 2024-03-31T17:15:53.006 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:15:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:15:53.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:15:53.032 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-03-31T17:15:53.212 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:15:53.216 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:15:53.217 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:15:53.218 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:15:53.218 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:16:11.177 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:16:11.180 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:16:41.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:16:41.727 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:17:06.817 INFO:teuthology.orchestra.run.smithi120.stdout:generic/241 73s 2024-03-31T17:17:06.828 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/241 2024-03-31T17:17:06.829 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:06.830 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:07.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:07.261 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-03-31T17:17:07.650 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:07.656 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:07.657 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:07.658 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:07.658 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:08.415 INFO:teuthology.orchestra.run.smithi120.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:17:08.422 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/242 2024-03-31T17:17:08.423 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/242 2024-03-31T17:17:08.423 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:08.425 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:08.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:08.712 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-03-31T17:17:08.940 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:08.944 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:08.944 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:08.945 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:08.945 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:09.289 INFO:teuthology.orchestra.run.smithi120.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:17:09.302 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/243 2024-03-31T17:17:09.302 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/243 2024-03-31T17:17:09.302 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:09.308 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:09.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:09.588 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-03-31T17:17:09.796 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:09.800 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:09.801 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:09.802 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:10.006 INFO:teuthology.orchestra.run.smithi120.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:17:10.010 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/244 2024-03-31T17:17:10.010 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/244 2024-03-31T17:17:10.010 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:10.012 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:10.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:10.024 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-03-31T17:17:10.206 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:10.210 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:10.210 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:10.211 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:10.211 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:10.498 INFO:teuthology.orchestra.run.smithi120.stdout:generic/245 0s 2024-03-31T17:17:10.504 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/245 2024-03-31T17:17:10.504 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:10.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:10.547 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-03-31T17:17:10.939 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:10.945 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:10.945 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:10.946 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:10.947 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:11.214 INFO:teuthology.orchestra.run.smithi120.stdout:generic/246 0s 2024-03-31T17:17:11.220 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/246 2024-03-31T17:17:11.220 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:11.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:11.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:11.282 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-03-31T17:17:11.649 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:11.655 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:11.655 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:11.657 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:11.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:17:11.782 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:17:18.080 INFO:teuthology.orchestra.run.smithi120.stdout:generic/247 7s 2024-03-31T17:17:18.085 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/247 2024-03-31T17:17:18.085 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:18.088 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:18.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:18.096 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-03-31T17:17:18.268 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:18.272 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:18.272 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:18.273 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:18.527 INFO:teuthology.orchestra.run.smithi120.stdout:generic/248 0s 2024-03-31T17:17:18.532 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/248 2024-03-31T17:17:18.532 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:18.535 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:18.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:18.556 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-03-31T17:17:18.734 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:18.738 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:18.738 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:18.739 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:18.739 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:19.137 INFO:teuthology.orchestra.run.smithi120.stdout:generic/249 1s 2024-03-31T17:17:19.143 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/249 2024-03-31T17:17:19.143 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:19.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:19.198 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-03-31T17:17:19.584 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:19.588 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:19.588 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:19.590 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:19.590 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:19.861 INFO:teuthology.orchestra.run.smithi120.stdout:generic/250 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:17:19.864 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/250 2024-03-31T17:17:19.865 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/250 2024-03-31T17:17:19.865 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:19.867 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:19.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:19.879 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-03-31T17:17:20.052 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:20.056 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:20.056 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:20.057 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:20.057 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:20.348 INFO:teuthology.orchestra.run.smithi120.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:20.355 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/251 2024-03-31T17:17:20.355 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/251 2024-03-31T17:17:20.355 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:20.357 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:20.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:20.369 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-03-31T17:17:20.541 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:20.545 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:20.545 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:20.546 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:20.546 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:20.769 INFO:teuthology.orchestra.run.smithi120.stdout:generic/252 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:17:20.772 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/252 2024-03-31T17:17:20.772 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/252 2024-03-31T17:17:20.772 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:20.775 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:20.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:20.786 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-03-31T17:17:20.971 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:20.974 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:20.976 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:21.326 INFO:teuthology.orchestra.run.smithi120.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:17:21.331 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/253 2024-03-31T17:17:21.332 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/253 2024-03-31T17:17:21.332 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:21.335 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:21.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:21.599 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-03-31T17:17:21.820 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:21.823 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:21.824 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:21.825 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:22.177 INFO:teuthology.orchestra.run.smithi120.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:17:22.183 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/254 2024-03-31T17:17:22.183 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/254 2024-03-31T17:17:22.183 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:22.187 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:22.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:22.450 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-03-31T17:17:22.669 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:22.673 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:22.673 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:22.674 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:22.675 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:22.997 INFO:teuthology.orchestra.run.smithi120.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:17:23.001 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/255 2024-03-31T17:17:23.001 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/255 2024-03-31T17:17:23.001 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:23.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:23.045 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-03-31T17:17:23.456 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:23.460 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:23.460 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:23.461 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:23.461 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:23.968 INFO:teuthology.orchestra.run.smithi120.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:17:23.972 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/256 2024-03-31T17:17:23.972 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/256 2024-03-31T17:17:23.972 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:23.974 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:23.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:23.991 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-03-31T17:17:24.179 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:24.183 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:24.183 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:24.184 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:25.056 INFO:teuthology.orchestra.run.smithi120.stdout:generic/257 1s 2024-03-31T17:17:25.062 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/257 2024-03-31T17:17:25.062 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:25.064 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:25.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:25.124 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-03-31T17:17:25.503 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:25.508 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:25.509 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:25.510 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:25.510 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:25.802 INFO:teuthology.orchestra.run.smithi120.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-03-31T17:17:25.811 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/258 2024-03-31T17:17:25.811 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/258 2024-03-31T17:17:25.811 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:25.817 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:25.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:25.832 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-03-31T17:17:26.009 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:26.013 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:26.013 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:26.014 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:26.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:26.354 INFO:teuthology.orchestra.run.smithi120.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:17:26.362 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/259 2024-03-31T17:17:26.362 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/259 2024-03-31T17:17:26.362 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:26.364 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:26.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:26.632 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-03-31T17:17:26.847 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:26.851 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:26.851 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:26.852 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:26.852 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:27.120 INFO:teuthology.orchestra.run.smithi120.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:27.127 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/260 2024-03-31T17:17:27.127 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/260 2024-03-31T17:17:27.127 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:27.129 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:27.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:27.140 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-03-31T17:17:27.320 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:27.324 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:27.325 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:27.326 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:27.326 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:27.676 INFO:teuthology.orchestra.run.smithi120.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:17:27.683 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/261 2024-03-31T17:17:27.683 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/261 2024-03-31T17:17:27.683 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:27.686 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:27.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:27.936 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-03-31T17:17:28.180 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:28.184 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:28.184 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:28.185 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:28.185 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:28.513 INFO:teuthology.orchestra.run.smithi120.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:17:28.520 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/262 2024-03-31T17:17:28.520 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/262 2024-03-31T17:17:28.520 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:17:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:28.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:17:28.811 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-03-31T17:17:29.023 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:17:29.027 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:17:29.028 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:17:29.028 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:17:29.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:17:41.835 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:17:41.838 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:18:10.215 INFO:teuthology.orchestra.run.smithi120.stdout:generic/263 41s 2024-03-31T17:18:10.220 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/263 2024-03-31T17:18:10.220 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:10.222 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:10.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:10.271 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-03-31T17:18:10.665 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:10.672 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:10.672 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:10.673 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:11.083 INFO:teuthology.orchestra.run.smithi120.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:11.089 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/264 2024-03-31T17:18:11.089 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/264 2024-03-31T17:18:11.089 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:11.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:11.337 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-03-31T17:18:11.550 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:11.554 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:11.554 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:11.555 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:11.555 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:11.947 INFO:teuthology.orchestra.run.smithi120.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:11.953 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/265 2024-03-31T17:18:11.954 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/265 2024-03-31T17:18:11.954 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:11.974 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:18:11.977 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:18:12.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:12.097 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-03-31T17:18:12.406 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:12.410 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:12.410 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:12.411 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:12.411 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:12.789 INFO:teuthology.orchestra.run.smithi120.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:12.796 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/266 2024-03-31T17:18:12.796 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/266 2024-03-31T17:18:12.796 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:12.798 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:13.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:13.018 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-03-31T17:18:13.272 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:13.276 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:13.276 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:13.277 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:13.277 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:13.638 INFO:teuthology.orchestra.run.smithi120.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:13.645 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/267 2024-03-31T17:18:13.645 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/267 2024-03-31T17:18:13.645 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:13.647 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:13.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:13.861 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-03-31T17:18:14.130 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:14.669 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:14.670 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:14.670 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:14.670 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:14.670 INFO:teuthology.orchestra.run.smithi120.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:14.671 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/268 2024-03-31T17:18:14.671 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/268 2024-03-31T17:18:14.671 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:14.671 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:14.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:14.691 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-03-31T17:18:14.974 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:14.978 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:14.978 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:14.979 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:14.979 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:15.196 INFO:teuthology.orchestra.run.smithi120.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:18:15.200 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/269 2024-03-31T17:18:15.200 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/269 2024-03-31T17:18:15.200 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:15.202 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:15.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:15.216 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-03-31T17:18:15.405 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:15.409 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:15.409 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:15.410 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:15.410 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:15.642 INFO:teuthology.orchestra.run.smithi120.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:18:15.642 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/270 2024-03-31T17:18:15.642 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/270 2024-03-31T17:18:15.642 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:15.645 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:15.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:15.659 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-03-31T17:18:15.840 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:15.844 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:15.844 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:15.845 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:15.845 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:16.241 INFO:teuthology.orchestra.run.smithi120.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:16.248 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/271 2024-03-31T17:18:16.248 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/271 2024-03-31T17:18:16.249 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:16.251 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:16.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:16.427 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-03-31T17:18:16.683 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:16.687 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:16.687 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:16.689 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:17.076 INFO:teuthology.orchestra.run.smithi120.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:17.082 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/272 2024-03-31T17:18:17.082 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/272 2024-03-31T17:18:17.082 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:17.085 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:17.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:17.266 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-03-31T17:18:17.538 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:17.541 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:17.541 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:17.542 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:17.543 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:17.761 INFO:teuthology.orchestra.run.smithi120.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:18:17.765 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/273 2024-03-31T17:18:17.766 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/273 2024-03-31T17:18:17.766 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:17.768 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:17.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:17.786 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-03-31T17:18:17.971 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:17.975 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:17.975 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:17.976 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:17.977 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:18.193 INFO:teuthology.orchestra.run.smithi120.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-31T17:18:18.197 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/274 2024-03-31T17:18:18.198 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/274 2024-03-31T17:18:18.198 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:18.200 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:18.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:18.218 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-03-31T17:18:18.409 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:18.413 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:18.414 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:18.415 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:18.415 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:18.634 INFO:teuthology.orchestra.run.smithi120.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:18:18.638 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/275 2024-03-31T17:18:18.638 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/275 2024-03-31T17:18:18.638 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:18.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:18.654 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-03-31T17:18:18.830 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:18.834 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:18.834 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:18.835 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:19.214 INFO:teuthology.orchestra.run.smithi120.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:19.221 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/276 2024-03-31T17:18:19.222 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/276 2024-03-31T17:18:19.222 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:19.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:19.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:19.453 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-03-31T17:18:19.680 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:19.683 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:19.684 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:19.685 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:19.685 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:19.917 INFO:teuthology.orchestra.run.smithi120.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-03-31T17:18:19.921 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/277 2024-03-31T17:18:19.922 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/277 2024-03-31T17:18:19.922 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:19.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:19.943 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-03-31T17:18:20.122 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:20.125 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:20.126 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:20.127 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:20.127 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:20.491 INFO:teuthology.orchestra.run.smithi120.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:20.498 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/278 2024-03-31T17:18:20.499 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/278 2024-03-31T17:18:20.499 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:20.501 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:20.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:20.721 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-03-31T17:18:20.975 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:20.979 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:20.979 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:20.980 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:20.980 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:21.369 INFO:teuthology.orchestra.run.smithi120.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:21.376 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/279 2024-03-31T17:18:21.376 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/279 2024-03-31T17:18:21.376 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:21.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:21.598 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-03-31T17:18:21.857 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:21.861 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:21.861 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:21.862 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:22.097 INFO:teuthology.orchestra.run.smithi120.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:18:22.101 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/280 2024-03-31T17:18:22.102 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/280 2024-03-31T17:18:22.102 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:22.103 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:22.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:22.116 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-03-31T17:18:22.303 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:22.307 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:22.308 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:22.309 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:22.309 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:22.680 INFO:teuthology.orchestra.run.smithi120.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:22.687 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/281 2024-03-31T17:18:22.687 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/281 2024-03-31T17:18:22.687 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:22.689 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:22.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:22.847 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-03-31T17:18:23.135 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:23.138 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:23.139 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:23.140 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:23.140 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:23.522 INFO:teuthology.orchestra.run.smithi120.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:23.529 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/282 2024-03-31T17:18:23.529 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/282 2024-03-31T17:18:23.529 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:23.533 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:23.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:23.736 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-03-31T17:18:23.988 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:23.991 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:23.992 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:23.993 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:23.993 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:24.359 INFO:teuthology.orchestra.run.smithi120.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:24.366 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/283 2024-03-31T17:18:24.366 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/283 2024-03-31T17:18:24.366 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:24.376 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:24.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:24.612 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-03-31T17:18:24.852 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:24.855 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:24.856 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:24.856 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:24.856 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:25.227 INFO:teuthology.orchestra.run.smithi120.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:25.233 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/284 2024-03-31T17:18:25.233 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/284 2024-03-31T17:18:25.233 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:25.236 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:25.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:25.456 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-03-31T17:18:25.709 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:25.712 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:25.713 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:25.714 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:25.714 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:26.903 INFO:teuthology.orchestra.run.smithi120.stdout:generic/285 1s 2024-03-31T17:18:26.910 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/285 2024-03-31T17:18:26.910 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:27.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:27.290 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-03-31T17:18:27.690 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:27.695 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:27.695 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:27.696 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:27.696 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:28.001 INFO:teuthology.orchestra.run.smithi120.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:18:28.006 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/286 2024-03-31T17:18:28.006 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/286 2024-03-31T17:18:28.006 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:28.011 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:28.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:28.032 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-03-31T17:18:28.300 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:28.305 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:28.305 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:28.307 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:28.307 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:28.764 INFO:teuthology.orchestra.run.smithi120.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:28.778 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/287 2024-03-31T17:18:28.778 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/287 2024-03-31T17:18:28.778 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:28.785 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:28.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:28.963 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-03-31T17:18:29.310 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:29.316 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:29.317 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:29.318 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:29.318 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:29.711 INFO:teuthology.orchestra.run.smithi120.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:29.730 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/288 2024-03-31T17:18:29.730 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/288 2024-03-31T17:18:29.730 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:29.733 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:29.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:29.752 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-03-31T17:18:30.012 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:30.017 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:30.018 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:30.018 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:30.019 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:30.504 INFO:teuthology.orchestra.run.smithi120.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:30.509 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/289 2024-03-31T17:18:30.510 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/289 2024-03-31T17:18:30.510 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:30.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:30.731 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-03-31T17:18:31.067 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:31.072 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:31.072 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:31.074 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:31.566 INFO:teuthology.orchestra.run.smithi120.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:31.573 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/290 2024-03-31T17:18:31.573 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/290 2024-03-31T17:18:31.574 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:31.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:31.848 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-03-31T17:18:32.140 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:32.150 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:32.150 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:32.151 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:32.621 INFO:teuthology.orchestra.run.smithi120.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:32.628 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/291 2024-03-31T17:18:32.628 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/291 2024-03-31T17:18:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:32.630 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:32.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:32.906 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-03-31T17:18:33.207 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:33.212 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:33.213 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:33.214 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:33.214 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:33.623 INFO:teuthology.orchestra.run.smithi120.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:33.629 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/292 2024-03-31T17:18:33.629 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/292 2024-03-31T17:18:33.629 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:33.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:33.888 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-03-31T17:18:34.119 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:34.124 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:34.124 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:34.124 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:34.124 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:34.496 INFO:teuthology.orchestra.run.smithi120.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:34.502 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/293 2024-03-31T17:18:34.502 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/293 2024-03-31T17:18:34.502 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:34.508 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:34.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:34.707 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-03-31T17:18:34.985 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:34.988 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:34.989 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:34.990 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:34.990 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:35.453 INFO:teuthology.orchestra.run.smithi120.stdout:generic/294 0s 2024-03-31T17:18:35.462 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/294 2024-03-31T17:18:35.462 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:35.465 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:35.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:35.492 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-03-31T17:18:35.824 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:35.828 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:35.829 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:35.830 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:35.830 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:36.208 INFO:teuthology.orchestra.run.smithi120.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:36.215 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/295 2024-03-31T17:18:36.215 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/295 2024-03-31T17:18:36.215 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:36.217 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:36.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:36.506 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-03-31T17:18:36.722 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:36.726 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:36.727 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:36.732 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:36.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:37.096 INFO:teuthology.orchestra.run.smithi120.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:37.102 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/296 2024-03-31T17:18:37.102 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/296 2024-03-31T17:18:37.103 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:37.105 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:37.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:37.348 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-03-31T17:18:37.584 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:37.587 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:37.588 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:37.589 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:37.589 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:37.938 INFO:teuthology.orchestra.run.smithi120.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:37.947 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/297 2024-03-31T17:18:37.947 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/297 2024-03-31T17:18:37.947 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:38.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:38.130 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-03-31T17:18:38.409 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:38.413 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:38.413 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:38.414 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:38.415 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:38.801 INFO:teuthology.orchestra.run.smithi120.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:38.806 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/298 2024-03-31T17:18:38.806 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/298 2024-03-31T17:18:38.807 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:38.813 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:39.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:39.055 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-03-31T17:18:39.282 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:39.286 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:39.286 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:39.287 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:39.287 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:39.577 INFO:teuthology.orchestra.run.smithi120.stdout:generic/299 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:18:39.580 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/299 2024-03-31T17:18:39.581 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/299 2024-03-31T17:18:39.581 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:39.583 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:39.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:39.618 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-03-31T17:18:39.810 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:39.813 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:39.814 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:39.815 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:39.815 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:40.087 INFO:teuthology.orchestra.run.smithi120.stdout:generic/300 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:18:40.091 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/300 2024-03-31T17:18:40.091 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/300 2024-03-31T17:18:40.091 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:40.093 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:40.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:40.112 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-03-31T17:18:40.307 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:40.311 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:40.311 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:40.312 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:40.312 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:40.666 INFO:teuthology.orchestra.run.smithi120.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/301 2024-03-31T17:18:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/301 2024-03-31T17:18:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:40.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:40.874 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-03-31T17:18:41.139 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:41.142 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:41.143 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:41.144 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:41.144 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:41.501 INFO:teuthology.orchestra.run.smithi120.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:41.508 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/302 2024-03-31T17:18:41.508 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/302 2024-03-31T17:18:41.508 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:41.513 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:41.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:41.772 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-03-31T17:18:41.995 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:41.999 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:41.999 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:42.000 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:42.001 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:42.064 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:18:42.067 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:18:42.264 INFO:teuthology.orchestra.run.smithi120.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:18:42.268 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/303 2024-03-31T17:18:42.268 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/303 2024-03-31T17:18:42.268 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:42.270 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:42.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:42.331 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-03-31T17:18:42.744 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:42.748 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:42.749 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:42.750 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:42.750 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:43.004 INFO:teuthology.orchestra.run.smithi120.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-31T17:18:43.008 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/304 2024-03-31T17:18:43.008 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/304 2024-03-31T17:18:43.008 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:43.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:43.077 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-03-31T17:18:43.496 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:43.500 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:43.500 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:43.501 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:43.865 INFO:teuthology.orchestra.run.smithi120.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:18:43.872 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/305 2024-03-31T17:18:43.872 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/305 2024-03-31T17:18:43.872 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:43.874 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:44.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:44.132 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-03-31T17:18:44.349 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:44.352 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:44.353 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:44.354 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:44.354 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:44.882 INFO:teuthology.orchestra.run.smithi120.stdout:generic/306 0s 2024-03-31T17:18:44.891 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/306 2024-03-31T17:18:44.892 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:44.895 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:45.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:45.109 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-03-31T17:18:45.537 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:45.543 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:45.543 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:45.544 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:45.544 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:47.038 INFO:teuthology.orchestra.run.smithi120.stdout:generic/307 2s 2024-03-31T17:18:47.043 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/307 2024-03-31T17:18:47.043 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:47.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:47.055 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-03-31T17:18:47.235 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:47.239 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:47.239 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:47.240 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:47.241 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:47.480 INFO:teuthology.orchestra.run.smithi120.stdout:generic/308 0s 2024-03-31T17:18:47.485 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/308 2024-03-31T17:18:47.485 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:47.487 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:47.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:47.505 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-03-31T17:18:47.683 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:47.687 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:47.687 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:47.688 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:47.688 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:48.971 INFO:teuthology.orchestra.run.smithi120.stdout:generic/309 1s 2024-03-31T17:18:48.976 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/309 2024-03-31T17:18:48.976 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:18:48.979 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:18:49.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:18:49.050 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-03-31T17:18:49.430 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:18:49.433 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:18:49.434 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:18:49.435 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:18:49.435 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:19:12.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:19:12.498 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:19:42.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:19:42.811 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:20:06.298 INFO:teuthology.orchestra.run.smithi120.stdout:generic/310 77s 2024-03-31T17:20:06.302 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/310 2024-03-31T17:20:06.302 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:06.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:06.466 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-03-31T17:20:06.809 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:06.812 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:06.813 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:06.814 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:06.814 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:07.179 INFO:teuthology.orchestra.run.smithi120.stdout:generic/311 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:20:07.182 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/311 2024-03-31T17:20:07.183 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/311 2024-03-31T17:20:07.183 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:07.185 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:07.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:07.202 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-03-31T17:20:07.385 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:07.389 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:07.390 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:07.619 INFO:teuthology.orchestra.run.smithi120.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:20:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/312 2024-03-31T17:20:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/312 2024-03-31T17:20:07.623 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:07.625 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:07.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:07.643 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-03-31T17:20:07.833 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:07.838 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:07.838 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:07.839 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:07.839 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:12.087 INFO:teuthology.orchestra.run.smithi120.stdout:generic/313 5s 2024-03-31T17:20:12.091 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/313 2024-03-31T17:20:12.092 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:12.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:12.108 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-03-31T17:20:12.294 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:12.298 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:12.298 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:12.299 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:12.299 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:12.722 INFO:teuthology.orchestra.run.smithi120.stdout:generic/314 0s 2024-03-31T17:20:12.728 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/314 2024-03-31T17:20:12.728 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:12.730 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:12.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:12.749 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-03-31T17:20:12.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:20:12.878 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:20:12.931 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:12.935 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:12.935 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:12.937 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:13.175 INFO:teuthology.orchestra.run.smithi120.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-31T17:20:13.179 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/315 2024-03-31T17:20:13.179 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/315 2024-03-31T17:20:13.179 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:13.181 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:13.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:13.201 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-03-31T17:20:13.400 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:13.404 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:13.405 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:13.406 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:13.406 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:13.746 INFO:teuthology.orchestra.run.smithi120.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-31T17:20:13.750 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/316 2024-03-31T17:20:13.750 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/316 2024-03-31T17:20:13.750 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:13.752 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:13.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:13.796 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-03-31T17:20:14.324 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:14.328 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:14.328 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:14.329 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:14.329 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:17.912 INFO:teuthology.orchestra.run.smithi120.stdout:generic/317 3s 2024-03-31T17:20:17.917 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/317 2024-03-31T17:20:17.917 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:17.919 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:17.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:17.929 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-03-31T17:20:18.122 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:18.127 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:18.127 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:18.127 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:18.127 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:18.649 INFO:teuthology.orchestra.run.smithi120.stdout:generic/318 0s 2024-03-31T17:20:18.655 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/318 2024-03-31T17:20:18.655 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:18.657 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:18.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:18.667 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-03-31T17:20:18.864 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:18.866 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:18.867 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:18.868 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:19.219 INFO:teuthology.orchestra.run.smithi120.stdout:generic/319 1s 2024-03-31T17:20:19.224 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/319 2024-03-31T17:20:19.225 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:19.229 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:19.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:19.236 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-03-31T17:20:19.421 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:19.425 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:19.426 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:19.426 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:19.652 INFO:teuthology.orchestra.run.smithi120.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:20:19.656 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/320 2024-03-31T17:20:19.656 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/320 2024-03-31T17:20:19.656 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:19.658 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:19.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:19.672 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-03-31T17:20:19.856 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:19.860 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:19.861 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:19.862 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:19.862 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:20.076 INFO:teuthology.orchestra.run.smithi120.stdout:generic/321 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:20:20.080 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/321 2024-03-31T17:20:20.080 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/321 2024-03-31T17:20:20.080 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:20.082 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:20.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:20.096 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-03-31T17:20:20.286 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:20.290 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:20.290 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:20.291 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:20.522 INFO:teuthology.orchestra.run.smithi120.stdout:generic/322 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:20:20.525 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/322 2024-03-31T17:20:20.526 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/322 2024-03-31T17:20:20.526 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:20:20.528 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:20.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:20:20.541 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-03-31T17:20:20.723 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:20:20.727 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:20:20.728 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:20:20.728 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:20:20.729 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:20:43.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:20:43.037 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:21:13.482 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:21:13.485 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:21:13.702 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T17:21:13.701+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46849) UID: 0 2024-03-31T17:21:13.703 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T17:21:13.701+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46849) UID: 0 2024-03-31T17:21:13.703 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T17:21:13.701+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46849) UID: 0 2024-03-31T17:21:13.703 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T17:21:13.701+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46849) UID: 0 2024-03-31T17:22:21.462 INFO:teuthology.orchestra.run.smithi120.stdout:generic/323 121s 2024-03-31T17:22:21.466 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/323 2024-03-31T17:22:21.467 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:21.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:21.514 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-03-31T17:22:21.932 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:21.936 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:21.936 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:21.937 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:21.937 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:22.157 INFO:teuthology.orchestra.run.smithi120.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-03-31T17:22:22.161 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/324 2024-03-31T17:22:22.161 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/324 2024-03-31T17:22:22.161 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:22.163 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:22.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:22.176 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-03-31T17:22:22.366 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:22.370 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:22.370 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:22.371 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout:generic/325 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/325 2024-03-31T17:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/325 2024-03-31T17:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:22.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:22.614 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-03-31T17:22:22.792 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:22.796 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:22.796 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:22.797 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:22.797 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:23.148 INFO:teuthology.orchestra.run.smithi120.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:23.154 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/326 2024-03-31T17:22:23.154 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/326 2024-03-31T17:22:23.154 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:23.157 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:23.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:23.378 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-03-31T17:22:23.647 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:23.651 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:23.651 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:23.652 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:24.017 INFO:teuthology.orchestra.run.smithi120.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:24.026 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/327 2024-03-31T17:22:24.026 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/327 2024-03-31T17:22:24.026 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:24.028 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:24.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:24.369 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-03-31T17:22:24.556 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:24.559 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:24.560 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:24.561 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:24.561 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:24.935 INFO:teuthology.orchestra.run.smithi120.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:24.941 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/328 2024-03-31T17:22:24.941 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/328 2024-03-31T17:22:24.941 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:25.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:25.267 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-03-31T17:22:25.464 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:25.468 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:25.468 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:25.469 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:25.469 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:25.848 INFO:teuthology.orchestra.run.smithi120.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:25.855 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/329 2024-03-31T17:22:25.856 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/329 2024-03-31T17:22:25.856 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:25.859 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:26.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:26.145 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-03-31T17:22:26.361 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:26.365 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:26.365 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:26.366 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:26.366 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:26.727 INFO:teuthology.orchestra.run.smithi120.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:26.733 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/330 2024-03-31T17:22:26.733 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/330 2024-03-31T17:22:26.733 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:26.737 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:27.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:27.042 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-03-31T17:22:27.241 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:27.245 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:27.245 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:27.247 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:27.616 INFO:teuthology.orchestra.run.smithi120.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:27.622 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/331 2024-03-31T17:22:27.622 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/331 2024-03-31T17:22:27.622 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:27.625 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:27.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:27.927 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-03-31T17:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:28.505 INFO:teuthology.orchestra.run.smithi120.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:28.512 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/332 2024-03-31T17:22:28.512 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/332 2024-03-31T17:22:28.512 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:28.515 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:28.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:28.804 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-03-31T17:22:29.015 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:29.019 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:29.020 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:29.020 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:29.021 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:29.384 INFO:teuthology.orchestra.run.smithi120.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:29.391 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/333 2024-03-31T17:22:29.391 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/333 2024-03-31T17:22:29.391 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:29.393 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:29.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:29.697 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-03-31T17:22:29.905 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:29.909 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:29.910 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:29.911 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:29.911 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:30.279 INFO:teuthology.orchestra.run.smithi120.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:22:30.285 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/334 2024-03-31T17:22:30.285 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/334 2024-03-31T17:22:30.285 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:30.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:30.588 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-03-31T17:22:30.789 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:30.793 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:30.793 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:30.794 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:31.017 INFO:teuthology.orchestra.run.smithi120.stdout:generic/335 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:22:31.021 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/335 2024-03-31T17:22:31.021 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/335 2024-03-31T17:22:31.021 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:31.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:31.048 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-03-31T17:22:31.233 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:31.237 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:31.238 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:31.239 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:31.474 INFO:teuthology.orchestra.run.smithi120.stdout:generic/336 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:22:31.478 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/336 2024-03-31T17:22:31.478 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/336 2024-03-31T17:22:31.478 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:31.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:31.500 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-03-31T17:22:31.694 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:31.698 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:31.698 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:31.699 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:31.699 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:32.054 INFO:teuthology.orchestra.run.smithi120.stdout:generic/337 1s 2024-03-31T17:22:32.059 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/337 2024-03-31T17:22:32.059 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:32.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:32.070 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-03-31T17:22:32.252 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:32.256 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:32.256 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:32.257 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:32.257 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:32.492 INFO:teuthology.orchestra.run.smithi120.stdout:generic/338 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:22:32.496 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/338 2024-03-31T17:22:32.496 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/338 2024-03-31T17:22:32.496 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:22:32.498 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:22:32.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:22:32.512 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-03-31T17:22:32.698 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:22:32.702 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:22:32.702 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:22:32.703 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:22:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:25.224 INFO:teuthology.orchestra.run.smithi120.stdout:generic/339 53s 2024-03-31T17:23:25.229 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/339 2024-03-31T17:23:25.229 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:25.231 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:25.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:25.240 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-03-31T17:23:25.448 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:23:25.451 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:23:25.541 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:25.546 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:25.550 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:27.962 INFO:teuthology.orchestra.run.smithi120.stdout:generic/340 2s 2024-03-31T17:23:28.031 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/340 2024-03-31T17:23:28.031 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:28.035 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:28.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:28.048 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-03-31T17:23:28.598 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:28.603 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:28.604 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:28.611 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:28.611 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:29.087 INFO:teuthology.orchestra.run.smithi120.stdout:generic/341 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:23:29.091 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/341 2024-03-31T17:23:29.091 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/341 2024-03-31T17:23:29.091 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:29.093 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:29.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:29.106 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-03-31T17:23:29.281 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:29.285 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:29.285 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:29.286 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:29.286 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:29.516 INFO:teuthology.orchestra.run.smithi120.stdout:generic/342 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:23:29.520 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/342 2024-03-31T17:23:29.520 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/342 2024-03-31T17:23:29.520 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:29.522 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:29.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:29.534 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-03-31T17:23:29.709 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:29.713 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:29.713 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:29.714 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:29.714 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:29.950 INFO:teuthology.orchestra.run.smithi120.stdout:generic/343 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:23:29.955 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/343 2024-03-31T17:23:29.955 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/343 2024-03-31T17:23:29.955 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:29.957 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:29.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:29.974 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-03-31T17:23:30.162 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:30.166 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:30.166 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:30.167 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:30.167 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout:generic/344 4s 2024-03-31T17:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/344 2024-03-31T17:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:34.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:34.650 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-03-31T17:23:35.014 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:35.019 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:35.019 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:35.021 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:35.021 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:40.020 INFO:teuthology.orchestra.run.smithi120.stdout:generic/345 5s 2024-03-31T17:23:40.026 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/345 2024-03-31T17:23:40.026 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:40.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:40.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:40.042 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-03-31T17:23:40.407 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:40.419 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:40.419 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:40.419 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:40.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:43.031 INFO:teuthology.orchestra.run.smithi120.stdout:generic/346 3s 2024-03-31T17:23:43.041 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/346 2024-03-31T17:23:43.041 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:43.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:43.058 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-03-31T17:23:43.494 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:43.499 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:43.500 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:43.501 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:43.501 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:43.855 INFO:teuthology.orchestra.run.smithi120.stdout:generic/347 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:23:43.861 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/347 2024-03-31T17:23:43.861 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/347 2024-03-31T17:23:43.861 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:43.864 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:43.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:43.882 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-03-31T17:23:44.098 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:44.102 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:44.102 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:44.103 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:44.330 INFO:teuthology.orchestra.run.smithi120.stdout:generic/348 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:23:44.334 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/348 2024-03-31T17:23:44.334 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/348 2024-03-31T17:23:44.334 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:44.337 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:44.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:44.353 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-03-31T17:23:44.547 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:44.551 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:44.551 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:44.552 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:44.879 INFO:teuthology.orchestra.run.smithi120.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-31T17:23:44.882 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/349 2024-03-31T17:23:44.883 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/349 2024-03-31T17:23:44.883 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:44.885 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:44.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:44.903 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-03-31T17:23:45.079 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:45.082 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:45.083 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:45.084 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:45.084 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:45.711 INFO:teuthology.orchestra.run.smithi120.stdout:generic/350 0s 2024-03-31T17:23:45.716 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/350 2024-03-31T17:23:45.716 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:45.719 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:45.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:45.728 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-03-31T17:23:45.907 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:45.911 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:45.912 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:45.913 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:45.913 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:46.136 INFO:teuthology.orchestra.run.smithi120.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:23:46.139 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/351 2024-03-31T17:23:46.140 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/351 2024-03-31T17:23:46.140 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:46.142 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:46.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:46.158 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-03-31T17:23:46.340 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:46.344 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:46.345 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:46.346 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:46.346 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:46.763 INFO:teuthology.orchestra.run.smithi120.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:23:46.770 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/352 2024-03-31T17:23:46.770 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/352 2024-03-31T17:23:46.770 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:47.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:47.061 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-03-31T17:23:47.253 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:47.257 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:47.257 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:47.258 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:47.258 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:47.613 INFO:teuthology.orchestra.run.smithi120.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:23:47.623 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/353 2024-03-31T17:23:47.624 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/353 2024-03-31T17:23:47.624 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:47.627 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:47.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:47.910 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-03-31T17:23:48.123 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:48.127 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:48.127 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:48.128 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:48.129 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:52.396 INFO:teuthology.orchestra.run.smithi120.stdout:generic/354 4s 2024-03-31T17:23:52.412 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/354 2024-03-31T17:23:52.412 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:52.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:52.428 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-03-31T17:23:52.822 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:52.828 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:52.829 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:52.830 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:52.830 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:53.635 INFO:teuthology.orchestra.run.smithi120.stdout:generic/355 1s 2024-03-31T17:23:53.642 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/355 2024-03-31T17:23:53.642 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:53.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:53.705 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-03-31T17:23:54.082 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:54.088 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:54.089 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:54.090 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:54.090 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:54.490 INFO:teuthology.orchestra.run.smithi120.stdout:generic/356 [not run] swapfiles are not supported 2024-03-31T17:23:54.494 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/356 2024-03-31T17:23:54.494 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/356 2024-03-31T17:23:54.494 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:54.497 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:54.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:54.512 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-03-31T17:23:54.692 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:54.696 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:54.696 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:54.697 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:54.697 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:55.110 INFO:teuthology.orchestra.run.smithi120.stdout:generic/357 [not run] swapfiles are not supported 2024-03-31T17:23:55.114 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/357 2024-03-31T17:23:55.114 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/357 2024-03-31T17:23:55.114 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:55.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:55.131 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-03-31T17:23:55.318 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:55.322 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:55.322 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:55.323 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:55.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:23:55.623 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:23:55.718 INFO:teuthology.orchestra.run.smithi120.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:23:55.728 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/358 2024-03-31T17:23:55.728 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/358 2024-03-31T17:23:55.729 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:55.732 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:55.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:55.877 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-03-31T17:23:56.214 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:56.218 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:56.218 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:56.219 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:56.219 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:56.588 INFO:teuthology.orchestra.run.smithi120.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:23:56.596 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/359 2024-03-31T17:23:56.596 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/359 2024-03-31T17:23:56.596 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:56.598 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:56.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:56.866 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-03-31T17:23:57.114 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:57.117 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:57.119 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:57.119 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:57.119 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:57.387 INFO:teuthology.orchestra.run.smithi120.stdout:generic/360 0s 2024-03-31T17:23:57.438 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/360 2024-03-31T17:23:57.438 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:57.440 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:57.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:57.458 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-03-31T17:23:57.639 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:57.643 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:57.643 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:57.644 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:57.644 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:57.861 INFO:teuthology.orchestra.run.smithi120.stdout:generic/361 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:23:57.915 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/361 2024-03-31T17:23:57.915 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/361 2024-03-31T17:23:57.915 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:57.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:57.915 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-03-31T17:23:58.100 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:58.104 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:58.105 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:58.106 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:58.106 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:58.325 INFO:teuthology.orchestra.run.smithi120.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:23:58.329 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/362 2024-03-31T17:23:58.329 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/362 2024-03-31T17:23:58.329 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:58.332 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:58.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:58.344 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-03-31T17:23:58.534 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:58.538 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:58.538 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:58.539 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:58.539 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:58.740 INFO:teuthology.orchestra.run.smithi120.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:23:58.744 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/363 2024-03-31T17:23:58.744 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/363 2024-03-31T17:23:58.744 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:58.746 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:58.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:58.759 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-03-31T17:23:58.952 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:58.956 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:58.956 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:58.957 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:59.181 INFO:teuthology.orchestra.run.smithi120.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:23:59.185 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/364 2024-03-31T17:23:59.185 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/364 2024-03-31T17:23:59.185 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:59.187 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:59.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:59.201 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-03-31T17:23:59.388 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:59.392 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:59.392 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:59.393 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:59.393 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:59.598 INFO:teuthology.orchestra.run.smithi120.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:23:59.602 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/365 2024-03-31T17:23:59.602 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/365 2024-03-31T17:23:59.602 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:23:59.605 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:23:59.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:23:59.618 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-03-31T17:23:59.794 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:23:59.798 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:23:59.798 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:23:59.799 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:23:59.799 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:00.009 INFO:teuthology.orchestra.run.smithi120.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:24:00.013 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/366 2024-03-31T17:24:00.013 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/366 2024-03-31T17:24:00.013 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:00.015 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:00.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:00.029 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-03-31T17:24:00.211 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:00.215 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:00.215 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:00.216 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:00.216 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:00.434 INFO:teuthology.orchestra.run.smithi120.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:24:00.438 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/367 2024-03-31T17:24:00.438 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/367 2024-03-31T17:24:00.438 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:00.440 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:00.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:00.454 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-03-31T17:24:00.648 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:00.652 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:00.652 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:00.654 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:00.654 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:00.853 INFO:teuthology.orchestra.run.smithi120.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:24:00.857 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/368 2024-03-31T17:24:00.857 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/368 2024-03-31T17:24:00.857 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:00.859 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:00.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:00.873 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-03-31T17:24:01.056 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:01.060 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:01.060 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:01.061 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:01.269 INFO:teuthology.orchestra.run.smithi120.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:24:01.273 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/369 2024-03-31T17:24:01.273 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/369 2024-03-31T17:24:01.274 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:01.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:01.289 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-03-31T17:24:01.465 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:01.468 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:01.469 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:01.470 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:01.470 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:01.671 INFO:teuthology.orchestra.run.smithi120.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-31T17:24:01.674 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/370 2024-03-31T17:24:01.675 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/370 2024-03-31T17:24:01.675 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:01.677 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:01.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:01.690 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-03-31T17:24:01.876 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:01.880 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:01.880 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:01.881 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:01.881 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:02.116 INFO:teuthology.orchestra.run.smithi120.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:24:02.120 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/371 2024-03-31T17:24:02.120 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/371 2024-03-31T17:24:02.120 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:02.122 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:02.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:02.140 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-03-31T17:24:02.320 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:02.324 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:02.324 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:02.325 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:02.708 INFO:teuthology.orchestra.run.smithi120.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:24:02.715 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/372 2024-03-31T17:24:02.715 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/372 2024-03-31T17:24:02.715 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:02.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:02.983 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-03-31T17:24:03.204 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:03.208 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:03.208 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:03.209 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:03.209 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:03.563 INFO:teuthology.orchestra.run.smithi120.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:24:03.570 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/373 2024-03-31T17:24:03.570 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/373 2024-03-31T17:24:03.570 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:03.574 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:03.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:03.858 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-03-31T17:24:04.078 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:04.081 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:04.082 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:04.083 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:04.083 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:04.390 INFO:teuthology.orchestra.run.smithi120.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-31T17:24:04.440 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/374 2024-03-31T17:24:04.440 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/374 2024-03-31T17:24:04.440 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:04.442 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:04.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:04.723 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-03-31T17:24:04.943 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:04.947 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:04.947 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:04.948 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:05.239 INFO:teuthology.orchestra.run.smithi120.stdout:generic/375 0s 2024-03-31T17:24:05.245 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/375 2024-03-31T17:24:05.245 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:05.247 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:05.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:05.304 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-03-31T17:24:05.679 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:05.685 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:05.687 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:05.687 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:05.911 INFO:teuthology.orchestra.run.smithi120.stdout:generic/376 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:24:05.915 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/376 2024-03-31T17:24:05.915 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/376 2024-03-31T17:24:05.915 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:05.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:05.930 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-03-31T17:24:06.112 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:06.116 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:06.116 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:06.117 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:06.117 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:06.465 INFO:teuthology.orchestra.run.smithi120.stdout:generic/377 0s 2024-03-31T17:24:06.470 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/377 2024-03-31T17:24:06.470 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:06.473 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:06.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:06.481 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-03-31T17:24:06.669 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:06.673 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:06.674 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:06.675 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:07.133 INFO:teuthology.orchestra.run.smithi120.stdout:generic/378 1s 2024-03-31T17:24:07.139 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/378 2024-03-31T17:24:07.139 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:07.141 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:07.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:07.205 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-03-31T17:24:07.607 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:07.612 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:07.613 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:07.614 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:07.816 INFO:teuthology.orchestra.run.smithi120.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:07.820 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/379 2024-03-31T17:24:07.820 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/379 2024-03-31T17:24:07.820 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:07.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:07.836 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-03-31T17:24:08.015 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:08.018 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:08.019 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:08.020 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:08.020 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:08.230 INFO:teuthology.orchestra.run.smithi120.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:08.234 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/380 2024-03-31T17:24:08.234 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/380 2024-03-31T17:24:08.234 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:08.236 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:08.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:08.250 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-03-31T17:24:08.431 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:08.435 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:08.436 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:08.437 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:08.437 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:08.654 INFO:teuthology.orchestra.run.smithi120.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:08.658 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/381 2024-03-31T17:24:08.658 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/381 2024-03-31T17:24:08.658 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:08.660 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:08.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:08.682 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-03-31T17:24:08.859 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:08.863 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:08.863 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:08.864 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:08.864 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:09.088 INFO:teuthology.orchestra.run.smithi120.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:09.092 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/382 2024-03-31T17:24:09.092 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/382 2024-03-31T17:24:09.092 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:09.095 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:09.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:09.109 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-03-31T17:24:09.293 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:09.296 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:09.297 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:09.298 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:09.298 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:09.505 INFO:teuthology.orchestra.run.smithi120.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:09.509 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/383 2024-03-31T17:24:09.509 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/383 2024-03-31T17:24:09.509 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:09.511 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:09.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:09.525 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-03-31T17:24:09.707 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:09.711 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:09.711 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:09.712 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:09.712 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:09.939 INFO:teuthology.orchestra.run.smithi120.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:09.943 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/384 2024-03-31T17:24:09.944 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/384 2024-03-31T17:24:09.944 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:09.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:09.961 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-03-31T17:24:10.152 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:10.156 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:10.156 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:10.157 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:10.157 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:10.384 INFO:teuthology.orchestra.run.smithi120.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:10.388 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/385 2024-03-31T17:24:10.389 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/385 2024-03-31T17:24:10.389 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:10.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:10.404 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-03-31T17:24:10.592 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:10.595 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:10.596 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:10.597 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:10.597 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:10.811 INFO:teuthology.orchestra.run.smithi120.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:10.815 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/386 2024-03-31T17:24:10.815 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/386 2024-03-31T17:24:10.815 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:10.817 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:10.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:10.831 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-03-31T17:24:11.015 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:11.019 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:11.019 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:11.020 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:11.020 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:11.382 INFO:teuthology.orchestra.run.smithi120.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:24:11.389 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/387 2024-03-31T17:24:11.389 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/387 2024-03-31T17:24:11.389 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:11.396 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:11.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:11.705 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-03-31T17:24:11.897 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:11.901 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:11.902 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:11.903 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:12.144 INFO:teuthology.orchestra.run.smithi120.stdout:generic/388 [not run] require 172.21.15.120:6789:/scratch to be local device 2024-03-31T17:24:12.148 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/388 2024-03-31T17:24:12.148 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/388 2024-03-31T17:24:12.149 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:12.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:12.163 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-03-31T17:24:12.341 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:12.345 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:12.345 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:12.346 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:12.574 INFO:teuthology.orchestra.run.smithi120.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-03-31T17:24:12.578 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/389 2024-03-31T17:24:12.579 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/389 2024-03-31T17:24:12.579 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:12.581 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:12.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:12.593 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-03-31T17:24:12.777 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:12.781 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:12.781 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:12.782 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:12.782 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:13.008 INFO:teuthology.orchestra.run.smithi120.stdout:generic/390 [not run] ceph does not support freezing 2024-03-31T17:24:13.011 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/390 2024-03-31T17:24:13.012 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/390 2024-03-31T17:24:13.012 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:13.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:13.027 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-03-31T17:24:13.209 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:13.212 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:13.213 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:13.214 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:13.214 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:13.446 INFO:teuthology.orchestra.run.smithi120.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:24:13.449 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/391 2024-03-31T17:24:13.450 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/391 2024-03-31T17:24:13.450 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:13.452 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:13.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:13.471 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-03-31T17:24:13.650 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:13.654 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:13.654 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:13.655 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:13.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:13.928 INFO:teuthology.orchestra.run.smithi120.stdout:generic/392 [not run] ceph does not support shutdown 2024-03-31T17:24:13.936 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/392 2024-03-31T17:24:13.936 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/392 2024-03-31T17:24:13.936 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:13.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:13.966 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-03-31T17:24:14.142 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:14.146 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:14.146 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:14.147 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:14.147 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:14.789 INFO:teuthology.orchestra.run.smithi120.stdout:generic/393 0s 2024-03-31T17:24:14.795 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/393 2024-03-31T17:24:14.795 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:14.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:14.805 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-03-31T17:24:14.979 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:14.983 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:14.983 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:14.984 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:14.984 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:15.245 INFO:teuthology.orchestra.run.smithi120.stdout:generic/394 0s 2024-03-31T17:24:15.251 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/394 2024-03-31T17:24:15.251 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:15.253 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:15.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:15.307 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-03-31T17:24:15.719 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:15.725 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:15.725 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:15.726 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:15.726 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:16.221 INFO:teuthology.orchestra.run.smithi120.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-03-31T17:24:16.242 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/395 2024-03-31T17:24:16.242 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/395 2024-03-31T17:24:16.242 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:16.244 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:16.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:16.260 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-03-31T17:24:16.513 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:16.518 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:16.518 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:16.520 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:16.520 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:16.998 INFO:teuthology.orchestra.run.smithi120.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-03-31T17:24:17.006 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/396 2024-03-31T17:24:17.006 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/396 2024-03-31T17:24:17.007 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:17.008 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:17.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:17.021 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-03-31T17:24:17.220 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:17.224 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:17.224 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:17.225 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:17.225 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:17.569 INFO:teuthology.orchestra.run.smithi120.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-03-31T17:24:17.578 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/397 2024-03-31T17:24:17.578 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/397 2024-03-31T17:24:17.578 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:17.580 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:17.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:17.607 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-03-31T17:24:17.808 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:17.812 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:17.812 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:17.813 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:18.143 INFO:teuthology.orchestra.run.smithi120.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-03-31T17:24:18.160 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/398 2024-03-31T17:24:18.160 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/398 2024-03-31T17:24:18.160 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:18.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:18.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:18.175 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-03-31T17:24:18.373 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:18.377 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:18.377 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:18.378 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:18.378 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:18.701 INFO:teuthology.orchestra.run.smithi120.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-03-31T17:24:18.709 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/399 2024-03-31T17:24:18.710 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/399 2024-03-31T17:24:18.710 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:18.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:18.724 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-03-31T17:24:18.901 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:18.905 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:18.905 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:18.906 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:18.906 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:19.109 INFO:teuthology.orchestra.run.smithi120.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T17:24:19.113 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/400 2024-03-31T17:24:19.113 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/400 2024-03-31T17:24:19.113 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:19.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:19.130 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-03-31T17:24:19.308 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:19.312 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:19.313 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:19.314 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:19.314 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:19.709 INFO:teuthology.orchestra.run.smithi120.stdout:generic/401 0s 2024-03-31T17:24:19.722 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/401 2024-03-31T17:24:19.722 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:19.725 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:19.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:19.737 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-03-31T17:24:20.090 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:20.095 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:20.095 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:20.096 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:20.096 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:20.422 INFO:teuthology.orchestra.run.smithi120.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-03-31T17:24:20.435 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/402 2024-03-31T17:24:20.435 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/402 2024-03-31T17:24:20.435 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:20.437 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:20.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:20.450 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-03-31T17:24:20.630 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:20.634 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:20.634 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:20.635 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:20.635 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:21.092 INFO:teuthology.orchestra.run.smithi120.stdout:generic/403 1s 2024-03-31T17:24:21.098 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/403 2024-03-31T17:24:21.098 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:21.102 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:21.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:21.109 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-03-31T17:24:21.304 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:21.308 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:21.309 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:21.309 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:21.309 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:21.540 INFO:teuthology.orchestra.run.smithi120.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:24:21.543 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/404 2024-03-31T17:24:21.543 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/404 2024-03-31T17:24:21.543 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:21.546 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:21.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:21.572 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-03-31T17:24:21.749 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:21.753 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:21.753 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:21.754 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:21.754 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:21.997 INFO:teuthology.orchestra.run.smithi120.stdout:generic/405 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:24:22.001 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/405 2024-03-31T17:24:22.001 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/405 2024-03-31T17:24:22.002 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:22.004 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:22.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:22.033 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-03-31T17:24:22.209 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:22.213 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:22.213 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:22.215 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:22.215 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:23.756 INFO:teuthology.orchestra.run.smithi120.stdout:generic/406 1s 2024-03-31T17:24:23.762 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/406 2024-03-31T17:24:23.762 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:23.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:23.773 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-03-31T17:24:23.965 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:23.968 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:23.968 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:23.969 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:23.969 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:24.234 INFO:teuthology.orchestra.run.smithi120.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:24:24.238 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/407 2024-03-31T17:24:24.238 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/407 2024-03-31T17:24:24.238 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:24.240 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:24.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:24.287 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-03-31T17:24:24.686 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:24.691 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:24.692 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:24.693 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:24.693 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:24.982 INFO:teuthology.orchestra.run.smithi120.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-31T17:24:24.986 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/408 2024-03-31T17:24:24.986 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/408 2024-03-31T17:24:24.986 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:24.988 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:25.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:25.058 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-03-31T17:24:25.494 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:25.498 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:25.499 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:25.499 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:25.499 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:25.729 INFO:teuthology.orchestra.run.smithi120.stdout:generic/409 [not run] require 172.21.15.120:6789:/scratch to be local device 2024-03-31T17:24:25.733 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/409 2024-03-31T17:24:25.733 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/409 2024-03-31T17:24:25.733 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:25.736 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:25.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:25.749 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-03-31T17:24:25.757 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:24:25.794 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:24:25.935 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:25.939 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:25.939 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:25.940 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:25.940 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:26.153 INFO:teuthology.orchestra.run.smithi120.stdout:generic/410 [not run] require 172.21.15.120:6789:/scratch to be local device 2024-03-31T17:24:26.157 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/410 2024-03-31T17:24:26.157 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/410 2024-03-31T17:24:26.157 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:26.159 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:26.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:26.172 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-03-31T17:24:26.369 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:26.372 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:26.373 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:26.374 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:26.374 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:26.597 INFO:teuthology.orchestra.run.smithi120.stdout:generic/411 [not run] require 172.21.15.120:6789:/scratch to be local device 2024-03-31T17:24:26.601 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/411 2024-03-31T17:24:26.601 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/411 2024-03-31T17:24:26.601 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:26.603 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:26.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:26.627 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-03-31T17:24:26.831 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:26.835 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:26.836 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:26.837 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:26.837 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:27.278 INFO:teuthology.orchestra.run.smithi120.stdout:generic/412 1s 2024-03-31T17:24:27.283 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/412 2024-03-31T17:24:27.283 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:27.285 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:27.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:27.294 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-03-31T17:24:27.474 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:27.478 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:27.478 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:27.479 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:27.479 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:27.762 INFO:teuthology.orchestra.run.smithi120.stdout:generic/413 [not run] mount 172.21.15.120:6789:/scratch with dax failed 2024-03-31T17:24:27.766 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/413 2024-03-31T17:24:27.766 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/413 2024-03-31T17:24:27.766 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:27.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:27.793 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-03-31T17:24:27.976 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:27.979 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:27.980 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:27.981 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:27.981 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:28.346 INFO:teuthology.orchestra.run.smithi120.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:24:28.352 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/414 2024-03-31T17:24:28.352 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/414 2024-03-31T17:24:28.353 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:28.355 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:28.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:28.547 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-03-31T17:24:28.849 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:28.853 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:28.853 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:28.854 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:29.191 INFO:teuthology.orchestra.run.smithi120.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:24:29.197 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/415 2024-03-31T17:24:29.197 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/415 2024-03-31T17:24:29.198 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:29.200 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:29.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:29.506 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-03-31T17:24:29.720 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:29.724 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:29.725 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:29.726 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:29.726 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:29.939 INFO:teuthology.orchestra.run.smithi120.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:24:29.943 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/416 2024-03-31T17:24:29.944 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/416 2024-03-31T17:24:29.944 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:29.946 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:29.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:29.959 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-03-31T17:24:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:30.156 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:30.157 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:30.157 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:30.157 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:30.432 INFO:teuthology.orchestra.run.smithi120.stdout:generic/417 [not run] ceph does not support shutdown 2024-03-31T17:24:30.440 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/417 2024-03-31T17:24:30.440 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/417 2024-03-31T17:24:30.440 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:30.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:30.455 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-03-31T17:24:30.641 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:30.645 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:30.645 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:30.646 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:30.881 INFO:teuthology.orchestra.run.smithi120.stdout:generic/418 [not run] require 172.21.15.120:6789:/test to be valid block disk 2024-03-31T17:24:30.885 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/418 2024-03-31T17:24:30.885 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/418 2024-03-31T17:24:30.885 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:30.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:30.905 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-03-31T17:24:31.090 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:31.093 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:31.094 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:31.095 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:31.435 INFO:teuthology.orchestra.run.smithi120.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-03-31T17:24:31.443 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/419 2024-03-31T17:24:31.443 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/419 2024-03-31T17:24:31.443 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:31.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:31.469 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-03-31T17:24:31.643 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:31.647 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:31.647 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:31.648 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:31.997 INFO:teuthology.orchestra.run.smithi120.stdout:generic/420 0s 2024-03-31T17:24:32.003 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/420 2024-03-31T17:24:32.003 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:32.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:32.068 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-03-31T17:24:32.423 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:32.431 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:32.432 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:32.439 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:32.439 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:32.781 INFO:teuthology.orchestra.run.smithi120.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-03-31T17:24:32.789 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/421 2024-03-31T17:24:32.789 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/421 2024-03-31T17:24:32.789 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:32.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:32.804 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-03-31T17:24:32.990 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:32.994 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:32.994 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:32.995 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:32.995 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:33.231 INFO:teuthology.orchestra.run.smithi120.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-31T17:24:33.235 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/422 2024-03-31T17:24:33.235 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/422 2024-03-31T17:24:33.235 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:33.237 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:33.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:33.266 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-03-31T17:24:33.440 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:33.444 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:33.444 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:33.445 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:33.445 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:33.750 INFO:teuthology.orchestra.run.smithi120.stdout:generic/423 0s 2024-03-31T17:24:33.759 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/423 2024-03-31T17:24:33.759 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:33.760 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:33.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:33.828 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-03-31T17:24:34.237 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:34.241 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:34.241 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:34.242 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:34.242 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:34.470 INFO:teuthology.orchestra.run.smithi120.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-03-31T17:24:34.474 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/424 2024-03-31T17:24:34.474 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/424 2024-03-31T17:24:34.474 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:34.476 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:34.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:34.494 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-03-31T17:24:34.674 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:34.678 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:34.678 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:34.679 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:34.680 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:34.913 INFO:teuthology.orchestra.run.smithi120.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-03-31T17:24:34.917 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/425 2024-03-31T17:24:34.918 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/425 2024-03-31T17:24:34.918 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:24:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:34.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:24:34.963 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-03-31T17:24:35.352 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:24:35.356 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:24:35.357 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:24:35.358 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:24:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:24:55.887 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:24:55.890 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:25:07.477 INFO:teuthology.orchestra.run.smithi120.stdout:generic/426 32s 2024-03-31T17:25:07.561 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/426 2024-03-31T17:25:07.561 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:07.573 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:07.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:07.785 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-03-31T17:25:08.853 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:08.857 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:08.858 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:08.859 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:08.859 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:09.225 INFO:teuthology.orchestra.run.smithi120.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:25:09.228 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/427 2024-03-31T17:25:09.228 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/427 2024-03-31T17:25:09.228 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:09.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:09.250 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-03-31T17:25:09.439 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:09.443 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:09.443 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:09.444 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:09.444 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:09.684 INFO:teuthology.orchestra.run.smithi120.stdout:generic/428 0s 2024-03-31T17:25:09.689 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/428 2024-03-31T17:25:09.689 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:09.692 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:09.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:09.713 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-03-31T17:25:09.903 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:09.907 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:09.907 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:09.908 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:10.294 INFO:teuthology.orchestra.run.smithi120.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-03-31T17:25:10.303 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/429 2024-03-31T17:25:10.303 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/429 2024-03-31T17:25:10.303 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:10.306 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:10.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:10.319 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-03-31T17:25:10.513 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:10.516 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:10.517 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:10.518 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:10.829 INFO:teuthology.orchestra.run.smithi120.stdout:generic/430 0s 2024-03-31T17:25:10.835 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/430 2024-03-31T17:25:10.835 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:10.837 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:10.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:10.920 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-03-31T17:25:11.296 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:11.301 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:11.302 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:11.303 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:11.303 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:11.621 INFO:teuthology.orchestra.run.smithi120.stdout:generic/431 0s 2024-03-31T17:25:11.626 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/431 2024-03-31T17:25:11.626 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:11.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:11.683 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-03-31T17:25:12.098 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:12.103 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:12.103 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:12.104 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:12.402 INFO:teuthology.orchestra.run.smithi120.stdout:generic/432 0s 2024-03-31T17:25:12.408 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/432 2024-03-31T17:25:12.408 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:12.410 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:12.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:12.472 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-03-31T17:25:12.863 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:12.867 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:12.868 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:12.869 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:12.869 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:13.155 INFO:teuthology.orchestra.run.smithi120.stdout:generic/433 1s 2024-03-31T17:25:13.160 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/433 2024-03-31T17:25:13.160 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:13.162 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:13.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:13.225 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-03-31T17:25:13.614 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:13.618 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:13.619 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:13.620 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:13.946 INFO:teuthology.orchestra.run.smithi120.stdout:generic/434 0s 2024-03-31T17:25:13.951 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/434 2024-03-31T17:25:13.951 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:14.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:14.023 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-03-31T17:25:14.420 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:14.424 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:14.424 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:14.425 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:14.425 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:14.751 INFO:teuthology.orchestra.run.smithi120.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-03-31T17:25:14.758 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/435 2024-03-31T17:25:14.758 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/435 2024-03-31T17:25:14.759 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:14.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:14.773 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-03-31T17:25:14.962 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:14.966 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:14.967 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:14.967 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:14.967 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:15.487 INFO:teuthology.orchestra.run.smithi120.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:25:15.491 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/436 2024-03-31T17:25:15.491 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/436 2024-03-31T17:25:15.491 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:15.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:15.540 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-03-31T17:25:15.969 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:15.973 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:15.974 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:15.975 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:15.975 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:16.825 INFO:teuthology.orchestra.run.smithi120.stdout:generic/437 0s 2024-03-31T17:25:16.831 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/437 2024-03-31T17:25:16.831 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:25:16.833 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:16.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:25:16.852 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-03-31T17:25:17.026 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:25:17.030 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:25:17.030 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:25:17.032 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:25:17.032 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:25:27.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:25:27.800 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:25:57.981 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:25:57.984 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:25:58.060 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T17:25:58.058+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 373394) UID: 0 2024-03-31T17:25:58.060 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T17:25:58.058+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 373394) UID: 0 2024-03-31T17:26:28.014 INFO:teuthology.orchestra.run.smithi120.stdout:generic/438 70s 2024-03-31T17:26:28.019 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/438 2024-03-31T17:26:28.019 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:28.021 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:28.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:28.038 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-03-31T17:26:28.220 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:28.224 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:28.224 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:28.225 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:28.226 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:29.080 INFO:teuthology.orchestra.run.smithi120.stdout:generic/439 1s 2024-03-31T17:26:29.092 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/439 2024-03-31T17:26:29.092 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:29.095 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:29.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:29.125 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-03-31T17:26:29.328 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:29.332 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:29.332 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:29.333 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:29.333 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:29.674 INFO:teuthology.orchestra.run.smithi120.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-03-31T17:26:29.682 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/440 2024-03-31T17:26:29.682 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/440 2024-03-31T17:26:29.682 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:29.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:29.698 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-03-31T17:26:29.892 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:29.895 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:29.896 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:29.897 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:29.897 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:30.218 INFO:teuthology.orchestra.run.smithi120.stdout:generic/441 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:26:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/441 2024-03-31T17:26:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/441 2024-03-31T17:26:30.222 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:30.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:30.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:30.238 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-03-31T17:26:30.417 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:30.421 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:30.422 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:30.422 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:30.672 INFO:teuthology.orchestra.run.smithi120.stdout:generic/442 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:26:30.676 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/442 2024-03-31T17:26:30.676 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/442 2024-03-31T17:26:30.676 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:30.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:30.694 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-03-31T17:26:30.885 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:30.888 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:30.889 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:30.890 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:31.146 INFO:teuthology.orchestra.run.smithi120.stdout:generic/443 1s 2024-03-31T17:26:31.152 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/443 2024-03-31T17:26:31.152 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:31.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:31.174 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-03-31T17:26:31.367 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:31.371 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:31.372 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:31.373 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:31.714 INFO:teuthology.orchestra.run.smithi120.stdout:generic/444 0s 2024-03-31T17:26:31.719 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/444 2024-03-31T17:26:31.776 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:31.778 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:31.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:31.778 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-03-31T17:26:31.959 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:31.963 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:31.963 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:31.964 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:32.501 INFO:teuthology.orchestra.run.smithi120.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:26:32.505 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/445 2024-03-31T17:26:32.505 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/445 2024-03-31T17:26:32.505 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:32.507 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:32.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:32.542 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-03-31T17:26:32.986 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:32.992 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:32.993 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:32.993 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:32.994 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:50.311 INFO:teuthology.orchestra.run.smithi120.stdout:generic/446 17s 2024-03-31T17:26:50.325 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/446 2024-03-31T17:26:50.325 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:50.329 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:50.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:50.345 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-03-31T17:26:50.731 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:50.737 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:50.737 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:50.740 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:50.741 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:51.199 INFO:teuthology.orchestra.run.smithi120.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:26:51.211 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/447 2024-03-31T17:26:51.211 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/447 2024-03-31T17:26:51.212 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:51.218 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:51.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:51.325 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-03-31T17:26:51.658 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:51.662 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:51.663 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:51.664 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:52.525 INFO:teuthology.orchestra.run.smithi120.stdout:generic/448 1s 2024-03-31T17:26:52.530 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/448 2024-03-31T17:26:52.530 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:52.533 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:52.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:52.603 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-03-31T17:26:53.132 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:53.136 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:53.136 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:53.137 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:53.137 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:53.393 INFO:teuthology.orchestra.run.smithi120.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T17:26:53.397 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/449 2024-03-31T17:26:53.397 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/449 2024-03-31T17:26:53.397 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:53.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:53.461 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-03-31T17:26:53.859 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:53.869 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:53.869 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:53.871 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:54.506 INFO:teuthology.orchestra.run.smithi120.stdout:generic/450 1s 2024-03-31T17:26:54.515 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/450 2024-03-31T17:26:54.515 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:26:54.517 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:26:54.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:26:54.595 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-03-31T17:26:55.023 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:26:55.027 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:26:55.027 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:26:55.028 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:26:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:25.589 INFO:teuthology.orchestra.run.smithi120.stdout:generic/451 30s 2024-03-31T17:27:25.594 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/451 2024-03-31T17:27:25.594 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:25.597 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:25.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:25.646 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-03-31T17:27:26.103 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:26.108 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:26.109 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:26.109 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:26.110 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:26.524 INFO:teuthology.orchestra.run.smithi120.stdout:generic/452 0s 2024-03-31T17:27:26.530 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/452 2024-03-31T17:27:26.530 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:26.532 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:26.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:26.542 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-03-31T17:27:26.717 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:26.721 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:26.721 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:26.722 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-03-31T17:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/453 2024-03-31T17:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/453 2024-03-31T17:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:26.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:26.939 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-03-31T17:27:27.113 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:27.117 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:27.117 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:27.118 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:27.118 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:27.338 INFO:teuthology.orchestra.run.smithi120.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-03-31T17:27:27.342 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/454 2024-03-31T17:27:27.342 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/454 2024-03-31T17:27:27.342 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:27.344 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:27.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:27.360 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-03-31T17:27:27.541 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:27.544 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:27.545 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:27.546 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:27.546 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:27.814 INFO:teuthology.orchestra.run.smithi120.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-31T17:27:27.818 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/455 2024-03-31T17:27:27.818 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/455 2024-03-31T17:27:27.818 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:27.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:27.835 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-03-31T17:27:28.012 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:28.016 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:28.016 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:28.017 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:28.017 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:28.251 INFO:teuthology.orchestra.run.smithi120.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T17:27:28.255 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/456 2024-03-31T17:27:28.255 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/456 2024-03-31T17:27:28.255 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:28.257 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:28.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:28.272 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-03-31T17:27:28.460 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:28.463 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:28.464 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:28.465 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:28.465 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:28.913 INFO:teuthology.orchestra.run.smithi120.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:27:28.920 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/457 2024-03-31T17:27:28.920 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/457 2024-03-31T17:27:28.920 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:29.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:29.134 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-03-31T17:27:29.406 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:29.410 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:29.411 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:29.412 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:29.412 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:29.767 INFO:teuthology.orchestra.run.smithi120.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T17:27:29.774 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/458 2024-03-31T17:27:29.774 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/458 2024-03-31T17:27:29.774 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:29.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:30.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:30.016 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-03-31T17:27:30.309 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:30.313 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:30.313 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:30.314 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:31.244 INFO:teuthology.orchestra.run.smithi120.stdout:generic/459 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:27:31.248 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/459 2024-03-31T17:27:31.248 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/459 2024-03-31T17:27:31.248 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:31.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:31.265 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-03-31T17:27:31.447 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:31.451 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:31.451 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:31.452 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:33.204 INFO:teuthology.orchestra.run.smithi120.stdout:generic/460 2s 2024-03-31T17:27:33.210 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/460 2024-03-31T17:27:33.210 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:33.212 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:33.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:33.220 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-03-31T17:27:33.399 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:33.403 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:33.403 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:33.404 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:33.405 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:33.775 INFO:teuthology.orchestra.run.smithi120.stdout:generic/461 [not run] ceph does not support shutdown 2024-03-31T17:27:33.782 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/461 2024-03-31T17:27:33.782 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/461 2024-03-31T17:27:33.783 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:33.788 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:33.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:33.808 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-03-31T17:27:34.074 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:34.077 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:34.078 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:34.079 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:34.079 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:34.360 INFO:teuthology.orchestra.run.smithi120.stdout:generic/462 [not run] mount 172.21.15.120:6789:/scratch with dax failed 2024-03-31T17:27:34.364 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/462 2024-03-31T17:27:34.364 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/462 2024-03-31T17:27:34.364 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:34.366 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:34.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:34.378 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-03-31T17:27:34.550 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:34.554 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:34.554 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:34.555 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:34.809 INFO:teuthology.orchestra.run.smithi120.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T17:27:34.813 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/463 2024-03-31T17:27:34.813 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/463 2024-03-31T17:27:34.813 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:27:34.815 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:27:34.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:27:34.889 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-03-31T17:27:35.309 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:27:35.316 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:27:35.317 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:27:35.318 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:27:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:31.845 INFO:teuthology.orchestra.run.smithi120.stdout:generic/464 56s 2024-03-31T17:28:31.850 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/464 2024-03-31T17:28:31.850 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:28:31.852 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:31.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:28:31.861 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-03-31T17:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:36.397 INFO:teuthology.orchestra.run.smithi120.stdout:generic/465 4s 2024-03-31T17:28:36.413 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/465 2024-03-31T17:28:36.413 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:28:36.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:36.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:28:36.431 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-03-31T17:28:36.793 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:28:36.797 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:28:36.798 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:28:36.799 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:28:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:37.041 INFO:teuthology.orchestra.run.smithi120.stdout:generic/466 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:28:37.044 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/466 2024-03-31T17:28:37.044 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/466 2024-03-31T17:28:37.044 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:28:37.046 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:37.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:28:37.058 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-03-31T17:28:37.235 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:28:37.239 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:28:37.239 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:28:37.240 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:28:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:49.899 INFO:teuthology.orchestra.run.smithi120.stdout:generic/467 12s 2024-03-31T17:28:50.021 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/467 2024-03-31T17:28:50.021 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:28:50.023 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:50.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:28:50.249 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-03-31T17:28:52.533 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:28:52.537 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:28:52.537 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:28:52.538 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:28:52.538 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:53.017 INFO:teuthology.orchestra.run.smithi120.stdout:generic/468 [not run] ceph does not support shutdown 2024-03-31T17:28:53.024 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/468 2024-03-31T17:28:53.024 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/468 2024-03-31T17:28:53.024 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:28:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:53.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:28:53.037 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-03-31T17:28:53.225 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:28:53.229 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:28:53.230 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:28:53.231 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:28:53.231 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:53.467 INFO:teuthology.orchestra.run.smithi120.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-31T17:28:53.471 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/469 2024-03-31T17:28:53.471 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/469 2024-03-31T17:28:53.471 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:28:53.473 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:53.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:28:53.485 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-03-31T17:28:53.677 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:28:53.681 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:28:53.681 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:28:53.682 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:28:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:54.003 INFO:teuthology.orchestra.run.smithi120.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-31T17:28:54.006 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/470 2024-03-31T17:28:54.007 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/470 2024-03-31T17:28:54.007 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:28:54.009 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:28:54.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:28:54.021 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-03-31T17:28:54.225 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:28:54.228 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:28:54.229 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:28:54.230 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:28:54.230 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:27.289 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:29:27.292 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:29:42.628 INFO:teuthology.orchestra.run.smithi120.stdout:generic/471 48s 2024-03-31T17:29:42.639 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/471 2024-03-31T17:29:42.639 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:29:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:42.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:29:42.843 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-03-31T17:29:43.411 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:29:43.417 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:29:43.418 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:29:43.420 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:29:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:43.963 INFO:teuthology.orchestra.run.smithi120.stdout:generic/472 [not run] swapfiles are not supported 2024-03-31T17:29:43.967 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/472 2024-03-31T17:29:43.967 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/472 2024-03-31T17:29:43.967 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:29:43.969 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:43.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:29:43.985 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-03-31T17:29:44.171 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:29:44.175 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:29:44.175 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:29:44.177 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:29:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:44.436 INFO:teuthology.orchestra.run.smithi120.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-31T17:29:44.440 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/473 2024-03-31T17:29:44.440 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/473 2024-03-31T17:29:44.440 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:29:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:44.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:29:44.459 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-03-31T17:29:44.639 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:29:44.643 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:29:44.643 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:29:44.644 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:29:44.645 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:44.936 INFO:teuthology.orchestra.run.smithi120.stdout:generic/474 [not run] ceph does not support shutdown 2024-03-31T17:29:44.944 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/474 2024-03-31T17:29:44.944 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/474 2024-03-31T17:29:44.944 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:29:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:44.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:29:44.958 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-03-31T17:29:45.153 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:29:45.157 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:29:45.157 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:29:45.158 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:29:45.158 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:45.399 INFO:teuthology.orchestra.run.smithi120.stdout:generic/475 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T17:29:45.403 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/475 2024-03-31T17:29:45.403 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/475 2024-03-31T17:29:45.403 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T17:29:45.405 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:45.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T17:29:45.418 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-03-31T17:29:45.603 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T17:29:45.606 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T17:29:45.607 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T17:29:45.608 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T17:29:45.608 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T17:29:57.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:29:57.753 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:30:28.159 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:30:28.163 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:30:58.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:30:58.253 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:31:28.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:31:28.360 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:31:58.650 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:31:58.653 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:32:28.896 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:32:28.900 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:32:58.977 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:32:58.983 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:33:29.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:33:29.112 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:33:59.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:33:59.182 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:34:29.603 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:34:29.606 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:34:59.713 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:34:59.716 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:35:29.915 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:35:29.919 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:36:00.079 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:36:00.083 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:36:30.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:36:30.177 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:37:00.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:37:00.575 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:37:30.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:37:30.765 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:38:00.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:38:00.858 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:38:30.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:38:30.967 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:39:01.061 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:39:01.066 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:39:01.142 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T17:39:01.141+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541873) UID: 0 2024-03-31T17:39:01.143 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T17:39:01.141+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541873) UID: 0 2024-03-31T17:39:01.146 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T17:39:01.145+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541873) UID: 0 2024-03-31T17:39:01.149 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T17:39:01.142+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541873) UID: 0 2024-03-31T17:43:46.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:43:46.801 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:43:46.868 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T17:43:46.867+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 541925) UID: 0 2024-03-31T17:43:46.868 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T17:43:46.868+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 541925) UID: 0 2024-03-31T17:49:20.381 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T17:49:20.379+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541967) UID: 0 2024-03-31T17:49:20.381 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T17:49:20.379+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541967) UID: 0 2024-03-31T17:49:20.382 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T17:49:20.379+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541967) UID: 0 2024-03-31T17:49:20.382 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T17:49:20.379+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 541967) UID: 0 2024-03-31T17:54:17.630 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:54:17.633 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T17:54:17.709 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T17:54:17.708+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49762) UID: 0 2024-03-31T17:54:17.713 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T17:54:17.712+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49762) UID: 0 2024-03-31T17:54:17.720 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T17:54:17.714+0000 7fb491d1e640 -1 Fail to open '/proc/49762/cmdline' error = (2) No such file or directory 2024-03-31T17:54:17.721 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T17:54:17.714+0000 7fb491d1e640 -1 received signal: Hangup from (PID: 49762) UID: 0 2024-03-31T17:54:17.725 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T17:54:17.724+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542042) UID: 0 2024-03-31T17:54:17.728 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T17:54:17.714+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49762) UID: 0 2024-03-31T17:54:17.731 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T17:54:17.724+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542042) UID: 0 2024-03-31T18:04:00.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:04:00.450 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:04:00.892 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T18:04:00.891+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542174) UID: 0 2024-03-31T18:04:00.892 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T18:04:00.891+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542174) UID: 0 2024-03-31T18:04:00.893 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T18:04:00.891+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542174) UID: 0 2024-03-31T18:04:00.893 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T18:04:00.891+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542174) UID: 0 2024-03-31T18:08:51.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:08:51.728 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:08:52.354 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T18:08:52.353+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542235) UID: 0 2024-03-31T18:08:52.355 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T18:08:52.355+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542235) UID: 0 2024-03-31T18:15:31.775 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T18:15:31.772+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542301) UID: 0 2024-03-31T18:15:31.776 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T18:15:31.772+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542301) UID: 0 2024-03-31T18:15:31.776 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T18:15:31.774+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542301) UID: 0 2024-03-31T18:15:31.776 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T18:15:31.774+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542301) UID: 0 2024-03-31T18:20:10.545 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:20:10.549 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:20:10.620 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T18:20:10.616+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50108) UID: 0 2024-03-31T18:20:10.623 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T18:20:10.623+0000 7f7fa48b1640 -1 Fail to open '/proc/50108/cmdline' error = (2) No such file or directory 2024-03-31T18:20:10.624 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T18:20:10.623+0000 7f7fa48b1640 -1 received signal: Hangup from (PID: 50108) UID: 0 2024-03-31T18:20:10.625 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T18:20:10.620+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50108) UID: 0 2024-03-31T18:20:10.629 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T18:20:10.625+0000 7fca0b2c1640 -1 Fail to open '/proc/50108/cmdline' error = (2) No such file or directory 2024-03-31T18:20:10.629 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T18:20:10.625+0000 7fca0b2c1640 -1 received signal: Hangup from (PID: 50108) UID: 0 2024-03-31T18:20:10.710 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T18:20:10.705+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542359) UID: 0 2024-03-31T18:20:10.716 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T18:20:10.711+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542359) UID: 0 2024-03-31T18:25:58.145 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T18:25:58.143+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542401) UID: 0 2024-03-31T18:25:58.146 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T18:25:58.146+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542401) UID: 0 2024-03-31T18:25:58.147 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T18:25:58.146+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542401) UID: 0 2024-03-31T18:25:58.149 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T18:25:58.148+0000 7f67f523c640 -1 Fail to open '/proc/542401/cmdline' error = (2) No such file or directory 2024-03-31T18:25:58.149 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T18:25:58.148+0000 7f67f523c640 -1 received signal: Hangup from (PID: 542401) UID: 0 2024-03-31T18:31:35.736 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:31:35.740 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:31:35.777 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T18:31:35.776+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542438) UID: 0 2024-03-31T18:31:35.777 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T18:31:35.776+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542438) UID: 0 2024-03-31T18:37:21.071 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T18:37:21.070+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542473) UID: 0 2024-03-31T18:37:21.072 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T18:37:21.070+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542473) UID: 0 2024-03-31T18:37:21.072 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T18:37:21.070+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542473) UID: 0 2024-03-31T18:37:21.072 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T18:37:21.071+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542473) UID: 0 2024-03-31T18:42:12.110 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:42:12.115 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:42:12.165 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T18:42:12.163+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50478) UID: 0 2024-03-31T18:42:12.165 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T18:42:12.164+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50478) UID: 0 2024-03-31T18:42:12.169 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T18:42:12.164+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50478) UID: 0 2024-03-31T18:42:12.180 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T18:42:12.179+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542547) UID: 0 2024-03-31T18:42:12.180 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T18:42:12.164+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50478) UID: 0 2024-03-31T18:42:12.186 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T18:42:12.186+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542547) UID: 0 2024-03-31T18:48:09.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:48:09.490 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:48:09.527 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T18:48:09.527+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50551) UID: 0 2024-03-31T18:48:09.527 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T18:48:09.527+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50551) UID: 0 2024-03-31T18:48:09.528 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T18:48:09.528+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50551) UID: 0 2024-03-31T18:48:09.528 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T18:48:09.528+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50551) UID: 0 2024-03-31T18:49:00.705 INFO:teuthology.orchestra.run.smithi120.stdout:generic/476 4755s 2024-03-31T18:49:00.760 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/476 2024-03-31T18:49:00.760 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:49:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:49:00.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:49:00.793 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-03-31T18:49:07.021 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:49:07.025 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:49:07.025 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:49:07.026 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:49:07.026 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:53:50.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:53:50.926 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T18:53:50.980 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T18:53:50.981+0000 7ff86c86b640 -1 Fail to open '/proc/542956/cmdline' error = (2) No such file or directory 2024-03-31T18:53:50.980 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T18:53:50.981+0000 7ff86c86b640 -1 received signal: Hangup from (PID: 542956) UID: 0 2024-03-31T18:53:50.981 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T18:53:50.981+0000 7f9e83ed4640 -1 Fail to open '/proc/542956/cmdline' error = (2) No such file or directory 2024-03-31T18:53:50.981 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T18:53:50.981+0000 7f9e83ed4640 -1 received signal: Hangup from (PID: 542956) UID: 0 2024-03-31T18:56:24.227 INFO:teuthology.orchestra.run.smithi120.stdout:generic/477 23s 2024-03-31T18:56:24.372 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/477 2024-03-31T18:56:24.372 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:24.375 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:24.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:24.574 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-03-31T18:56:27.178 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:27.183 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:27.184 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:27.185 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:38.084 INFO:teuthology.orchestra.run.smithi120.stdout:generic/478 11s 2024-03-31T18:56:38.091 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/478 2024-03-31T18:56:38.092 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:38.094 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:38.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:38.124 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-03-31T18:56:38.429 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:38.435 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:38.435 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:38.437 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:38.437 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:38.934 INFO:teuthology.orchestra.run.smithi120.stdout:generic/479 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:38.944 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/479 2024-03-31T18:56:38.944 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/479 2024-03-31T18:56:38.944 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:38.947 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:38.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:38.980 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-03-31T18:56:39.281 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:39.295 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:39.299 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:39.301 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:39.301 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:39.719 INFO:teuthology.orchestra.run.smithi120.stdout:generic/480 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:39.724 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/480 2024-03-31T18:56:39.724 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/480 2024-03-31T18:56:39.725 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:39.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:39.765 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-03-31T18:56:40.083 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:40.088 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:40.089 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:40.092 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:40.092 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:40.445 INFO:teuthology.orchestra.run.smithi120.stdout:generic/481 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:40.450 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/481 2024-03-31T18:56:40.450 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/481 2024-03-31T18:56:40.450 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:40.452 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:40.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:40.474 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-03-31T18:56:40.785 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:40.789 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:40.790 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:40.791 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:40.791 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:41.184 INFO:teuthology.orchestra.run.smithi120.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-31T18:56:41.189 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/482 2024-03-31T18:56:41.189 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/482 2024-03-31T18:56:41.189 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:41.192 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:41.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:41.217 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-03-31T18:56:41.532 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:41.537 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:41.540 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:41.540 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:41.540 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:41.904 INFO:teuthology.orchestra.run.smithi120.stdout:generic/483 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:41.911 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/483 2024-03-31T18:56:41.911 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/483 2024-03-31T18:56:41.911 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:41.913 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:41.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:41.940 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-03-31T18:56:42.278 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:42.284 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:42.284 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:42.285 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:42.286 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:42.663 INFO:teuthology.orchestra.run.smithi120.stdout:generic/484 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:42.668 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/484 2024-03-31T18:56:42.668 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/484 2024-03-31T18:56:42.668 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:42.672 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:42.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:42.697 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-03-31T18:56:43.016 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:43.022 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:43.022 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:43.023 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:43.374 INFO:teuthology.orchestra.run.smithi120.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-31T18:56:43.380 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/485 2024-03-31T18:56:43.380 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/485 2024-03-31T18:56:43.380 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:43.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:43.412 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-03-31T18:56:43.695 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:43.701 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:43.702 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:43.706 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:43.707 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:44.472 INFO:teuthology.orchestra.run.smithi120.stdout:generic/486 1s 2024-03-31T18:56:44.486 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/486 2024-03-31T18:56:44.486 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:44.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:44.498 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-03-31T18:56:44.805 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:44.811 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:44.813 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:44.815 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:44.815 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:45.231 INFO:teuthology.orchestra.run.smithi120.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-03-31T18:56:45.236 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/487 2024-03-31T18:56:45.236 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/487 2024-03-31T18:56:45.236 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:45.239 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:45.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:45.273 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-03-31T18:56:45.565 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:45.570 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:45.570 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:45.571 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:45.572 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:46.013 INFO:teuthology.orchestra.run.smithi120.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T18:56:46.019 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/488 2024-03-31T18:56:46.019 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/488 2024-03-31T18:56:46.019 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:46.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:46.048 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-03-31T18:56:46.389 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:46.395 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:46.395 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:46.397 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:46.397 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:46.764 INFO:teuthology.orchestra.run.smithi120.stdout:generic/489 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:46.769 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/489 2024-03-31T18:56:46.769 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/489 2024-03-31T18:56:46.769 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:46.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:46.795 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-03-31T18:56:47.080 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:47.085 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:47.086 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:47.088 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:49.399 INFO:teuthology.orchestra.run.smithi120.stdout:generic/490 2s 2024-03-31T18:56:49.414 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/490 2024-03-31T18:56:49.414 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:49.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:49.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:49.499 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-03-31T18:56:49.929 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:49.937 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:49.938 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:49.939 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:49.939 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:50.431 INFO:teuthology.orchestra.run.smithi120.stdout:generic/491 [not run] ceph does not support freezing 2024-03-31T18:56:50.436 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/491 2024-03-31T18:56:50.436 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/491 2024-03-31T18:56:50.436 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:50.438 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:50.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:50.470 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-03-31T18:56:50.753 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:50.759 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:50.759 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:50.764 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:50.764 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:51.174 INFO:teuthology.orchestra.run.smithi120.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-03-31T18:56:51.180 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/492 2024-03-31T18:56:51.180 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/492 2024-03-31T18:56:51.180 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:51.184 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:51.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:51.205 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-03-31T18:56:51.504 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:51.509 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:51.510 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:51.512 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:51.512 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:52.144 INFO:teuthology.orchestra.run.smithi120.stdout:generic/493 [not run] swapfiles are not supported 2024-03-31T18:56:52.150 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/493 2024-03-31T18:56:52.150 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/493 2024-03-31T18:56:52.150 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:52.153 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:52.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:52.183 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-03-31T18:56:52.475 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:52.481 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:52.481 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:52.482 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:53.020 INFO:teuthology.orchestra.run.smithi120.stdout:generic/494 [not run] swapfiles are not supported 2024-03-31T18:56:53.025 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/494 2024-03-31T18:56:53.025 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/494 2024-03-31T18:56:53.025 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:53.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:53.060 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-03-31T18:56:53.369 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:53.379 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:53.379 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:53.381 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:53.932 INFO:teuthology.orchestra.run.smithi120.stdout:generic/495 [not run] swapfiles are not supported 2024-03-31T18:56:53.937 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/495 2024-03-31T18:56:53.938 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/495 2024-03-31T18:56:53.938 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:53.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:53.970 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-03-31T18:56:54.265 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:54.271 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:54.272 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:54.273 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:54.273 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:54.788 INFO:teuthology.orchestra.run.smithi120.stdout:generic/496 [not run] swapfiles are not supported 2024-03-31T18:56:54.793 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/496 2024-03-31T18:56:54.793 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/496 2024-03-31T18:56:54.793 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:54.796 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:54.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:54.820 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-03-31T18:56:55.108 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:55.113 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:55.113 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:55.114 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:55.641 INFO:teuthology.orchestra.run.smithi120.stdout:generic/497 [not run] swapfiles are not supported 2024-03-31T18:56:55.648 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/497 2024-03-31T18:56:55.648 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/497 2024-03-31T18:56:55.648 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:55.651 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:55.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:55.677 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-03-31T18:56:55.980 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:55.985 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:55.986 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:55.987 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:55.987 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:56.371 INFO:teuthology.orchestra.run.smithi120.stdout:generic/498 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:56.425 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/498 2024-03-31T18:56:56.425 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/498 2024-03-31T18:56:56.425 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:56.425 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:56.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:56.426 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-03-31T18:56:56.756 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:56.761 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:56.761 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:56.763 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:56.763 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:57.098 INFO:teuthology.orchestra.run.smithi120.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-31T18:56:57.104 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/499 2024-03-31T18:56:57.104 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/499 2024-03-31T18:56:57.104 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:57.107 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:57.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:57.135 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-03-31T18:56:57.430 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:57.434 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:57.435 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:57.436 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:57.436 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:57.814 INFO:teuthology.orchestra.run.smithi120.stdout:generic/500 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:57.822 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/500 2024-03-31T18:56:57.822 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/500 2024-03-31T18:56:57.822 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:57.823 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:57.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:57.847 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-03-31T18:56:58.143 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:58.151 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:58.151 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:58.152 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:58.153 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:58.730 INFO:teuthology.orchestra.run.smithi120.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T18:56:58.736 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/501 2024-03-31T18:56:58.736 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/501 2024-03-31T18:56:58.736 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:58.739 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:59.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:59.160 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-03-31T18:56:59.445 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:56:59.450 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:56:59.450 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:56:59.452 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:56:59.452 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:59.843 INFO:teuthology.orchestra.run.smithi120.stdout:generic/502 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:56:59.849 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/502 2024-03-31T18:56:59.849 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/502 2024-03-31T18:56:59.850 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:56:59.853 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:56:59.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:56:59.883 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-03-31T18:57:00.183 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:00.188 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:00.188 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:00.190 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:00.555 INFO:teuthology.orchestra.run.smithi120.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T18:57:00.561 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/503 2024-03-31T18:57:00.561 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/503 2024-03-31T18:57:00.561 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:00.564 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:00.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:00.600 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-03-31T18:57:00.903 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:00.909 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:00.909 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:00.911 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:00.911 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:01.316 INFO:teuthology.orchestra.run.smithi120.stdout:generic/504 0s 2024-03-31T18:57:01.324 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/504 2024-03-31T18:57:01.324 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:01.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:01.356 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-03-31T18:57:01.652 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:01.661 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:01.662 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:01.664 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:01.664 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:02.103 INFO:teuthology.orchestra.run.smithi120.stdout:generic/505 [not run] ceph does not support shutdown 2024-03-31T18:57:02.122 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/505 2024-03-31T18:57:02.122 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/505 2024-03-31T18:57:02.122 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:02.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:02.147 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-03-31T18:57:02.456 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:02.463 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:02.464 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:02.465 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:02.465 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:02.800 INFO:teuthology.orchestra.run.smithi120.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T18:57:02.804 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/506 2024-03-31T18:57:02.804 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/506 2024-03-31T18:57:02.804 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:02.808 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:02.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:02.831 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-03-31T18:57:03.117 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:03.126 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:03.127 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:03.130 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:03.130 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:03.508 INFO:teuthology.orchestra.run.smithi120.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-03-31T18:57:03.514 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/507 2024-03-31T18:57:03.514 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/507 2024-03-31T18:57:03.514 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:03.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:03.551 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-03-31T18:57:03.854 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:03.859 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:03.860 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:03.861 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:03.862 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:04.185 INFO:teuthology.orchestra.run.smithi120.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-03-31T18:57:04.189 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/508 2024-03-31T18:57:04.189 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/508 2024-03-31T18:57:04.189 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:04.191 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:04.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:04.213 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-03-31T18:57:04.510 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:04.516 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:04.516 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:04.518 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:04.518 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:04.882 INFO:teuthology.orchestra.run.smithi120.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-03-31T18:57:04.888 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/509 2024-03-31T18:57:04.888 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/509 2024-03-31T18:57:04.888 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:04.891 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:04.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:04.921 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-03-31T18:57:05.207 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:05.212 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:05.212 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:05.214 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:05.214 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:05.567 INFO:teuthology.orchestra.run.smithi120.stdout:generic/510 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:57:05.573 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/510 2024-03-31T18:57:05.573 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/510 2024-03-31T18:57:05.573 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:05.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:05.596 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-03-31T18:57:05.892 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:05.903 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:05.903 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:05.904 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:06.236 INFO:teuthology.orchestra.run.smithi120.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-31T18:57:06.242 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/511 2024-03-31T18:57:06.242 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/511 2024-03-31T18:57:06.242 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:06.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:06.282 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-03-31T18:57:06.588 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:06.593 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:06.593 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:06.594 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:06.968 INFO:teuthology.orchestra.run.smithi120.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T18:57:06.973 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/512 2024-03-31T18:57:06.973 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/512 2024-03-31T18:57:06.973 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:06.976 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:07.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:07.003 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-03-31T18:57:07.311 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:07.318 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:07.318 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:07.320 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:07.320 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:07.884 INFO:teuthology.orchestra.run.smithi120.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T18:57:07.893 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/513 2024-03-31T18:57:07.893 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/513 2024-03-31T18:57:07.893 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:07.897 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:08.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:08.168 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-03-31T18:57:08.522 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:08.529 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:08.530 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:08.532 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:08.532 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:09.073 INFO:teuthology.orchestra.run.smithi120.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T18:57:09.084 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/514 2024-03-31T18:57:09.084 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/514 2024-03-31T18:57:09.085 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:09.089 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:09.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:09.325 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-03-31T18:57:09.685 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:09.689 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:09.690 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:09.691 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:09.691 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:10.248 INFO:teuthology.orchestra.run.smithi120.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T18:57:10.253 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/515 2024-03-31T18:57:10.253 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/515 2024-03-31T18:57:10.254 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:10.257 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:10.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:10.467 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-03-31T18:57:10.820 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:10.829 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:10.833 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:10.834 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:10.835 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:11.246 INFO:teuthology.orchestra.run.smithi120.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-31T18:57:11.250 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/516 2024-03-31T18:57:11.250 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/516 2024-03-31T18:57:11.251 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:11.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:11.324 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-03-31T18:57:11.757 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:11.763 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:11.763 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:11.765 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:11.765 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:12.330 INFO:teuthology.orchestra.run.smithi120.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-31T18:57:12.376 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/517 2024-03-31T18:57:12.377 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/517 2024-03-31T18:57:12.377 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:12.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:12.520 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-03-31T18:57:13.046 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:13.056 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:13.057 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:13.060 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:13.060 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:13.623 INFO:teuthology.orchestra.run.smithi120.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T18:57:13.633 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/518 2024-03-31T18:57:13.633 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/518 2024-03-31T18:57:13.633 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:13.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:13.802 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-03-31T18:57:14.169 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:14.186 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:14.186 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:14.187 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:14.582 INFO:teuthology.orchestra.run.smithi120.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-03-31T18:57:14.587 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/519 2024-03-31T18:57:14.587 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/519 2024-03-31T18:57:14.587 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:14.592 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:14.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:14.657 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-03-31T18:57:15.125 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:15.134 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:15.134 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:15.135 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:15.489 INFO:teuthology.orchestra.run.smithi120.stdout:generic/520 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T18:57:15.493 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/520 2024-03-31T18:57:15.494 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/520 2024-03-31T18:57:15.494 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T18:57:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T18:57:15.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T18:57:15.519 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-03-31T18:57:15.784 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T18:57:15.791 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T18:57:15.791 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T18:57:15.793 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T18:57:15.793 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T19:01:37.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:01:37.844 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:02:08.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:02:08.005 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:02:38.073 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:02:38.077 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:03:08.187 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:03:08.190 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:03:38.292 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:03:38.296 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:04:08.423 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:04:08.429 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:04:38.508 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:04:38.510 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:05:08.597 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:05:08.600 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:05:38.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:05:38.669 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:06:08.800 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:06:08.803 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:06:38.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:06:38.876 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:07:09.214 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:07:09.217 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:07:39.384 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:07:39.387 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:08:09.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:08:09.477 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:08:09.545 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T19:08:09.544+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 564686) UID: 0 2024-03-31T19:08:09.546 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T19:08:09.544+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 564686) UID: 0 2024-03-31T19:08:09.546 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T19:08:09.545+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 564686) UID: 0 2024-03-31T19:08:09.546 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T19:08:09.545+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 564686) UID: 0 2024-03-31T19:11:39.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:11:39.957 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:11:40.007 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T19:11:40.006+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 564726) UID: 0 2024-03-31T19:11:40.007 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T19:11:40.006+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 564726) UID: 0 2024-03-31T19:11:40.007 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T19:11:40.006+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 564726) UID: 0 2024-03-31T19:11:40.013 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T19:11:40.006+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 564726) UID: 0 2024-03-31T19:15:06.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:15:06.747 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:15:36.823 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:15:36.826 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:16:06.903 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:16:06.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:16:37.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:16:37.060 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:17:07.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:17:07.144 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:17:37.236 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:17:37.239 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:18:07.304 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:18:07.307 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:18:37.385 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:18:37.389 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:19:07.458 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:19:07.461 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:19:37.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:19:37.746 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:20:07.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:20:07.845 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:20:37.955 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:20:37.959 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:21:08.027 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:21:08.030 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:21:08.075 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T19:21:08.075+0000 7f4dc118c640 -1 Fail to open '/proc/51147/cmdline' error = (2) No such file or directory 2024-03-31T19:21:08.075 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T19:21:08.075+0000 7f4dc118c640 -1 received signal: Hangup from (PID: 51147) UID: 0 2024-03-31T19:21:08.075 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T19:21:08.076+0000 7fb491d1e640 -1 Fail to open '/proc/51147/cmdline' error = (2) No such file or directory 2024-03-31T19:21:08.075 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T19:21:08.076+0000 7fb491d1e640 -1 received signal: Hangup from (PID: 51147) UID: 0 2024-03-31T19:21:08.076 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T19:21:08.075+0000 7fca0b2c1640 -1 received signal: Hangup from (PID: 51147) UID: 0 2024-03-31T19:21:08.076 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T19:21:08.074+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51147) UID: 0 2024-03-31T19:24:06.416 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:24:06.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:24:36.546 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:24:36.550 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:25:06.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:25:06.623 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:25:06.667 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T19:25:06.666+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565025) UID: 0 2024-03-31T19:25:06.667 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T19:25:06.666+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565025) UID: 0 2024-03-31T19:25:06.667 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T19:25:06.667+0000 7effe18db640 -1 received signal: Hangup from (PID: 565025) UID: 0 2024-03-31T19:25:06.668 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T19:25:06.666+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565025) UID: 0 2024-03-31T19:28:22.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:28:22.522 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:28:52.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:28:52.681 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:29:22.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:29:22.843 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:29:52.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:29:52.941 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:30:23.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:30:23.043 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:30:53.150 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:30:53.155 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:31:23.268 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:31:23.274 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:31:53.699 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:31:53.702 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:31:53.743 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T19:31:53.742+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51358) UID: 0 2024-03-31T19:31:53.743 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T19:31:53.742+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51358) UID: 0 2024-03-31T19:31:53.744 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T19:31:53.742+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51358) UID: 0 2024-03-31T19:31:53.744 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T19:31:53.743+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51358) UID: 0 2024-03-31T19:35:04.098 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:35:04.103 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:35:04.166 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T19:35:04.166+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 565197) UID: 0 2024-03-31T19:35:04.166 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T19:35:04.166+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 565197) UID: 0 2024-03-31T19:37:56.346 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T19:37:56.346+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565201) UID: 0 2024-03-31T19:37:56.347 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T19:37:56.345+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565201) UID: 0 2024-03-31T19:37:56.347 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T19:37:56.346+0000 7f67f523c640 -1 received signal: Hangup from (PID: 565201) UID: 0 2024-03-31T19:37:56.348 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T19:37:56.346+0000 7f421f549640 -1 Fail to open '/proc/565201/cmdline' error = (2) No such file or directory 2024-03-31T19:37:56.348 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T19:37:56.346+0000 7f421f549640 -1 received signal: Hangup from (PID: 565201) UID: 0 2024-03-31T19:41:23.440 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:41:23.444 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:41:23.477 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T19:41:23.477+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51404) UID: 0 2024-03-31T19:41:23.477 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T19:41:23.477+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51404) UID: 0 2024-03-31T19:41:23.478 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T19:41:23.477+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51404) UID: 0 2024-03-31T19:41:23.478 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T19:41:23.477+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51404) UID: 0 2024-03-31T19:47:42.442 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:47:42.445 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:47:42.486 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T19:47:42.488+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565249) UID: 0 2024-03-31T19:47:42.487 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T19:47:42.488+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565249) UID: 0 2024-03-31T19:47:42.487 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T19:47:42.487+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565249) UID: 0 2024-03-31T19:47:42.487 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T19:47:42.487+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565249) UID: 0 2024-03-31T19:50:57.757 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:50:57.760 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:50:57.804 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T19:50:57.804+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51451) UID: 0 2024-03-31T19:50:57.804 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T19:50:57.804+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51451) UID: 0 2024-03-31T19:50:57.805 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T19:50:57.804+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51451) UID: 0 2024-03-31T19:50:57.805 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T19:50:57.804+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51451) UID: 0 2024-03-31T19:54:08.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:54:08.631 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:54:38.734 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:54:38.738 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:55:08.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:55:08.830 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:55:38.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:55:38.917 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:56:09.033 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:56:09.036 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:56:39.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:56:39.177 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:57:09.431 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:57:09.435 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:57:39.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:57:39.711 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:58:09.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:58:09.787 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:58:39.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:58:39.916 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:59:09.989 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:59:09.992 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:59:40.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T19:59:40.128 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:00:10.242 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:00:10.246 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:00:40.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:00:40.402 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:01:10.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:01:10.713 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:01:40.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:01:40.823 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:02:11.276 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:02:11.281 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:02:41.589 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:02:41.592 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:03:11.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:03:11.676 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:03:41.814 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:03:41.818 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:04:12.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:04:12.048 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:04:42.150 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:04:42.153 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:05:12.273 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:05:12.277 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:05:42.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:05:42.415 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:06:12.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:06:12.796 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:06:42.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:06:42.884 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:07:12.998 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:07:13.002 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:07:43.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:07:43.063 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:08:13.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:08:13.201 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:08:43.303 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:08:43.306 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:09:13.418 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:09:13.420 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:09:43.499 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:09:43.502 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:10:14.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:10:14.037 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:10:44.105 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:10:44.108 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:11:14.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:11:14.272 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:11:44.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:11:44.342 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:12:14.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:12:14.773 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:12:14.811 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T20:12:14.810+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565965) UID: 0 2024-03-31T20:12:14.811 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T20:12:14.810+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565965) UID: 0 2024-03-31T20:12:14.812 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T20:12:14.810+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565965) UID: 0 2024-03-31T20:12:14.812 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T20:12:14.810+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565965) UID: 0 2024-03-31T20:18:11.927 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:18:11.930 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:18:42.073 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:18:42.076 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:19:12.453 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:19:12.456 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:19:12.498 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T20:19:12.497+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52206) UID: 0 2024-03-31T20:19:12.499 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T20:19:12.497+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52206) UID: 0 2024-03-31T20:19:12.499 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T20:19:12.497+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52206) UID: 0 2024-03-31T20:19:12.500 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T20:19:12.497+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52206) UID: 0 2024-03-31T20:22:07.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:22:07.465 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:22:07.501 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T20:22:07.500+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52230) UID: 0 2024-03-31T20:22:07.501 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T20:22:07.500+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52230) UID: 0 2024-03-31T20:22:07.502 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T20:22:07.500+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52230) UID: 0 2024-03-31T20:22:07.502 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T20:22:07.501+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52230) UID: 0 2024-03-31T20:23:32.584 INFO:teuthology.orchestra.run.smithi120.stdout:generic/521 5177s 2024-03-31T20:23:32.600 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/521 2024-03-31T20:23:32.600 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T20:23:32.603 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T20:23:32.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T20:23:32.643 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-03-31T20:23:33.072 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T20:23:33.079 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T20:23:33.080 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T20:23:33.082 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T20:23:33.082 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T20:25:17.624 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:25:17.628 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:25:17.678 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T20:25:17.678+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566547) UID: 0 2024-03-31T20:25:17.678 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T20:25:17.678+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566547) UID: 0 2024-03-31T20:25:17.678 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T20:25:17.678+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566547) UID: 0 2024-03-31T20:25:17.679 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T20:25:17.678+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566547) UID: 0 2024-03-31T20:28:35.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:28:35.332 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:28:35.376 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T20:28:35.376+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52271) UID: 0 2024-03-31T20:28:35.377 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T20:28:35.376+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52271) UID: 0 2024-03-31T20:28:35.378 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T20:28:35.377+0000 7f4dc118c640 -1 Fail to open '/proc/52271/cmdline' error = (2) No such file or directory 2024-03-31T20:28:35.378 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T20:28:35.377+0000 7f4dc118c640 -1 received signal: Hangup from (PID: 52271) UID: 0 2024-03-31T20:28:35.379 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T20:28:35.379+0000 7fca0b2c1640 -1 Fail to open '/proc/52271/cmdline' error = (2) No such file or directory 2024-03-31T20:28:35.380 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T20:28:35.379+0000 7fca0b2c1640 -1 received signal: Hangup from (PID: 52271) UID: 0 2024-03-31T20:31:26.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:31:26.999 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:31:57.106 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:31:57.109 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:32:27.534 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:32:27.539 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:32:57.839 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:32:57.842 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:33:28.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:33:28.157 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:33:58.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:33:58.531 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:34:28.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:34:28.799 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:34:58.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:34:58.880 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:35:28.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:35:28.969 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:35:59.072 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:35:59.076 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:36:29.142 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:36:29.145 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:36:59.218 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:36:59.221 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:37:29.349 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:37:29.352 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:37:59.464 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:37:59.467 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:38:29.602 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:38:29.607 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:38:59.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:38:59.672 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:39:29.782 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:39:29.785 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:39:59.920 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:39:59.925 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:40:30.011 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:40:30.017 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:41:00.108 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:41:00.111 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:41:30.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:41:30.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:42:00.552 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:42:00.556 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:42:30.693 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:42:30.696 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:43:00.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:43:00.860 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:43:30.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:43:31.001 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:44:01.108 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:44:01.111 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:44:01.169 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T20:44:01.170+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 567050) UID: 0 2024-03-31T20:44:01.170 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T20:44:01.170+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 567050) UID: 0 2024-03-31T20:47:40.974 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:47:40.977 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:48:11.278 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:48:11.281 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:48:41.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:48:41.364 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:49:11.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:49:11.736 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:49:41.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:49:41.892 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:50:12.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:50:12.043 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:50:42.158 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:50:42.161 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:51:12.238 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:51:12.242 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:51:42.581 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:51:42.586 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:52:12.653 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:52:12.657 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:52:42.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:52:42.745 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:53:12.844 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:53:12.849 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:53:42.942 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:53:42.946 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:54:13.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:54:13.094 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:54:43.175 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:54:43.178 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:54:43.219 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T20:54:43.219+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567329) UID: 0 2024-03-31T20:54:43.219 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T20:54:43.220+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567329) UID: 0 2024-03-31T20:54:43.220 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T20:54:43.220+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567329) UID: 0 2024-03-31T20:54:43.220 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T20:54:43.220+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567329) UID: 0 2024-03-31T20:58:03.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:58:03.459 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T20:58:03.494 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T20:58:03.495+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53050) UID: 0 2024-03-31T20:58:03.495 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T20:58:03.495+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53050) UID: 0 2024-03-31T20:58:03.495 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T20:58:03.495+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53050) UID: 0 2024-03-31T20:58:03.495 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T20:58:03.495+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53050) UID: 0 2024-03-31T20:58:03.503 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T20:58:03.505+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567353) UID: 0 2024-03-31T20:58:03.503 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T20:58:03.505+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567353) UID: 0 2024-03-31T20:58:03.504 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T20:58:03.505+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567353) UID: 0 2024-03-31T20:58:03.504 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T20:58:03.506+0000 7f421f549640 -1 Fail to open '/proc/567353/cmdline' error = (2) No such file or directory 2024-03-31T20:58:03.504 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T20:58:03.506+0000 7f421f549640 -1 received signal: Hangup from (PID: 567353) UID: 0 2024-03-31T21:04:36.347 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:04:36.351 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:04:36.389 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T21:04:36.389+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53087) UID: 0 2024-03-31T21:04:36.389 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T21:04:36.389+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53087) UID: 0 2024-03-31T21:04:36.389 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T21:04:36.389+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53087) UID: 0 2024-03-31T21:04:36.390 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T21:04:36.389+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53087) UID: 0 2024-03-31T21:07:37.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:07:37.491 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:08:07.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:08:07.701 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:08:37.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:08:37.823 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:09:08.146 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:09:08.151 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:09:08.186 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T21:09:08.186+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53165) UID: 0 2024-03-31T21:09:08.186 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T21:09:08.186+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53165) UID: 0 2024-03-31T21:09:08.186 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T21:09:08.186+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53165) UID: 0 2024-03-31T21:09:08.187 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T21:09:08.186+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53165) UID: 0 2024-03-31T21:12:09.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:12:09.092 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:12:39.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:12:39.170 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:13:09.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:13:09.311 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:13:39.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:13:39.641 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:13:39.687 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T21:13:39.687+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567556) UID: 0 2024-03-31T21:13:39.687 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T21:13:39.687+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567556) UID: 0 2024-03-31T21:13:39.688 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T21:13:39.687+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567556) UID: 0 2024-03-31T21:13:39.689 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T21:13:39.688+0000 7fd012219640 -1 Fail to open '/proc/567556/cmdline' error = (2) No such file or directory 2024-03-31T21:13:39.689 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T21:13:39.688+0000 7fd012219640 -1 received signal: Hangup from (PID: 567556) UID: 0 2024-03-31T21:16:59.491 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:16:59.493 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:16:59.531 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T21:16:59.531+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53266) UID: 0 2024-03-31T21:16:59.531 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T21:16:59.531+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53266) UID: 0 2024-03-31T21:16:59.532 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T21:16:59.531+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53266) UID: 0 2024-03-31T21:16:59.532 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T21:16:59.531+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53266) UID: 0 2024-03-31T21:19:52.956 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:19:52.960 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:20:23.043 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:20:23.046 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:20:46.319 INFO:teuthology.orchestra.run.smithi120.stdout:generic/522 3433s 2024-03-31T21:20:46.338 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/522 2024-03-31T21:20:46.338 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:46.341 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:46.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:46.373 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-03-31T21:20:46.629 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:46.634 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:46.634 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:46.635 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:46.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:47.205 INFO:teuthology.orchestra.run.smithi120.stdout:generic/523 1s 2024-03-31T21:20:47.213 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/523 2024-03-31T21:20:47.214 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:47.217 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:47.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:47.227 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-03-31T21:20:47.481 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:47.486 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:47.486 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:47.487 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:47.488 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:51.497 INFO:teuthology.orchestra.run.smithi120.stdout:generic/524 4s 2024-03-31T21:20:51.503 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/524 2024-03-31T21:20:51.503 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:51.509 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:51.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:51.517 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-03-31T21:20:51.789 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:51.795 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:51.795 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:51.796 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:51.797 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:52.236 INFO:teuthology.orchestra.run.smithi120.stdout:generic/525 [not run] filesystem does not support huge file size 2024-03-31T21:20:52.250 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/525 2024-03-31T21:20:52.250 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/525 2024-03-31T21:20:52.251 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:52.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:52.278 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-03-31T21:20:52.534 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:52.537 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:52.537 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:52.539 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:52.539 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:52.914 INFO:teuthology.orchestra.run.smithi120.stdout:generic/526 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:20:52.919 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/526 2024-03-31T21:20:52.919 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/526 2024-03-31T21:20:52.919 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:52.922 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:52.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:52.951 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-03-31T21:20:53.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:20:53.159 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:20:53.221 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:53.226 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:53.226 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:53.227 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:53.228 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:53.599 INFO:teuthology.orchestra.run.smithi120.stdout:generic/527 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:20:53.604 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/527 2024-03-31T21:20:53.604 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/527 2024-03-31T21:20:53.604 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:53.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:53.633 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-03-31T21:20:53.889 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:53.894 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:53.894 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:53.896 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:54.555 INFO:teuthology.orchestra.run.smithi120.stdout:generic/528 0s 2024-03-31T21:20:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/528 2024-03-31T21:20:54.568 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:54.571 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:54.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:54.611 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-03-31T21:20:55.050 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:55.056 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:55.057 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:55.058 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:56.212 INFO:teuthology.orchestra.run.smithi120.stdout:generic/529 1s 2024-03-31T21:20:56.223 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/529 2024-03-31T21:20:56.223 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:56.227 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:56.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:56.240 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-03-31T21:20:56.487 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:56.491 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:56.491 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:56.492 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:57.050 INFO:teuthology.orchestra.run.smithi120.stdout:generic/530 [not run] ceph does not support shutdown 2024-03-31T21:20:57.065 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/530 2024-03-31T21:20:57.066 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/530 2024-03-31T21:20:57.066 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:57.069 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:57.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:57.092 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-03-31T21:20:57.338 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:57.351 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:57.352 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:57.353 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:57.668 INFO:teuthology.orchestra.run.smithi120.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-03-31T21:20:57.673 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/531 2024-03-31T21:20:57.673 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/531 2024-03-31T21:20:57.674 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:57.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:57.700 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-03-31T21:20:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:57.956 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:58.319 INFO:teuthology.orchestra.run.smithi120.stdout:generic/532 0s 2024-03-31T21:20:58.326 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/532 2024-03-31T21:20:58.326 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:58.328 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:58.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:58.347 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-03-31T21:20:58.610 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:58.617 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:58.619 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:58.621 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:58.621 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:59.585 INFO:teuthology.orchestra.run.smithi120.stdout:generic/533 1s 2024-03-31T21:20:59.593 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/533 2024-03-31T21:20:59.593 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:20:59.596 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:20:59.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:20:59.614 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-03-31T21:20:59.872 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:20:59.877 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:20:59.878 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:20:59.879 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:20:59.879 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:00.213 INFO:teuthology.orchestra.run.smithi120.stdout:generic/534 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:21:00.218 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/534 2024-03-31T21:21:00.218 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/534 2024-03-31T21:21:00.218 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:21:00.220 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:00.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:21:00.241 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-03-31T21:21:00.506 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:21:00.510 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:21:00.511 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:21:00.512 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:21:00.512 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:00.821 INFO:teuthology.orchestra.run.smithi120.stdout:generic/535 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:21:00.826 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/535 2024-03-31T21:21:00.826 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/535 2024-03-31T21:21:00.826 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:21:00.828 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:00.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:21:00.847 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-03-31T21:21:01.102 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:21:01.107 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:21:01.108 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:21:01.108 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:21:01.109 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:01.494 INFO:teuthology.orchestra.run.smithi120.stdout:generic/536 [not run] ceph does not support shutdown 2024-03-31T21:21:01.508 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/536 2024-03-31T21:21:01.508 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/536 2024-03-31T21:21:01.508 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:21:01.512 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:01.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:21:01.532 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-03-31T21:21:01.777 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:21:01.785 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:21:01.786 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:21:01.787 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:21:01.787 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:02.203 INFO:teuthology.orchestra.run.smithi120.stdout:generic/537 [not run] FSTRIM not supported 2024-03-31T21:21:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/537 2024-03-31T21:21:02.218 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/537 2024-03-31T21:21:02.219 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:21:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:02.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:21:02.239 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-03-31T21:21:02.515 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:21:02.520 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:21:02.521 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:21:02.522 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:21:02.522 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:21:23.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:21:23.514 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:21:53.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:21:53.594 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:22:23.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:22:23.667 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:22:53.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:22:53.816 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:23:23.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:23:23.905 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:23:54.072 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:23:54.075 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:24:24.170 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:24:24.180 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:24:54.246 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:24:54.249 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:25:24.615 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:25:24.617 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:25:54.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:25:54.715 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:25:54.756 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T21:25:54.756+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579655) UID: 0 2024-03-31T21:25:54.758 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T21:25:54.756+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579655) UID: 0 2024-03-31T21:25:54.758 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T21:25:54.756+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579655) UID: 0 2024-03-31T21:25:54.762 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T21:25:54.763+0000 7fd012219640 -1 Fail to open '/proc/579655/cmdline' error = (2) No such file or directory 2024-03-31T21:25:54.763 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T21:25:54.763+0000 7fd012219640 -1 received signal: Hangup from (PID: 579655) UID: 0 2024-03-31T21:28:58.462 INFO:teuthology.orchestra.run.smithi120.stdout:generic/538 476s 2024-03-31T21:28:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/538 2024-03-31T21:28:58.472 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:28:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:28:58.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:28:58.505 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-03-31T21:28:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:28:58.984 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:28:58.984 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:28:58.986 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:28:58.986 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:01.168 INFO:teuthology.orchestra.run.smithi120.stdout:generic/539 2s 2024-03-31T21:29:01.184 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/539 2024-03-31T21:29:01.184 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:01.187 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:01.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:01.230 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-03-31T21:29:01.756 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:01.762 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:01.762 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:01.765 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:01.765 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:02.309 INFO:teuthology.orchestra.run.smithi120.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:29:02.315 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/540 2024-03-31T21:29:02.316 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/540 2024-03-31T21:29:02.316 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:02.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:02.597 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-03-31T21:29:02.920 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:02.925 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:02.925 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:02.927 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:02.927 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:03.447 INFO:teuthology.orchestra.run.smithi120.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:29:03.453 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/541 2024-03-31T21:29:03.453 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/541 2024-03-31T21:29:03.453 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:03.461 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:03.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:03.838 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-03-31T21:29:04.117 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:04.122 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:04.123 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:04.127 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:04.127 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:04.656 INFO:teuthology.orchestra.run.smithi120.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:29:04.661 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/542 2024-03-31T21:29:04.662 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/542 2024-03-31T21:29:04.662 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:04.669 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:05.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:05.099 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-03-31T21:29:05.368 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:05.372 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:05.373 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:05.374 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:05.375 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:05.889 INFO:teuthology.orchestra.run.smithi120.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:29:05.897 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/543 2024-03-31T21:29:05.897 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/543 2024-03-31T21:29:05.897 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:06.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:06.185 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-03-31T21:29:06.488 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:06.495 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:06.496 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:06.497 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:06.497 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:07.033 INFO:teuthology.orchestra.run.smithi120.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:29:07.039 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/544 2024-03-31T21:29:07.039 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/544 2024-03-31T21:29:07.039 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:07.043 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:07.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:07.425 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-03-31T21:29:07.683 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:07.689 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:07.690 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:07.691 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:07.691 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:08.095 INFO:teuthology.orchestra.run.smithi120.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-03-31T21:29:08.100 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/545 2024-03-31T21:29:08.100 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/545 2024-03-31T21:29:08.100 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:08.103 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:08.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:08.136 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-03-31T21:29:08.406 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:08.411 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:08.412 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:08.413 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:08.413 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:08.782 INFO:teuthology.orchestra.run.smithi120.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T21:29:08.786 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/546 2024-03-31T21:29:08.787 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/546 2024-03-31T21:29:08.787 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:08.789 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:08.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:08.817 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-03-31T21:29:09.089 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:09.093 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:09.094 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:09.095 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:09.096 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:09.406 INFO:teuthology.orchestra.run.smithi120.stdout:generic/547 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:29:09.415 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/547 2024-03-31T21:29:09.415 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/547 2024-03-31T21:29:09.416 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:09.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:09.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:09.439 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-03-31T21:29:09.722 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:09.726 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:09.726 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:09.728 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:09.728 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:10.236 INFO:teuthology.orchestra.run.smithi120.stdout:generic/548 [not run] kernel does not support ceph encryption 2024-03-31T21:29:10.248 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:29:10.250 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/548 2024-03-31T21:29:10.251 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/548 2024-03-31T21:29:10.251 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:10.252 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:29:10.253 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:10.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:10.275 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-03-31T21:29:10.593 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:10.597 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:10.598 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:10.599 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:10.599 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:11.078 INFO:teuthology.orchestra.run.smithi120.stdout:generic/549 [not run] kernel does not support ceph encryption 2024-03-31T21:29:11.103 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/549 2024-03-31T21:29:11.103 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/549 2024-03-31T21:29:11.103 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:11.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:11.125 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-03-31T21:29:11.391 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:11.396 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:11.396 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:11.398 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:11.398 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:11.882 INFO:teuthology.orchestra.run.smithi120.stdout:generic/550 [not run] kernel does not support ceph encryption 2024-03-31T21:29:11.899 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/550 2024-03-31T21:29:11.899 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/550 2024-03-31T21:29:11.899 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:29:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:11.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:29:11.920 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-03-31T21:29:12.190 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:29:12.200 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:29:12.201 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:29:12.202 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:29:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:29:40.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:29:40.337 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:30:10.602 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:30:10.631 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:30:40.711 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:30:40.714 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:31:10.797 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:31:10.800 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:31:40.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:31:40.892 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:32:11.004 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:32:11.007 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:32:41.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:32:41.104 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:33:11.180 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:33:11.184 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:33:41.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:33:41.283 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:34:11.394 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:34:11.398 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:34:41.715 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:34:41.724 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:35:11.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:35:11.798 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:35:41.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:35:41.912 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:36:12.065 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:36:12.068 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:36:42.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:36:42.198 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:37:12.338 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:37:12.341 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:37:42.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:37:42.477 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:38:12.596 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:38:12.599 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:38:42.694 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:38:42.697 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:39:12.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:39:12.877 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:39:42.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:39:42.954 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:40:13.342 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:40:13.345 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:40:43.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:40:43.414 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:41:13.534 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:41:13.541 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:41:24.921 INFO:teuthology.orchestra.run.smithi120.stdout:generic/551 732s 2024-03-31T21:41:24.984 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/551 2024-03-31T21:41:24.984 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:24.987 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:25.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:25.001 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-03-31T21:41:25.272 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:25.279 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:25.280 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:25.281 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:25.765 INFO:teuthology.orchestra.run.smithi120.stdout:generic/552 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:41:25.770 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/552 2024-03-31T21:41:25.770 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/552 2024-03-31T21:41:25.770 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:25.773 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:25.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:25.792 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-03-31T21:41:26.066 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:26.070 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:26.071 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:26.072 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:26.072 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:26.452 INFO:teuthology.orchestra.run.smithi120.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-03-31T21:41:26.457 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/553 2024-03-31T21:41:26.457 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/553 2024-03-31T21:41:26.457 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:26.461 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:26.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:26.512 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-03-31T21:41:27.107 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:27.115 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:27.116 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:27.117 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:27.117 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:27.707 INFO:teuthology.orchestra.run.smithi120.stdout:generic/554 [not run] swapfiles are not supported 2024-03-31T21:41:27.712 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/554 2024-03-31T21:41:27.712 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/554 2024-03-31T21:41:27.712 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:27.716 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:27.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:27.776 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-03-31T21:41:28.310 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:28.311 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:28.312 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:28.314 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:28.314 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:28.685 INFO:teuthology.orchestra.run.smithi120.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-03-31T21:41:28.690 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/555 2024-03-31T21:41:28.690 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/555 2024-03-31T21:41:28.690 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:28.693 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:28.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:28.734 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-03-31T21:41:29.303 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:29.311 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:29.311 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:29.313 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:29.313 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:29.622 INFO:teuthology.orchestra.run.smithi120.stdout:generic/556 [not run] ceph does not support casefold feature 2024-03-31T21:41:29.627 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/556 2024-03-31T21:41:29.627 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/556 2024-03-31T21:41:29.627 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:29.631 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:29.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:29.652 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-03-31T21:41:29.928 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:29.936 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:29.937 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:29.940 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:29.940 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:30.508 INFO:teuthology.orchestra.run.smithi120.stdout:generic/557 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:41:30.515 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/557 2024-03-31T21:41:30.515 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/557 2024-03-31T21:41:30.515 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:30.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:30.536 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-03-31T21:41:30.808 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:30.814 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:30.814 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:30.815 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:31.153 INFO:teuthology.orchestra.run.smithi120.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-31T21:41:31.159 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/558 2024-03-31T21:41:31.159 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/558 2024-03-31T21:41:31.159 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:31.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:31.186 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-03-31T21:41:31.472 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:31.477 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:31.478 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:31.479 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:31.800 INFO:teuthology.orchestra.run.smithi120.stdout:generic/559 [not run] duperemove utility required, skipped this test 2024-03-31T21:41:31.806 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/559 2024-03-31T21:41:31.806 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/559 2024-03-31T21:41:31.806 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:31.809 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:31.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:31.829 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-03-31T21:41:32.089 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:32.093 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:32.093 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:32.094 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:32.414 INFO:teuthology.orchestra.run.smithi120.stdout:generic/560 [not run] duperemove utility required, skipped this test 2024-03-31T21:41:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/560 2024-03-31T21:41:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/560 2024-03-31T21:41:32.418 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:32.421 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:32.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:32.439 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-03-31T21:41:32.723 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:32.734 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:32.734 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:32.735 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:33.053 INFO:teuthology.orchestra.run.smithi120.stdout:generic/561 [not run] duperemove utility required, skipped this test 2024-03-31T21:41:33.058 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/561 2024-03-31T21:41:33.058 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/561 2024-03-31T21:41:33.058 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:33.061 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:33.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:33.084 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-03-31T21:41:33.336 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:33.348 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:33.349 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:33.350 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:33.350 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:33.846 INFO:teuthology.orchestra.run.smithi120.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:41:33.852 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/562 2024-03-31T21:41:33.853 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/562 2024-03-31T21:41:33.853 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:33.855 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:34.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:34.273 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-03-31T21:41:34.556 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:34.560 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:34.561 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:34.563 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:34.919 INFO:teuthology.orchestra.run.smithi120.stdout:generic/563 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:41:34.925 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/563 2024-03-31T21:41:34.925 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/563 2024-03-31T21:41:34.925 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:34.928 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:34.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:34.948 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-03-31T21:41:35.211 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:35.215 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:35.215 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:35.216 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:35.217 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:35.769 INFO:teuthology.orchestra.run.smithi120.stdout:generic/564 0s 2024-03-31T21:41:35.775 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/564 2024-03-31T21:41:35.775 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:35.778 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:35.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:35.853 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-03-31T21:41:36.312 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:36.318 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:36.318 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:36.320 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:36.320 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:36.871 INFO:teuthology.orchestra.run.smithi120.stdout:generic/565 0s 2024-03-31T21:41:36.880 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/565 2024-03-31T21:41:36.880 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:36.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:36.949 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-03-31T21:41:37.492 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:37.498 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:37.499 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:37.500 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:37.500 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:37.825 INFO:teuthology.orchestra.run.smithi120.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T21:41:37.830 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/566 2024-03-31T21:41:37.830 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/566 2024-03-31T21:41:37.830 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:37.833 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:37.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:37.853 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-03-31T21:41:38.114 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:38.127 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:38.127 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:38.129 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:38.129 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:38.855 INFO:teuthology.orchestra.run.smithi120.stdout:generic/567 0s 2024-03-31T21:41:38.862 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/567 2024-03-31T21:41:38.862 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:38.869 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:38.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:38.880 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-03-31T21:41:39.149 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:39.154 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:39.155 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:39.157 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:39.157 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:39.467 INFO:teuthology.orchestra.run.smithi120.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T21:41:39.472 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/568 2024-03-31T21:41:39.472 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/568 2024-03-31T21:41:39.472 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:39.475 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:39.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:39.503 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-03-31T21:41:39.778 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:39.784 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:39.784 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:39.786 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:39.786 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:40.103 INFO:teuthology.orchestra.run.smithi120.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T21:41:40.111 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/569 2024-03-31T21:41:40.111 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/569 2024-03-31T21:41:40.111 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:40.114 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:40.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:40.149 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-03-31T21:41:40.421 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:40.425 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:40.426 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:40.428 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:40.428 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:40.749 INFO:teuthology.orchestra.run.smithi120.stdout:generic/570 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:41:40.754 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/570 2024-03-31T21:41:40.754 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/570 2024-03-31T21:41:40.754 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:40.758 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:40.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:40.777 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-03-31T21:41:41.033 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:41.039 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:41.039 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:41.041 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:41.382 INFO:teuthology.orchestra.run.smithi120.stdout:generic/571 [not run] Require fcntl setlease support 2024-03-31T21:41:41.386 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/571 2024-03-31T21:41:41.386 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/571 2024-03-31T21:41:41.386 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:41.389 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:41.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:41.424 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-03-31T21:41:41.686 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:41.691 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:41.691 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:41.692 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:41.692 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:41.995 INFO:teuthology.orchestra.run.smithi120.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-03-31T21:41:42.000 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/572 2024-03-31T21:41:42.000 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/572 2024-03-31T21:41:42.000 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:42.003 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:42.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:42.026 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-03-31T21:41:42.292 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:42.297 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:42.297 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:42.298 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:42.298 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:42.610 INFO:teuthology.orchestra.run.smithi120.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-03-31T21:41:42.616 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/573 2024-03-31T21:41:42.616 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/573 2024-03-31T21:41:42.616 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:42.618 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:42.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:42.636 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-03-31T21:41:42.903 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:42.908 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:42.908 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:42.910 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:42.910 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:43.225 INFO:teuthology.orchestra.run.smithi120.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-03-31T21:41:43.230 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/574 2024-03-31T21:41:43.230 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/574 2024-03-31T21:41:43.230 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:43.232 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:43.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:43.258 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-03-31T21:41:43.509 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:43.513 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:43.514 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:43.515 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:43.515 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:43.638 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:41:43.640 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:41:43.820 INFO:teuthology.orchestra.run.smithi120.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-03-31T21:41:43.826 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/575 2024-03-31T21:41:43.826 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/575 2024-03-31T21:41:43.826 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:43.829 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:43.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:43.852 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-03-31T21:41:44.128 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:44.132 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:44.133 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:44.134 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:44.134 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:44.475 INFO:teuthology.orchestra.run.smithi120.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-03-31T21:41:44.481 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/576 2024-03-31T21:41:44.481 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/576 2024-03-31T21:41:44.481 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:44.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:44.506 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-03-31T21:41:44.770 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:44.776 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:44.777 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:44.778 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:44.778 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:45.068 INFO:teuthology.orchestra.run.smithi120.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-03-31T21:41:45.074 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/577 2024-03-31T21:41:45.074 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/577 2024-03-31T21:41:45.074 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:45.076 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:45.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:45.100 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-03-31T21:41:45.342 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:45.346 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:45.347 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:45.348 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:45.348 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:45.690 INFO:teuthology.orchestra.run.smithi120.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-31T21:41:45.694 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/578 2024-03-31T21:41:45.694 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/578 2024-03-31T21:41:45.694 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:45.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:45.729 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-03-31T21:41:45.987 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:45.992 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:45.993 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:45.996 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:45.996 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:46.324 INFO:teuthology.orchestra.run.smithi120.stdout:generic/579 [not run] fsverity utility required, skipped this test 2024-03-31T21:41:46.331 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/579 2024-03-31T21:41:46.331 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/579 2024-03-31T21:41:46.331 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:46.332 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:46.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:46.355 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-03-31T21:41:46.624 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:46.629 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:46.630 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:46.631 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:46.631 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:47.104 INFO:teuthology.orchestra.run.smithi120.stdout:generic/580 [not run] kernel does not support ceph encryption 2024-03-31T21:41:47.131 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/580 2024-03-31T21:41:47.131 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/580 2024-03-31T21:41:47.131 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:47.134 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:47.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:47.153 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-03-31T21:41:47.434 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:47.439 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:47.439 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:47.440 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:47.440 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:48.465 INFO:teuthology.orchestra.run.smithi120.stdout:generic/581 [not run] kernel does not support ceph encryption 2024-03-31T21:41:48.488 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/581 2024-03-31T21:41:48.488 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/581 2024-03-31T21:41:48.488 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:48.492 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:48.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:48.513 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-03-31T21:41:48.779 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:48.784 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:48.785 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:48.786 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:48.786 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:49.262 INFO:teuthology.orchestra.run.smithi120.stdout:generic/582 [not run] kernel does not support ceph encryption 2024-03-31T21:41:49.283 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/582 2024-03-31T21:41:49.283 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/582 2024-03-31T21:41:49.283 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:49.286 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:49.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:49.313 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-03-31T21:41:49.589 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:49.594 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:49.595 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:49.596 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:49.596 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:50.086 INFO:teuthology.orchestra.run.smithi120.stdout:generic/583 [not run] kernel does not support ceph encryption 2024-03-31T21:41:50.109 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/583 2024-03-31T21:41:50.110 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/583 2024-03-31T21:41:50.110 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:50.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:50.132 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-03-31T21:41:50.418 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:50.423 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:50.424 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:50.425 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:50.425 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:50.935 INFO:teuthology.orchestra.run.smithi120.stdout:generic/584 [not run] kernel does not support ceph encryption 2024-03-31T21:41:50.950 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/584 2024-03-31T21:41:50.950 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/584 2024-03-31T21:41:50.950 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:50.953 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:50.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:50.975 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-03-31T21:41:51.238 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:51.246 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:51.246 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:51.247 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:51.248 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:51.631 INFO:teuthology.orchestra.run.smithi120.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2024-03-31T21:41:51.636 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/585 2024-03-31T21:41:51.636 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/585 2024-03-31T21:41:51.636 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:51.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:51.679 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-03-31T21:41:52.222 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:52.227 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:52.227 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:52.228 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:52.630 INFO:teuthology.orchestra.run.smithi120.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T21:41:52.636 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/586 2024-03-31T21:41:52.636 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/586 2024-03-31T21:41:52.636 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:52.640 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:52.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:52.686 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-03-31T21:41:53.238 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:53.243 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:53.243 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:53.245 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:53.245 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:53.574 INFO:teuthology.orchestra.run.smithi120.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T21:41:53.579 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/587 2024-03-31T21:41:53.580 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/587 2024-03-31T21:41:53.580 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:53.583 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:53.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:53.606 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-03-31T21:41:53.878 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:53.883 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:53.885 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:53.886 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:54.401 INFO:teuthology.orchestra.run.smithi120.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:41:54.409 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/588 2024-03-31T21:41:54.409 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/588 2024-03-31T21:41:54.409 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:54.413 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:54.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:54.809 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-03-31T21:41:55.061 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:55.065 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:55.066 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:55.067 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:55.410 INFO:teuthology.orchestra.run.smithi120.stdout:generic/589 [not run] require 172.21.15.120:6789:/scratch to be local device 2024-03-31T21:41:55.415 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/589 2024-03-31T21:41:55.415 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/589 2024-03-31T21:41:55.415 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:55.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:55.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:55.440 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-03-31T21:41:55.719 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:55.724 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:55.725 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:55.726 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:55.726 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:56.077 INFO:teuthology.orchestra.run.smithi120.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T21:41:56.084 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/590 2024-03-31T21:41:56.084 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/590 2024-03-31T21:41:56.084 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:56.087 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:56.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:56.120 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-03-31T21:41:56.409 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:56.414 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:56.415 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:56.416 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:56.416 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:56.964 INFO:teuthology.orchestra.run.smithi120.stdout:generic/591 0s 2024-03-31T21:41:56.972 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/591 2024-03-31T21:41:56.972 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:56.975 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:57.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:57.035 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-03-31T21:41:57.530 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:57.535 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:57.536 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:57.537 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:57.537 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:58.047 INFO:teuthology.orchestra.run.smithi120.stdout:generic/592 [not run] kernel does not support ceph encryption 2024-03-31T21:41:58.078 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/592 2024-03-31T21:41:58.078 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/592 2024-03-31T21:41:58.078 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:58.082 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:58.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:58.101 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-03-31T21:41:58.381 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:58.386 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:58.387 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:58.388 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:58.388 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:59.019 INFO:teuthology.orchestra.run.smithi120.stdout:generic/593 [not run] kernel does not support ceph encryption 2024-03-31T21:41:59.032 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/593 2024-03-31T21:41:59.032 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/593 2024-03-31T21:41:59.032 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:59.037 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:59.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:59.069 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-03-31T21:41:59.402 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:41:59.407 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:41:59.408 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:41:59.409 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:41:59.409 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:59.788 INFO:teuthology.orchestra.run.smithi120.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T21:41:59.801 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/594 2024-03-31T21:41:59.801 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/594 2024-03-31T21:41:59.801 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:41:59.804 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:41:59.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:41:59.822 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-03-31T21:42:00.108 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:00.115 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:00.115 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:00.117 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:00.639 INFO:teuthology.orchestra.run.smithi120.stdout:generic/595 [not run] kernel does not support ceph encryption 2024-03-31T21:42:00.655 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/595 2024-03-31T21:42:00.655 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/595 2024-03-31T21:42:00.655 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:00.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:00.690 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-03-31T21:42:00.991 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:00.998 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:00.998 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:01.000 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:01.430 INFO:teuthology.orchestra.run.smithi120.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-03-31T21:42:01.436 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/596 2024-03-31T21:42:01.436 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/596 2024-03-31T21:42:01.436 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:01.439 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:01.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:01.471 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-03-31T21:42:01.745 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:01.750 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:01.750 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:01.752 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:01.752 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:02.692 INFO:teuthology.orchestra.run.smithi120.stdout:generic/597 1s 2024-03-31T21:42:02.700 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/597 2024-03-31T21:42:02.700 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:02.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:02.764 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-03-31T21:42:03.219 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:03.229 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:03.229 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:03.230 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:03.230 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:04.224 INFO:teuthology.orchestra.run.smithi120.stdout:generic/598 1s 2024-03-31T21:42:04.230 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/598 2024-03-31T21:42:04.230 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:04.233 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:04.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:04.281 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-03-31T21:42:04.795 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:04.800 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:04.800 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:04.801 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:05.398 INFO:teuthology.orchestra.run.smithi120.stdout:generic/599 [not run] ceph does not support shutdown 2024-03-31T21:42:05.423 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/599 2024-03-31T21:42:05.424 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/599 2024-03-31T21:42:05.424 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:05.427 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:05.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:05.448 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-03-31T21:42:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:05.739 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:05.740 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:05.740 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:06.061 INFO:teuthology.orchestra.run.smithi120.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T21:42:06.067 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/600 2024-03-31T21:42:06.067 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/600 2024-03-31T21:42:06.067 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:06.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:06.094 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-03-31T21:42:06.358 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:06.363 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:06.363 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:06.365 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:06.365 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:06.669 INFO:teuthology.orchestra.run.smithi120.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T21:42:06.675 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/601 2024-03-31T21:42:06.675 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/601 2024-03-31T21:42:06.675 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:06.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:06.702 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-03-31T21:42:06.990 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:06.997 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:06.998 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:06.998 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:06.999 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:07.471 INFO:teuthology.orchestra.run.smithi120.stdout:generic/602 [not run] kernel does not support ceph encryption 2024-03-31T21:42:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/602 2024-03-31T21:42:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/602 2024-03-31T21:42:07.491 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:07.495 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:07.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:07.522 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-03-31T21:42:07.772 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:07.777 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:07.778 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:07.779 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:08.090 INFO:teuthology.orchestra.run.smithi120.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T21:42:08.095 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/603 2024-03-31T21:42:08.095 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/603 2024-03-31T21:42:08.096 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:08.101 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:08.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:08.122 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-03-31T21:42:08.400 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:08.406 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:08.407 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:08.408 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:08.408 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:13.029 INFO:teuthology.orchestra.run.smithi120.stdout:generic/604 5s 2024-03-31T21:42:13.038 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/604 2024-03-31T21:42:13.038 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:13.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:13.052 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-03-31T21:42:13.306 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:13.312 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:13.313 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:13.315 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:13.315 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:13.716 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:42:13.718 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:42:15.543 INFO:teuthology.orchestra.run.smithi120.stdout:generic/605 [not run] mount 172.21.15.120:6789:/scratch with dax=always failed 2024-03-31T21:42:15.548 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/605 2024-03-31T21:42:15.548 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/605 2024-03-31T21:42:15.548 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:15.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:15.573 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-03-31T21:42:15.836 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:15.841 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:15.841 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:15.842 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:15.843 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:16.234 INFO:teuthology.orchestra.run.smithi120.stdout:generic/606 [not run] mount 172.21.15.120:6789:/scratch with dax=always failed 2024-03-31T21:42:16.238 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/606 2024-03-31T21:42:16.239 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/606 2024-03-31T21:42:16.239 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:16.241 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:16.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:16.263 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-03-31T21:42:16.497 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:16.503 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:16.504 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:16.505 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:16.506 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:16.836 INFO:teuthology.orchestra.run.smithi120.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-03-31T21:42:16.842 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/607 2024-03-31T21:42:16.842 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/607 2024-03-31T21:42:16.842 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:16.846 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:16.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:16.911 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-03-31T21:42:17.350 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:17.356 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:17.357 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:17.358 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:17.358 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:17.776 INFO:teuthology.orchestra.run.smithi120.stdout:generic/608 [not run] mount 172.21.15.120:6789:/scratch with dax=always failed 2024-03-31T21:42:17.781 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/608 2024-03-31T21:42:17.782 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/608 2024-03-31T21:42:17.782 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:17.784 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:17.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:17.809 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-03-31T21:42:18.063 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:18.068 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:18.068 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:18.070 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:18.070 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:18.680 INFO:teuthology.orchestra.run.smithi120.stdout:generic/609 0s 2024-03-31T21:42:18.687 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/609 2024-03-31T21:42:18.687 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:18.690 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:18.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:18.748 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-03-31T21:42:19.206 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:19.212 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:19.212 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:19.213 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:19.214 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:19.650 INFO:teuthology.orchestra.run.smithi120.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-31T21:42:19.655 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/610 2024-03-31T21:42:19.656 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/610 2024-03-31T21:42:19.656 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:19.659 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:19.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:19.690 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-03-31T21:42:19.937 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:19.943 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:19.943 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:19.944 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:19.944 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:20.547 INFO:teuthology.orchestra.run.smithi120.stdout:generic/611 0s 2024-03-31T21:42:20.556 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/611 2024-03-31T21:42:20.556 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:20.559 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:20.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:20.571 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-03-31T21:42:20.845 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:20.850 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:20.851 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:20.852 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:20.852 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:21.216 INFO:teuthology.orchestra.run.smithi120.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T21:42:21.221 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/612 2024-03-31T21:42:21.221 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/612 2024-03-31T21:42:21.221 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:21.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:21.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:21.362 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-03-31T21:42:21.752 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:21.758 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:21.758 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:21.761 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:21.761 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:22.304 INFO:teuthology.orchestra.run.smithi120.stdout:generic/613 [not run] kernel does not support ceph encryption 2024-03-31T21:42:22.327 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/613 2024-03-31T21:42:22.327 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/613 2024-03-31T21:42:22.327 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:22.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:22.350 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-03-31T21:42:22.616 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:22.622 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:22.622 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:22.623 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:23.067 INFO:teuthology.orchestra.run.smithi120.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-03-31T21:42:23.097 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/614 2024-03-31T21:42:23.097 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/614 2024-03-31T21:42:23.097 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:42:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:23.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:42:23.134 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-03-31T21:42:23.398 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:42:23.402 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:42:23.403 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:42:23.404 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:42:23.404 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:42:43.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:42:43.819 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:43:14.022 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:43:14.026 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:43:32.294 INFO:teuthology.orchestra.run.smithi120.stdout:generic/615 69s 2024-03-31T21:43:32.307 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/615 2024-03-31T21:43:32.307 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:32.310 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:32.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:32.319 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-03-31T21:43:32.513 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:32.516 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:32.517 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:32.518 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:32.518 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:32.759 INFO:teuthology.orchestra.run.smithi120.stdout:generic/616 [not run] kernel does not support IO_URING 2024-03-31T21:43:32.763 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/616 2024-03-31T21:43:32.763 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/616 2024-03-31T21:43:32.763 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:32.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:32.781 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-03-31T21:43:32.973 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:32.978 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:32.978 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:32.978 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:32.979 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:33.247 INFO:teuthology.orchestra.run.smithi120.stdout:generic/617 [not run] kernel does not support IO_URING 2024-03-31T21:43:33.251 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/617 2024-03-31T21:43:33.251 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/617 2024-03-31T21:43:33.251 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:33.254 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:33.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:33.275 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-03-31T21:43:33.465 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:33.469 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:33.470 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:33.470 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:33.899 INFO:teuthology.orchestra.run.smithi120.stdout:generic/618 0s 2024-03-31T21:43:33.905 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/618 2024-03-31T21:43:33.905 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:33.907 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:33.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:33.915 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-03-31T21:43:34.101 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:34.104 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:34.105 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:34.105 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:34.106 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:34.341 INFO:teuthology.orchestra.run.smithi120.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T21:43:34.347 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/619 2024-03-31T21:43:34.348 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/619 2024-03-31T21:43:34.348 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:34.348 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:34.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:34.370 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-03-31T21:43:34.560 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:34.564 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:34.564 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:34.565 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:34.817 INFO:teuthology.orchestra.run.smithi120.stdout:generic/620 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:43:34.821 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/620 2024-03-31T21:43:34.821 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/620 2024-03-31T21:43:34.821 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:34.824 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:34.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:34.841 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-03-31T21:43:35.026 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:35.030 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:35.031 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:35.032 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:35.379 INFO:teuthology.orchestra.run.smithi120.stdout:generic/621 [not run] kernel does not support ceph encryption 2024-03-31T21:43:35.390 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/621 2024-03-31T21:43:35.390 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/621 2024-03-31T21:43:35.390 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:35.392 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:35.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:35.408 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-03-31T21:43:35.597 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:35.601 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:35.601 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:35.602 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:35.602 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:35.895 INFO:teuthology.orchestra.run.smithi120.stdout:generic/622 [not run] ceph does not support shutdown 2024-03-31T21:43:35.905 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/622 2024-03-31T21:43:35.906 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/622 2024-03-31T21:43:35.906 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:35.908 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:35.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:35.923 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-03-31T21:43:36.104 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:36.108 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:36.109 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:36.109 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:36.110 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:36.400 INFO:teuthology.orchestra.run.smithi120.stdout:generic/623 [not run] ceph does not support shutdown 2024-03-31T21:43:36.412 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/623 2024-03-31T21:43:36.412 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/623 2024-03-31T21:43:36.412 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:36.414 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:36.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:36.429 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-03-31T21:43:36.610 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:36.614 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:36.614 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:36.615 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:36.615 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:36.845 INFO:teuthology.orchestra.run.smithi120.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-03-31T21:43:36.848 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/624 2024-03-31T21:43:36.848 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/624 2024-03-31T21:43:36.849 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:36.851 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:36.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:36.869 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-03-31T21:43:37.056 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:37.061 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:37.061 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:37.062 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:37.062 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:37.276 INFO:teuthology.orchestra.run.smithi120.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-03-31T21:43:37.279 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/625 2024-03-31T21:43:37.280 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/625 2024-03-31T21:43:37.280 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:37.282 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:37.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:37.299 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-03-31T21:43:37.498 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:37.502 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:37.502 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:37.503 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:37.503 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:37.766 INFO:teuthology.orchestra.run.smithi120.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-03-31T21:43:37.770 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/626 2024-03-31T21:43:37.770 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/626 2024-03-31T21:43:37.770 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:37.772 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:37.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:37.829 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-03-31T21:43:38.208 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:38.212 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:38.213 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:38.214 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:38.214 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:38.530 INFO:teuthology.orchestra.run.smithi120.stdout:generic/627 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:43:38.535 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/627 2024-03-31T21:43:38.535 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/627 2024-03-31T21:43:38.535 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:38.537 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:38.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:38.558 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-03-31T21:43:38.745 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:38.749 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:38.749 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:38.750 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:38.750 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:39.189 INFO:teuthology.orchestra.run.smithi120.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:43:39.196 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/628 2024-03-31T21:43:39.196 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/628 2024-03-31T21:43:39.196 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:39.197 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:39.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:39.298 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-03-31T21:43:39.613 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:39.618 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:39.618 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:39.619 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:39.619 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:39.871 INFO:teuthology.orchestra.run.smithi120.stdout:generic/629 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:43:39.875 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/629 2024-03-31T21:43:39.875 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/629 2024-03-31T21:43:39.875 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:39.878 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:39.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:39.893 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-03-31T21:43:40.076 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:40.080 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:40.080 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:40.081 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:40.081 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:40.398 INFO:teuthology.orchestra.run.smithi120.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-31T21:43:40.449 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/630 2024-03-31T21:43:40.449 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/630 2024-03-31T21:43:40.449 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:43:40.454 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:40.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:43:40.554 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-03-31T21:43:40.924 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:43:40.927 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:43:40.928 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:43:40.929 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:43:40.929 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:43:44.145 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:43:44.149 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:44:11.797 INFO:teuthology.orchestra.run.smithi120.stdout:generic/631 - output mismatch (see /tmp/tmp.HCjZqVXECMxfstests-dev/results//generic/631.out.bad) 2024-03-31T21:44:11.810 INFO:teuthology.orchestra.run.smithi120.stdout: --- tests/generic/631.out 2024-03-31 16:36:30.511492205 +0000 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +++ /tmp/tmp.HCjZqVXECMxfstests-dev/results//generic/631.out.bad 2024-03-31 21:44:11.693188517 +0000 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: @@ -1,2 +1,5534 @@ 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: QA output created by 631 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.811 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.812 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf' 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-31T21:44:11.814 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.815 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.816 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.817 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.818 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.819 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.820 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.821 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.822 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf' 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directorytouch: 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.824 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.825 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.826 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.827 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.828 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.829 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.830 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.831 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.832 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.833 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.834 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.835 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.836 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.837 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.838 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.839 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.840 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.841 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.841 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.841 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.841 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.841 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.841 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf' 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.842 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.843 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.844 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.845 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.846 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.847 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.848 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.849 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.850 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.851 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.852 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.853 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: mv: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.854 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.854 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.854 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.854 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.854 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.854 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.854 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.855 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.856 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.857 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.858 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.859 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.860 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.861 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.862 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.863 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.864 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.865 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.866 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.867 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.868 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.869 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.870 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.871 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.872 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.873 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.874 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.875 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.876 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.877 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.878 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.879 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directorymv: 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.880 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.881 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.882 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.883 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.884 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.885 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.886 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.887 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.888 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.889 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.890 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.891 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.892 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.893 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.894 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.895 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.896 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.897 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.898 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.899 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.900 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: mv: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.901 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.902 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: mv: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted.cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf' 2024-03-31T21:44:11.903 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.904 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.905 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf' 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.906 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.907 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf' 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.908 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf' 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.909 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.910 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.911 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.912 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.913 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.914 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.915 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.916 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.917 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.918 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.919 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.920 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.921 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.922 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.923 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.924 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.925 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.926 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.927 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted.umount: 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.928 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.929 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.930 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf' 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.931 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.932 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.933 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.934 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.935 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.936 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.937 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.938 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.939 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.940 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.941 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.942 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.943 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.944 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.945 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.946 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.947 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.948 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.949 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted.umount: 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.950 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.951 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.952 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.953 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.954 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.955 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.956 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.957 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.958 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.959 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.960 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.961 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.962 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.963 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.964 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.965 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.966 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.967 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.968 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.969 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.970 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.971 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.972 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.973 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.974 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.975 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.976 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.977 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.978 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.979 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.980 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.981 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.982 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.983 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.984 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.985 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.986 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.987 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.988 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.989 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.990 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.991 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf' 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.992 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.993 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:11.997 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.998 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:11.999 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.000 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.001 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.002 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.003 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.004 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.005 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.006 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.007 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.008 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.009 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.010 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.011 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf' 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf' 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.027 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.027 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.027 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.027 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.027 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.032 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.033 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.034 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.035 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted.umount: 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.036 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.037 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.038 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.039 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.040 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.041 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.042 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.043 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.044 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.045 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.046 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.047 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.048 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.049 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.050 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.051 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.052 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.053 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.054 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.055 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.056 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.057 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directorymv: 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.058 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.059 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.060 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.061 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.062 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.063 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.064 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.065 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.066 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.067 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.068 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.069 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.070 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.071 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.072 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.073 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.074 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.075 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.076 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.077 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.078 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.079 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.080 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.081 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.082 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.083 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.084 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.085 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.086 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.087 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.088 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.089 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.090 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.091 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.092 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.093 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.094 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.095 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.096 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.097 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.098 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.099 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.100 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.101 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.102 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.103 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.104 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.105 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.106 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.107 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.108 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.109 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.110 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.111 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.112 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.113 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.114 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.115 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.116 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.117 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.118 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.119 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf' 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.120 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.121 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.122 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.123 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.124 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.125 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.126 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.127 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.128 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.129 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.130 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.131 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.132 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.133 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.134 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.135 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.136 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.137 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.138 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.139 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.140 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.141 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.142 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.143 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.144 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.145 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.146 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directorymv: 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.147 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.148 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf' 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.149 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.150 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.151 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directorytouch: 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.152 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.153 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.154 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.155 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.156 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf' 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.157 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.158 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.159 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.160 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.161 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.162 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.163 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-31T21:44:12.164 INFO:teuthology.orchestra.run.smithi120.stdout: +/tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.165 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.166 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted./tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.167 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.168 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf' 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.169 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.170 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.171 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.172 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.173 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.174 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.175 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.176 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directorytouch: 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.177 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.178 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.179 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.180 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.181 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.182 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf' 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.183 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: umount: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'/tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted.: No such file or directory 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.184 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.185 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.186 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.187 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf' 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.188 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.189 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.190 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.191 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.192 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.193 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directorymv: 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.194 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.195 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.196 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.197 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.198 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.199 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.200 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.201 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.202 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.203 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.204 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.205 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.206 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.207 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.208 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: mv: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.209 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf' 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +: No such file or directory 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.210 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.211 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.212 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.213 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.214 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.215 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.216 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.217 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.218 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.219 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.220 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.221 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.222 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.223 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.224 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.225 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.226 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.227 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.228 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.229 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.230 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.231 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.232 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.233 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.234 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.235 INFO:teuthology.orchestra.run.smithi120.stdout: + 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.236 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged1/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged1: not mounted. 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged2/etc/access.conf': No such file or directory 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged2: not mounted. 2024-03-31T21:44:12.237 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged3/etc/access.conf': No such file or directory 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged3: not mounted. 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +mount: /tmp/tmp.QrZcf5mS2uscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.238 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged0/etc/access.conf': No such file or directory 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +mv: cannot stat '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged5/etc/access.conf': No such file or directory 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged0: not mounted. 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +touch: cannot touch '/tmp/tmp.QrZcf5mS2uscratch/merged4/etc/access.conf': No such file or directory 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged5: not mounted. 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: +umount: /tmp/tmp.QrZcf5mS2uscratch/merged4: not mounted. 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: Silence is golden. 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout:HINT: You _MAY_ be missing kernel fix: 2024-03-31T21:44:12.239 INFO:teuthology.orchestra.run.smithi120.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2024-03-31T21:44:12.240 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:12.240 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/631 2024-03-31T21:44:12.240 INFO:teuthology.orchestra.run.smithi120.stdout:Failures: generic/631 2024-03-31T21:44:12.240 INFO:teuthology.orchestra.run.smithi120.stdout:Failed 1 of 1 tests 2024-03-31T21:44:12.240 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:12.240 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-31T21:44:12.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-31T21:44:12.241 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-03-31T21:44:12.463 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:12.467 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:12.467 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:12.468 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:12.468 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:13.272 INFO:teuthology.orchestra.run.smithi120.stdout:generic/632 1s 2024-03-31T21:44:13.292 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/632 2024-03-31T21:44:13.292 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:13.294 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:13.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:13.317 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-03-31T21:44:13.531 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:13.534 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:13.535 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:13.537 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:14.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:44:14.277 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:44:15.292 INFO:teuthology.orchestra.run.smithi120.stdout:generic/633 2s 2024-03-31T21:44:15.359 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/633 2024-03-31T21:44:15.359 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:15.362 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:15.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:15.422 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-03-31T21:44:15.835 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:15.839 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:15.840 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:15.841 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:15.841 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:16.787 INFO:teuthology.orchestra.run.smithi120.stdout:generic/634 1s 2024-03-31T21:44:16.794 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/634 2024-03-31T21:44:16.794 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:16.796 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:16.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:16.805 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-03-31T21:44:16.989 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:16.993 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:16.993 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:16.994 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:16.994 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:17.310 INFO:teuthology.orchestra.run.smithi120.stdout:generic/635 [not run] ceph does not support shutdown 2024-03-31T21:44:17.319 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/635 2024-03-31T21:44:17.319 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/635 2024-03-31T21:44:17.320 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:17.322 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:17.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:17.335 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-03-31T21:44:17.526 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:17.530 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:17.530 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:17.531 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:17.531 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:17.855 INFO:teuthology.orchestra.run.smithi120.stdout:generic/636 [not run] swapfiles are not supported 2024-03-31T21:44:17.859 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/636 2024-03-31T21:44:17.859 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/636 2024-03-31T21:44:17.859 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:17.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:17.880 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-03-31T21:44:18.064 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:18.068 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:18.068 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:18.069 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:18.069 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:18.715 INFO:teuthology.orchestra.run.smithi120.stdout:generic/637 0s 2024-03-31T21:44:18.720 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/637 2024-03-31T21:44:18.720 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:19.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:19.016 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-03-31T21:44:19.317 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:19.320 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:19.321 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:19.321 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:19.322 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:19.602 INFO:teuthology.orchestra.run.smithi120.stdout:generic/638 0s 2024-03-31T21:44:19.607 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/638 2024-03-31T21:44:19.607 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:19.610 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:19.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:19.632 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-03-31T21:44:19.812 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:19.815 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:19.816 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:19.817 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:20.133 INFO:teuthology.orchestra.run.smithi120.stdout:generic/639 1s 2024-03-31T21:44:20.138 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/639 2024-03-31T21:44:20.138 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:20.141 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:20.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:20.162 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-03-31T21:44:20.351 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:20.355 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:20.355 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:20.356 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:20.356 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:20.577 INFO:teuthology.orchestra.run.smithi120.stdout:generic/640 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T21:44:20.581 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/640 2024-03-31T21:44:20.581 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/640 2024-03-31T21:44:20.581 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:20.583 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:20.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:20.597 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-03-31T21:44:20.789 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:20.793 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:20.793 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:20.794 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:20.794 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:21.136 INFO:teuthology.orchestra.run.smithi120.stdout:generic/641 [not run] swapfiles are not supported 2024-03-31T21:44:21.140 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/641 2024-03-31T21:44:21.140 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/641 2024-03-31T21:44:21.140 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:44:21.142 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:21.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:44:21.160 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-03-31T21:44:21.342 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:44:21.346 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:44:21.346 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:44:21.347 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:44:21.348 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:44:44.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:44:44.588 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:44:44.627 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T21:44:44.627+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 692333) UID: 0 2024-03-31T21:44:44.628 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T21:44:44.627+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 692333) UID: 0 2024-03-31T21:49:06.262 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T21:49:06.261+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 692341) UID: 0 2024-03-31T21:49:06.262 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T21:49:06.261+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 692341) UID: 0 2024-03-31T21:49:06.263 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T21:49:06.261+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 692341) UID: 0 2024-03-31T21:49:06.263 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T21:49:06.261+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 692341) UID: 0 2024-03-31T21:53:39.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:53:39.273 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T21:53:39.314 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T21:53:39.312+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 692364) UID: 0 2024-03-31T21:53:39.314 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T21:53:39.312+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 692364) UID: 0 2024-03-31T21:54:02.905 INFO:teuthology.orchestra.run.smithi120.stdout:generic/642 581s 2024-03-31T21:54:02.921 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/642 2024-03-31T21:54:02.921 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:54:02.925 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:54:02.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:54:02.939 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-03-31T21:54:04.792 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:54:04.796 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:54:04.796 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:54:04.797 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:54:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:37.036 INFO:teuthology.orchestra.run.smithi120.stdout:generic/643 [not run] swapfiles are not supported 2024-03-31T21:57:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/643 2024-03-31T21:57:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/643 2024-03-31T21:57:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:57:37.042 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:37.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:57:37.071 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-03-31T21:57:37.250 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:57:37.253 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:57:37.254 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:57:37.255 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:57:37.255 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:37.643 INFO:teuthology.orchestra.run.smithi120.stdout:generic/644 [not run] vfstest not support by ceph 2024-03-31T21:57:37.646 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/644 2024-03-31T21:57:37.647 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/644 2024-03-31T21:57:37.647 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:57:37.649 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:37.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:57:37.669 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-03-31T21:57:37.870 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:57:37.874 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:57:37.874 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:57:37.876 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:57:37.876 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:38.083 INFO:teuthology.orchestra.run.smithi120.stdout:generic/645 [not run] vfstest not support by ceph 2024-03-31T21:57:38.087 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/645 2024-03-31T21:57:38.087 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/645 2024-03-31T21:57:38.087 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:57:38.089 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:38.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:57:38.105 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-03-31T21:57:38.297 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:57:38.300 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:57:38.301 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:57:38.302 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:57:38.302 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:38.594 INFO:teuthology.orchestra.run.smithi120.stdout:generic/646 [not run] ceph does not support shutdown 2024-03-31T21:57:38.604 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/646 2024-03-31T21:57:38.604 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/646 2024-03-31T21:57:38.604 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:57:38.607 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:38.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:57:38.622 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-03-31T21:57:38.804 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:57:38.807 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:57:38.808 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:57:38.809 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:57:38.809 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:39.300 INFO:teuthology.orchestra.run.smithi120.stdout:generic/647 1s 2024-03-31T21:57:39.305 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/647 2024-03-31T21:57:39.306 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:57:39.308 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:39.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:57:39.394 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-03-31T21:57:39.811 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:57:39.817 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:57:39.817 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:57:39.819 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:57:39.819 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:40.353 INFO:teuthology.orchestra.run.smithi120.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T21:57:40.360 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/648 2024-03-31T21:57:40.360 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/648 2024-03-31T21:57:40.360 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:57:40.362 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:40.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:57:40.566 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-03-31T21:57:40.857 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:57:40.861 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:57:40.861 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:57:40.862 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:57:40.862 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:41.170 INFO:teuthology.orchestra.run.smithi120.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2024-03-31T21:57:41.174 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/649 2024-03-31T21:57:41.174 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/649 2024-03-31T21:57:41.174 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T21:57:41.176 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T21:57:41.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T21:57:41.236 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-03-31T21:57:41.671 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T21:57:41.677 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T21:57:41.677 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T21:57:41.679 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T21:57:41.679 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:04:39.446 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:04:39.449 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:05:09.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:05:09.597 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:05:39.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:05:39.825 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:06:09.967 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:06:09.972 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:06:40.134 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:06:40.146 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:07:10.300 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:07:10.304 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:07:40.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:07:40.459 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:08:10.614 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:08:10.618 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:08:10.715 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T22:08:10.715+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 697579) UID: 0 2024-03-31T22:08:10.716 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T22:08:10.717+0000 7ff86c86b640 -1 Fail to read '/proc/697579/cmdline' error = (3) No such process 2024-03-31T22:08:10.716 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T22:08:10.717+0000 7ff86c86b640 -1 received signal: Hangup from (PID: 697579) UID: 0 2024-03-31T22:13:25.342 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:13:25.345 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:13:25.376 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T22:13:25.377+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54379) UID: 0 2024-03-31T22:13:25.376 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T22:13:25.377+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54379) UID: 0 2024-03-31T22:13:25.376 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T22:13:25.377+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54379) UID: 0 2024-03-31T22:13:25.377 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T22:13:25.377+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54379) UID: 0 2024-03-31T22:16:05.983 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:16:05.986 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:16:06.018 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T22:16:06.019+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54401) UID: 0 2024-03-31T22:16:06.018 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T22:16:06.019+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54401) UID: 0 2024-03-31T22:16:06.018 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T22:16:06.019+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54401) UID: 0 2024-03-31T22:16:06.019 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T22:16:06.019+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54401) UID: 0 2024-03-31T22:18:50.940 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:18:50.944 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:19:21.111 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:19:21.115 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:19:51.342 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:19:51.347 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:20:21.464 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:20:21.468 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:20:51.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:20:51.588 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:21:21.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:21:22.210 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:21:52.338 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:21:52.340 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:22:22.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:22:22.515 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:22:52.605 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:22:52.608 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:23:22.777 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:23:22.790 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:23:52.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:23:52.920 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:24:23.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:24:23.202 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:24:53.380 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:24:53.384 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:25:23.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:25:23.582 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:25:54.004 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:25:54.007 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:26:24.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:26:24.149 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:26:54.335 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:26:54.340 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:27:24.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:27:24.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:27:54.599 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:27:54.604 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:28:24.775 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:28:24.779 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:28:55.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:28:55.172 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:29:25.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:29:25.313 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:29:55.416 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:29:55.420 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:30:25.548 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:30:25.552 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:30:55.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:30:55.730 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:31:25.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:31:25.886 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:31:56.028 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:31:56.034 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:32:26.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:32:26.183 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:32:56.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:32:56.521 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:33:26.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:33:26.748 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:33:56.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:33:56.926 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:34:27.010 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:34:27.013 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:34:57.106 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:34:57.109 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:34:57.145 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T22:34:57.146+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55032) UID: 0 2024-03-31T22:34:57.146 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T22:34:57.146+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55032) UID: 0 2024-03-31T22:34:57.146 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T22:34:57.146+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55032) UID: 0 2024-03-31T22:34:57.146 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T22:34:57.146+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55032) UID: 0 2024-03-31T22:37:32.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:37:32.739 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:38:02.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:38:02.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:38:33.302 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:38:33.306 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:39:03.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:39:03.430 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:39:33.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:39:33.673 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:39:33.773 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T22:39:33.773+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 702369) UID: 0 2024-03-31T22:39:33.774 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T22:39:33.773+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 702369) UID: 0 2024-03-31T22:39:33.778 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T22:39:33.776+0000 7f67f523c640 -1 Fail to open '/proc/702369/cmdline' error = (2) No such file or directory 2024-03-31T22:39:33.778 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T22:39:33.776+0000 7f67f523c640 -1 received signal: Hangup from (PID: 702369) UID: 0 2024-03-31T22:39:33.796 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T22:39:33.795+0000 7fd012219640 -1 Fail to open '/proc/702369/cmdline' error = (2) No such file or directory 2024-03-31T22:39:33.796 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T22:39:33.795+0000 7fd012219640 -1 received signal: Hangup from (PID: 702369) UID: 0 2024-03-31T22:44:47.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:44:47.039 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:45:17.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:45:17.192 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:45:47.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:45:47.355 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:46:17.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:46:17.484 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:46:47.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:46:47.632 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:47:17.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:47:17.752 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:47:47.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:47:47.967 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:48:18.122 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:48:18.126 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:48:48.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:48:48.326 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:49:18.525 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:49:18.529 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:49:48.844 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:49:48.850 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:50:18.974 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:50:18.980 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T22:50:19.044 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T22:50:19.043+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 703781) UID: 0 2024-03-31T22:50:19.044 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T22:50:19.043+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 703781) UID: 0 2024-03-31T22:53:45.817 INFO:teuthology.orchestra.run.smithi120.stdout:generic/650 3364s 2024-03-31T22:53:46.193 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/650 2024-03-31T22:53:46.194 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:53:46.194 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:46.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:53:46.199 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-03-31T22:53:46.882 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:53:46.897 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:53:46.899 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:53:46.902 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:53:46.902 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:48.248 INFO:teuthology.orchestra.run.smithi120.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:53:48.263 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/651 2024-03-31T22:53:48.264 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/651 2024-03-31T22:53:48.264 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:53:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:48.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:53:48.693 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-03-31T22:53:49.450 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:53:49.459 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:53:49.460 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:53:49.461 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:53:49.461 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:50.720 INFO:teuthology.orchestra.run.smithi120.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:53:50.735 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/652 2024-03-31T22:53:50.735 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/652 2024-03-31T22:53:50.735 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:53:50.745 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:51.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:53:51.018 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-03-31T22:53:51.733 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:53:51.756 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:53:51.758 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:53:51.760 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:53:51.760 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:52.864 INFO:teuthology.orchestra.run.smithi120.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:53:52.878 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/653 2024-03-31T22:53:52.878 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/653 2024-03-31T22:53:52.878 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:53:52.900 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:53.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:53:53.184 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-03-31T22:53:53.939 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:53:53.956 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:53:53.957 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:53:53.960 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:53:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:55.079 INFO:teuthology.orchestra.run.smithi120.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:53:55.097 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/654 2024-03-31T22:53:55.097 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/654 2024-03-31T22:53:55.098 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:53:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:55.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:53:55.329 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-03-31T22:53:56.121 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:53:56.134 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:53:56.136 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:53:56.139 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:53:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:57.344 INFO:teuthology.orchestra.run.smithi120.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:53:57.360 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/655 2024-03-31T22:53:57.362 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/655 2024-03-31T22:53:57.363 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:53:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:57.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:53:57.609 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-03-31T22:53:58.307 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:53:58.321 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:53:58.322 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:53:58.325 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:53:58.325 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:59.137 INFO:teuthology.orchestra.run.smithi120.stdout:generic/656 [not run] vfstest not support by ceph 2024-03-31T22:53:59.150 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/656 2024-03-31T22:53:59.151 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/656 2024-03-31T22:53:59.151 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:53:59.158 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:53:59.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:53:59.210 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-03-31T22:53:59.866 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:53:59.879 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:53:59.880 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:53:59.884 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:53:59.884 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:01.079 INFO:teuthology.orchestra.run.smithi120.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:01.093 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/657 2024-03-31T22:54:01.094 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/657 2024-03-31T22:54:01.094 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:01.110 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:01.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:01.337 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-03-31T22:54:02.261 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:02.287 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:02.290 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:03.556 INFO:teuthology.orchestra.run.smithi120.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:03.573 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/658 2024-03-31T22:54:03.573 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/658 2024-03-31T22:54:03.573 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:03.579 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:03.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:03.765 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-03-31T22:54:04.593 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:04.623 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:04.626 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:04.627 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:04.627 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:05.779 INFO:teuthology.orchestra.run.smithi120.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:05.791 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/659 2024-03-31T22:54:05.791 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/659 2024-03-31T22:54:05.791 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:05.799 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:06.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:06.039 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-03-31T22:54:06.835 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:06.855 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:06.857 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:06.860 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:06.860 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:08.184 INFO:teuthology.orchestra.run.smithi120.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:08.208 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/660 2024-03-31T22:54:08.208 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/660 2024-03-31T22:54:08.208 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:08.220 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:08.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:08.484 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-03-31T22:54:09.125 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:09.141 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:09.142 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:09.145 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:10.288 INFO:teuthology.orchestra.run.smithi120.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:10.311 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/661 2024-03-31T22:54:10.311 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/661 2024-03-31T22:54:10.316 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:10.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:10.592 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-03-31T22:54:11.367 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:11.378 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:11.381 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:11.383 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:11.383 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:12.685 INFO:teuthology.orchestra.run.smithi120.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:12.700 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/662 2024-03-31T22:54:12.701 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/662 2024-03-31T22:54:12.701 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:12.715 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:12.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:12.900 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-03-31T22:54:13.736 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:13.746 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:13.747 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:13.748 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:13.748 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:14.921 INFO:teuthology.orchestra.run.smithi120.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:14.936 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/663 2024-03-31T22:54:14.936 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/663 2024-03-31T22:54:14.937 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:14.946 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:15.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:15.205 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-03-31T22:54:15.879 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:15.892 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:15.893 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:15.897 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:15.897 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:17.100 INFO:teuthology.orchestra.run.smithi120.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:17.116 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/664 2024-03-31T22:54:17.117 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/664 2024-03-31T22:54:17.117 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:17.129 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:17.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:17.403 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-03-31T22:54:18.169 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:18.182 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:18.183 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:18.186 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:18.187 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:19.397 INFO:teuthology.orchestra.run.smithi120.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:19.410 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/665 2024-03-31T22:54:19.411 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/665 2024-03-31T22:54:19.411 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:19.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:19.782 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-03-31T22:54:20.478 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:20.487 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:20.488 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:20.492 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:20.492 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:21.752 INFO:teuthology.orchestra.run.smithi120.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:21.771 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/666 2024-03-31T22:54:21.771 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/666 2024-03-31T22:54:21.771 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:21.781 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:22.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:22.098 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-03-31T22:54:22.776 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:22.794 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:22.798 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:22.801 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:22.801 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:24.069 INFO:teuthology.orchestra.run.smithi120.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:24.084 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/667 2024-03-31T22:54:24.084 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/667 2024-03-31T22:54:24.084 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:24.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:24.357 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-03-31T22:54:25.115 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:25.128 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:25.129 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:25.133 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:25.133 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:26.459 INFO:teuthology.orchestra.run.smithi120.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:26.473 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/668 2024-03-31T22:54:26.473 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/668 2024-03-31T22:54:26.473 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:26.496 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:26.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:26.812 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-03-31T22:54:27.529 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:27.547 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:27.548 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:27.550 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:27.550 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:28.794 INFO:teuthology.orchestra.run.smithi120.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:28.808 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/669 2024-03-31T22:54:28.808 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/669 2024-03-31T22:54:28.808 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:28.818 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:29.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:29.150 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-03-31T22:54:29.791 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:29.805 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:29.807 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:29.823 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:29.823 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:31.156 INFO:teuthology.orchestra.run.smithi120.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:31.164 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/670 2024-03-31T22:54:31.164 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/670 2024-03-31T22:54:31.165 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:31.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:31.566 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-03-31T22:54:32.291 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:32.303 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:32.304 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:32.304 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:32.305 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:33.583 INFO:teuthology.orchestra.run.smithi120.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:33.597 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/671 2024-03-31T22:54:33.597 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/671 2024-03-31T22:54:33.598 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:33.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:33.848 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-03-31T22:54:34.572 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:34.584 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:34.584 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:34.586 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:35.677 INFO:teuthology.orchestra.run.smithi120.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:35.694 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/672 2024-03-31T22:54:35.695 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/672 2024-03-31T22:54:35.695 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:35.716 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:36.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:36.298 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-03-31T22:54:36.904 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:36.918 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:36.920 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:36.923 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:38.821 INFO:teuthology.orchestra.run.smithi120.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:38.835 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/673 2024-03-31T22:54:38.835 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/673 2024-03-31T22:54:38.835 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:38.846 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:39.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:39.228 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-03-31T22:54:39.962 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:39.978 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:39.979 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:39.993 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:39.993 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:41.345 INFO:teuthology.orchestra.run.smithi120.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-31T22:54:41.541 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/674 2024-03-31T22:54:41.542 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/674 2024-03-31T22:54:41.542 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:41.551 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:41.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:41.903 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-03-31T22:54:42.709 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:42.724 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:42.725 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:42.729 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:42.729 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:44.150 INFO:teuthology.orchestra.run.smithi120.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T22:54:44.165 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/675 2024-03-31T22:54:44.165 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/675 2024-03-31T22:54:44.166 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T22:54:44.176 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:54:44.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T22:54:44.441 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-03-31T22:54:45.264 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T22:54:45.276 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T22:54:45.276 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T22:54:45.279 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T22:54:45.279 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T22:58:04.530 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T22:58:04.528+0000 7f67f523c640 -1 Fail to open '/proc/716256/cmdline' error = (2) No such file or directory 2024-03-31T22:58:04.530 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T22:58:04.528+0000 7f67f523c640 -1 received signal: Hangup from (PID: 716256) UID: 0 2024-03-31T22:58:04.530 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T22:58:04.524+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 716256) UID: 0 2024-03-31T22:58:04.531 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T22:58:04.524+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 716256) UID: 0 2024-03-31T22:58:04.532 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T22:58:04.532+0000 7f421f549640 -1 Fail to open '/proc/716256/cmdline' error = (2) No such file or directory 2024-03-31T22:58:04.533 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T22:58:04.532+0000 7f421f549640 -1 received signal: Hangup from (PID: 716256) UID: 0 2024-03-31T23:06:00.016 INFO:teuthology.orchestra.run.smithi120.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.0.log.1: 2024-03-31T23:06:00.017 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: stdin: file size changed while zipping 2024-03-31T23:14:11.419 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T23:14:11.423 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T23:14:11.461 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T23:14:11.461+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55412) UID: 0 2024-03-31T23:14:11.461 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T23:14:11.461+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55412) UID: 0 2024-03-31T23:14:11.462 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T23:14:11.461+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55412) UID: 0 2024-03-31T23:14:11.463 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T23:14:11.461+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55412) UID: 0 2024-03-31T23:14:11.582 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T23:14:11.581+0000 7f9e83ed4640 -1 Fail to open '/proc/716311/cmdline' error = (2) No such file or directory 2024-03-31T23:14:11.582 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T23:14:11.581+0000 7f9e83ed4640 -1 received signal: Hangup from (PID: 716311) UID: 0 2024-03-31T23:14:11.583 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T23:14:11.580+0000 7ff86c86b640 -1 Fail to open '/proc/716311/cmdline' error = (2) No such file or directory 2024-03-31T23:14:11.583 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T23:14:11.580+0000 7ff86c86b640 -1 received signal: Hangup from (PID: 716311) UID: 0 2024-03-31T23:18:40.423 INFO:teuthology.orchestra.run.smithi120.stdout:generic/676 1435s 2024-03-31T23:18:40.453 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/676 2024-03-31T23:18:40.453 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:18:40.464 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:40.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:18:40.759 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-03-31T23:18:41.551 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:18:41.555 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:18:41.556 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:18:41.557 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:18:41.557 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:42.436 INFO:teuthology.orchestra.run.smithi120.stdout:generic/677 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T23:18:42.449 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/677 2024-03-31T23:18:42.450 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/677 2024-03-31T23:18:42.450 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:18:42.458 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:42.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:18:42.558 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-03-31T23:18:43.208 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:18:43.234 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:18:43.234 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:18:43.238 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:18:43.238 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:43.985 INFO:teuthology.orchestra.run.smithi120.stdout:generic/678 [not run] kernel does not support IO_URING 2024-03-31T23:18:43.998 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/678 2024-03-31T23:18:43.998 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/678 2024-03-31T23:18:43.998 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:18:44.010 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:44.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:18:44.060 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-03-31T23:18:44.681 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:18:44.696 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:18:44.697 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:18:44.702 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:18:44.702 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:45.380 INFO:teuthology.orchestra.run.smithi120.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T23:18:45.385 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/679 2024-03-31T23:18:45.385 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/679 2024-03-31T23:18:45.386 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:18:45.392 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:45.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:18:45.443 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-03-31T23:18:46.113 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:18:46.127 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:18:46.128 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:18:46.132 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:18:46.133 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:48.615 INFO:teuthology.orchestra.run.smithi120.stdout:generic/680 2s 2024-03-31T23:18:48.635 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/680 2024-03-31T23:18:48.636 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:18:48.641 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:48.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:18:48.834 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-03-31T23:18:49.881 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:18:49.894 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:18:49.895 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:18:49.897 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:18:49.897 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:50.607 INFO:teuthology.orchestra.run.smithi120.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T23:18:50.614 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/681 2024-03-31T23:18:50.614 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/681 2024-03-31T23:18:50.615 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:18:50.621 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:50.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:18:50.663 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-03-31T23:18:51.326 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:18:51.334 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:18:51.334 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:18:51.337 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:18:51.337 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:52.015 INFO:teuthology.orchestra.run.smithi120.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T23:18:52.030 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/682 2024-03-31T23:18:52.030 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/682 2024-03-31T23:18:52.030 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:18:52.041 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:52.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:18:52.079 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-03-31T23:18:52.639 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:18:52.650 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:18:52.653 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:18:52.655 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:18:52.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:53.493 INFO:teuthology.orchestra.run.smithi120.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T23:18:53.501 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/683 2024-03-31T23:18:53.502 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/683 2024-03-31T23:18:53.502 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:18:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:18:53.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:18:53.569 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-03-31T23:18:54.345 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:18:54.360 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:18:54.362 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:18:54.366 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:18:54.366 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:03.063 INFO:teuthology.orchestra.run.smithi120.stdout:generic/684 - output mismatch (see /tmp/tmp.HCjZqVXECMxfstests-dev/results//generic/684.out.bad) 2024-03-31T23:19:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: --- tests/generic/684.out 2024-03-31 16:36:30.516492092 +0000 2024-03-31T23:19:03.066 INFO:teuthology.orchestra.run.smithi120.stdout: +++ /tmp/tmp.HCjZqVXECMxfstests-dev/results//generic/684.out.bad 2024-03-31 23:19:03.038542824 +0000 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: @@ -1,7 +1,7 @@ 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: QA output created by 684 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: Test 1 - qa_user, non-exec file fpunch 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: -666 -rw-rw-rw- TEST_DIR/684/a 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: +2666 -rw-rwSrw- TEST_DIR/684/a 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: Test 2 - qa_user, group-exec file fpunch 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: 6676 -rwSrwsrw- TEST_DIR/684/a 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: @@ -9,7 +9,7 @@ 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: Test 3 - qa_user, user-exec file fpunch 2024-03-31T23:19:03.067 INFO:teuthology.orchestra.run.smithi120.stdout: 6766 -rwsrwSrw- TEST_DIR/684/a 2024-03-31T23:19:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: -766 -rwxrw-rw- TEST_DIR/684/a 2024-03-31T23:19:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: +2766 -rwxrwSrw- TEST_DIR/684/a 2024-03-31T23:19:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: Test 4 - qa_user, all-exec file fpunch 2024-03-31T23:19:03.068 INFO:teuthology.orchestra.run.smithi120.stdout: 6777 -rwsrwsrwx TEST_DIR/684/a 2024-03-31T23:19:03.074 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/684 2024-03-31T23:19:03.074 INFO:teuthology.orchestra.run.smithi120.stdout:Failures: generic/684 2024-03-31T23:19:03.074 INFO:teuthology.orchestra.run.smithi120.stdout:Failed 1 of 1 tests 2024-03-31T23:19:03.088 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:03.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-31T23:19:03.157 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-31T23:19:03.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-31T23:19:03.157 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-03-31T23:19:04.105 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:04.118 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:04.118 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:04.121 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:04.121 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:05.089 INFO:teuthology.orchestra.run.smithi120.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-31T23:19:05.104 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/685 2024-03-31T23:19:05.104 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/685 2024-03-31T23:19:05.104 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:05.111 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:05.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:05.165 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-03-31T23:19:05.845 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:05.859 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:05.860 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:05.863 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:05.863 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:06.802 INFO:teuthology.orchestra.run.smithi120.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-31T23:19:06.813 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/686 2024-03-31T23:19:06.821 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/686 2024-03-31T23:19:06.821 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:06.822 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:06.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:06.870 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-03-31T23:19:07.551 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:07.563 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:07.564 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:07.568 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:08.595 INFO:teuthology.orchestra.run.smithi120.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-31T23:19:08.609 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/687 2024-03-31T23:19:08.609 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/687 2024-03-31T23:19:08.609 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:08.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:08.681 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-03-31T23:19:09.347 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:09.367 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:09.368 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:09.375 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:09.375 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:10.220 INFO:teuthology.orchestra.run.smithi120.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-31T23:19:10.230 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/688 2024-03-31T23:19:10.230 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/688 2024-03-31T23:19:10.230 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:10.237 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:10.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:10.290 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-03-31T23:19:11.060 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:11.075 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:11.077 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:11.081 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:11.803 INFO:teuthology.orchestra.run.smithi120.stdout:generic/689 [not run] vfstest not support by ceph 2024-03-31T23:19:11.815 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/689 2024-03-31T23:19:11.815 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/689 2024-03-31T23:19:11.815 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:11.823 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:11.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:11.854 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-03-31T23:19:12.624 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:12.640 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:12.641 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:12.643 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:12.643 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:13.524 INFO:teuthology.orchestra.run.smithi120.stdout:generic/690 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T23:19:13.538 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/690 2024-03-31T23:19:13.538 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/690 2024-03-31T23:19:13.539 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:13.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:13.608 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-03-31T23:19:14.320 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:14.342 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:14.344 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:14.348 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:14.348 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:15.040 INFO:teuthology.orchestra.run.smithi120.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-31T23:19:15.053 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/691 2024-03-31T23:19:15.053 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/691 2024-03-31T23:19:15.053 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:15.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:15.095 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-03-31T23:19:15.818 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:15.831 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:15.832 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:15.836 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:15.836 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:16.607 INFO:teuthology.orchestra.run.smithi120.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-03-31T23:19:16.621 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/692 2024-03-31T23:19:16.621 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/692 2024-03-31T23:19:16.621 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:16.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:16.668 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-03-31T23:19:17.314 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:17.330 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:17.331 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:17.334 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:17.334 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:generic/693 [not run] kernel does not support ceph encryption 2024-03-31T23:19:18.487 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/693 2024-03-31T23:19:18.487 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/693 2024-03-31T23:19:18.487 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:18.495 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:18.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:18.535 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-03-31T23:19:19.165 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:19.182 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:19.183 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:19.185 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:19.185 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:32.374 INFO:teuthology.orchestra.run.smithi120.stdout:generic/694 13s 2024-03-31T23:19:32.407 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/694 2024-03-31T23:19:32.408 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:32.417 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:32.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:32.477 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-03-31T23:19:33.180 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:33.194 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:33.196 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:33.199 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:33.199 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:33.928 INFO:teuthology.orchestra.run.smithi120.stdout:generic/695 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2024-03-31T23:19:33.939 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/695 2024-03-31T23:19:33.939 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/695 2024-03-31T23:19:33.940 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:33.949 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:33.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:33.981 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-03-31T23:19:34.601 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:34.615 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:34.616 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:34.619 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:36.171 INFO:teuthology.orchestra.run.smithi120.stdout:generic/696 2s 2024-03-31T23:19:36.202 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/696 2024-03-31T23:19:36.202 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:36.224 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:36.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:36.356 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-03-31T23:19:37.411 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:37.434 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:37.436 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:37.439 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:37.439 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:38.622 INFO:teuthology.orchestra.run.smithi120.stdout:generic/697 1s 2024-03-31T23:19:38.646 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/697 2024-03-31T23:19:38.646 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:38.656 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:38.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:38.874 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-03-31T23:19:39.712 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:39.722 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:39.723 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:39.726 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:40.633 INFO:teuthology.orchestra.run.smithi120.stdout:generic/698 [not run] vfstest not support by ceph 2024-03-31T23:19:40.646 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/698 2024-03-31T23:19:40.646 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/698 2024-03-31T23:19:40.646 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:40.657 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:40.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:40.719 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-03-31T23:19:41.524 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:41.536 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:41.538 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:41.550 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:41.550 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:42.375 INFO:teuthology.orchestra.run.smithi120.stdout:generic/699 [not run] vfstest not support by ceph 2024-03-31T23:19:42.381 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/699 2024-03-31T23:19:42.381 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/699 2024-03-31T23:19:42.381 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:42.385 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:42.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:42.458 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-03-31T23:19:43.199 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:43.213 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:43.215 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:43.220 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:43.220 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:44.162 INFO:teuthology.orchestra.run.smithi120.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-03-31T23:19:44.170 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/700 2024-03-31T23:19:44.170 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/700 2024-03-31T23:19:44.170 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:44.177 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:44.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:19:44.362 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-03-31T23:19:45.200 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:19:45.213 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:19:45.215 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:19:45.226 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:19:45.226 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:19:56.567 INFO:teuthology.orchestra.run.smithi120.stdout:generic/701 11s 2024-03-31T23:19:56.589 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/701 2024-03-31T23:19:56.589 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:19:56.597 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:00.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:20:00.883 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-03-31T23:20:01.914 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:20:01.930 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:20:01.938 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:20:01.941 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:20:01.941 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:03.155 INFO:teuthology.orchestra.run.smithi120.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-31T23:20:03.169 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/702 2024-03-31T23:20:03.169 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/702 2024-03-31T23:20:03.170 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:20:03.180 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:03.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:20:03.883 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-03-31T23:20:04.594 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:20:04.619 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:20:04.621 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:20:04.624 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:20:04.624 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:05.680 INFO:teuthology.orchestra.run.smithi120.stdout:generic/703 [not run] kernel does not support IO_URING 2024-03-31T23:20:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/703 2024-03-31T23:20:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/703 2024-03-31T23:20:05.697 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:20:05.705 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:05.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:20:05.763 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-03-31T23:20:06.465 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:20:06.483 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:20:06.484 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:20:06.487 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:20:06.487 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:07.479 INFO:teuthology.orchestra.run.smithi120.stdout:generic/704 [not run] require 172.21.15.120:6789:/test to be valid block disk 2024-03-31T23:20:07.493 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/704 2024-03-31T23:20:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/704 2024-03-31T23:20:07.494 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:20:07.503 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:07.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:20:07.560 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-03-31T23:20:08.191 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:20:08.199 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:20:08.201 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:20:08.209 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:20:08.209 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:09.211 INFO:teuthology.orchestra.run.smithi120.stdout:generic/705 [not run] ceph does not support shutdown 2024-03-31T23:20:09.235 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/705 2024-03-31T23:20:09.235 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/705 2024-03-31T23:20:09.236 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:20:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:09.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:20:09.283 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-03-31T23:20:09.957 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:20:09.974 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:20:09.976 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:20:09.978 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:20:09.978 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:14.583 INFO:teuthology.orchestra.run.smithi120.stdout:generic/706 4s 2024-03-31T23:20:14.621 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/706 2024-03-31T23:20:14.621 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-03-31T23:20:14.634 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:20:14.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-31T23:20:14.828 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-03-31T23:20:15.914 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-03-31T23:20:15.928 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-03-31T23:20:15.930 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-03-31T23:20:15.932 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-03-31T23:20:15.933 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-03-31T23:38:07.825 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-03-31T23:38:07.822+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 771520) UID: 0 2024-03-31T23:38:07.851 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T23:38:07.825+0000 7effe18db640 -1 Fail to open '/proc/771520/cmdline' error = (2) No such file or directory 2024-03-31T23:38:07.851 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-03-31T23:38:07.825+0000 7effe18db640 -1 received signal: Hangup from (PID: 771520) UID: 0 2024-03-31T23:38:07.852 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T23:38:07.825+0000 7f421f549640 -1 Fail to open '/proc/771520/cmdline' error = (2) No such file or directory 2024-03-31T23:38:07.852 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-03-31T23:38:07.825+0000 7f421f549640 -1 received signal: Hangup from (PID: 771520) UID: 0 2024-03-31T23:38:07.852 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-03-31T23:38:07.822+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 771520) UID: 0 2024-03-31T23:47:33.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T23:47:33.195 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-31T23:47:33.236 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-03-31T23:47:33.236+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55458) UID: 0 2024-03-31T23:47:33.236 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-03-31T23:47:33.236+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55458) UID: 0 2024-03-31T23:47:33.236 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-03-31T23:47:33.236+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55458) UID: 0 2024-03-31T23:47:33.236 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-03-31T23:47:33.236+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55458) UID: 0 2024-03-31T23:47:33.336 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-03-31T23:47:33.335+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 792415) UID: 0 2024-03-31T23:47:33.337 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-03-31T23:47:33.335+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 792415) UID: 0 2024-04-01T00:00:29.735 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-01T00:00:29.734+0000 7fb491d1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55481) UID: 0 2024-04-01T00:00:29.759 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-01T00:00:29.734+0000 7fca0b2c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55481) UID: 0 2024-04-01T00:00:29.759 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-01T00:00:29.734+0000 7f4dc118c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55481) UID: 0 2024-04-01T00:00:29.759 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-01T00:00:29.734+0000 7f7fa48b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55481) UID: 0 2024-04-01T00:00:41.667 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-01T00:00:41.666+0000 7f67f523c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 821753) UID: 0 2024-04-01T00:00:41.668 INFO:tasks.ceph.osd.1.smithi120.stderr:2024-04-01T00:00:41.666+0000 7fd012219640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 821753) UID: 0 2024-04-01T00:00:41.668 INFO:tasks.ceph.osd.2.smithi120.stderr:2024-04-01T00:00:41.666+0000 7effe18db640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 821753) UID: 0 2024-04-01T00:00:41.669 INFO:tasks.ceph.osd.3.smithi120.stderr:2024-04-01T00:00:41.666+0000 7f421f549640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 821753) UID: 0 2024-04-01T00:05:16.716 INFO:teuthology.orchestra.run.smithi120.stdout:generic/707 2700s 2024-04-01T00:05:16.772 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/707 2024-04-01T00:05:16.772 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:16.780 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:16.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:16.810 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-04-01T00:05:17.837 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:17.859 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:17.862 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:17.866 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:25.569 INFO:teuthology.orchestra.run.smithi120.stdout:generic/708 1s 2024-04-01T00:05:25.590 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/708 2024-04-01T00:05:25.591 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:25.601 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:25.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:25.752 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-04-01T00:05:26.934 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:26.940 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:26.940 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:26.941 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:27.995 INFO:teuthology.orchestra.run.smithi120.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:28.009 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/709 2024-04-01T00:05:28.009 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/709 2024-04-01T00:05:28.009 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:28.015 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:28.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:28.136 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-04-01T00:05:29.081 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:29.101 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:29.102 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:29.106 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:29.106 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:30.033 INFO:teuthology.orchestra.run.smithi120.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:30.038 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/710 2024-04-01T00:05:30.039 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/710 2024-04-01T00:05:30.039 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:30.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:30.211 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-04-01T00:05:31.181 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:31.193 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:31.194 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:31.197 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:32.078 INFO:teuthology.orchestra.run.smithi120.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:32.092 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/711 2024-04-01T00:05:32.092 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/711 2024-04-01T00:05:32.093 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:32.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:32.249 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-04-01T00:05:33.136 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:33.160 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:33.162 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:33.165 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:33.165 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:33.977 INFO:teuthology.orchestra.run.smithi120.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:33.990 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/712 2024-04-01T00:05:33.990 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/712 2024-04-01T00:05:33.991 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:34.000 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:34.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:34.083 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-04-01T00:05:35.151 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:35.161 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:35.162 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:35.166 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:35.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:36.112 INFO:teuthology.orchestra.run.smithi120.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-04-01T00:05:36.126 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/713 2024-04-01T00:05:36.127 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/713 2024-04-01T00:05:36.127 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:36.137 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:36.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:36.351 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-04-01T00:05:37.562 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:37.568 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:37.569 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:37.572 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:37.572 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:38.452 INFO:teuthology.orchestra.run.smithi120.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:38.466 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/714 2024-04-01T00:05:38.466 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/714 2024-04-01T00:05:38.466 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:38.477 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:38.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:38.599 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-04-01T00:05:39.684 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:39.692 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:39.693 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:39.695 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:40.513 INFO:teuthology.orchestra.run.smithi120.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-04-01T00:05:40.524 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/715 2024-04-01T00:05:40.524 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/715 2024-04-01T00:05:40.524 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:40.536 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:40.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:40.729 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-04-01T00:05:41.566 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:41.582 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:41.584 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:41.587 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:41.587 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:42.591 INFO:teuthology.orchestra.run.smithi120.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:42.605 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/716 2024-04-01T00:05:42.605 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/716 2024-04-01T00:05:42.605 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:42.608 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:42.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:42.759 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-04-01T00:05:43.674 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:43.689 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:43.691 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:43.694 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:43.694 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:44.555 INFO:teuthology.orchestra.run.smithi120.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:44.568 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/717 2024-04-01T00:05:44.568 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/717 2024-04-01T00:05:44.568 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:44.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:44.740 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-04-01T00:05:45.672 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:45.685 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:45.687 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:45.698 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:46.532 INFO:teuthology.orchestra.run.smithi120.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:46.543 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/718 2024-04-01T00:05:46.543 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/718 2024-04-01T00:05:46.543 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:46.554 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:46.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:46.735 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-04-01T00:05:47.718 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:47.726 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:47.727 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:47.729 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:47.729 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:48.692 INFO:teuthology.orchestra.run.smithi120.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:48.702 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/719 2024-04-01T00:05:48.702 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/719 2024-04-01T00:05:48.703 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:48.710 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:48.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:48.899 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-04-01T00:05:49.844 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:49.854 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:49.855 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:49.861 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:49.861 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:50.709 INFO:teuthology.orchestra.run.smithi120.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:50.723 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/720 2024-04-01T00:05:50.723 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/720 2024-04-01T00:05:50.723 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:50.730 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:50.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:50.948 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-04-01T00:05:51.863 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:51.878 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:51.880 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:51.883 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:51.884 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:52.773 INFO:teuthology.orchestra.run.smithi120.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-04-01T00:05:52.791 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/721 2024-04-01T00:05:52.792 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/721 2024-04-01T00:05:52.792 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:52.802 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:52.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:52.894 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-04-01T00:05:53.666 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:53.682 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:53.684 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:53.687 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:54.622 INFO:teuthology.orchestra.run.smithi120.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-04-01T00:05:54.638 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/722 2024-04-01T00:05:54.638 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/722 2024-04-01T00:05:54.638 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:54.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:54.870 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-04-01T00:05:55.793 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:55.814 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:55.816 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:55.820 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:55.820 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:56.637 INFO:teuthology.orchestra.run.smithi120.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-04-01T00:05:56.647 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/723 2024-04-01T00:05:56.647 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/723 2024-04-01T00:05:56.648 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:56.655 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:56.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:56.744 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-04-01T00:05:57.661 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:57.676 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:57.678 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:57.681 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:58.592 INFO:teuthology.orchestra.run.smithi120.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-04-01T00:05:58.605 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/724 2024-04-01T00:05:58.605 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/724 2024-04-01T00:05:58.606 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:05:58.615 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:05:58.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:05:58.721 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-04-01T00:05:59.834 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:05:59.840 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:05:59.841 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:05:59.842 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:05:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:00.700 INFO:teuthology.orchestra.run.smithi120.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-04-01T00:06:00.713 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/725 2024-04-01T00:06:00.713 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/725 2024-04-01T00:06:00.713 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:00.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:00.944 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-04-01T00:06:02.059 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:02.074 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:02.076 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:02.078 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:02.078 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:04.045 INFO:teuthology.orchestra.run.smithi120.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-04-01T00:06:04.065 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/726 2024-04-01T00:06:04.066 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/726 2024-04-01T00:06:04.066 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:04.074 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:04.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:04.291 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-04-01T00:06:05.511 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:05.529 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:05.531 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:05.533 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:06.478 INFO:teuthology.orchestra.run.smithi120.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-04-01T00:06:06.487 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/727 2024-04-01T00:06:06.487 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/727 2024-04-01T00:06:06.487 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:06.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:06.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:06.674 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-04-01T00:06:07.567 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:07.586 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:07.589 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:07.589 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:12.669 INFO:teuthology.orchestra.run.smithi120.stdout:generic/728 5s 2024-04-01T00:06:12.688 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/728 2024-04-01T00:06:12.688 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:12.700 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:12.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:12.961 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-04-01T00:06:13.889 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:13.894 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:13.896 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:13.898 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:13.898 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:15.757 INFO:teuthology.orchestra.run.smithi120.stdout:generic/729 1s 2024-04-01T00:06:15.776 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/729 2024-04-01T00:06:15.777 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:15.787 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:15.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:15.902 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-04-01T00:06:17.043 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:17.054 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:17.056 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:17.065 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:17.066 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:17.945 INFO:teuthology.orchestra.run.smithi120.stdout:generic/730 [not run] require 172.21.15.120:6789:/test to be valid block disk 2024-04-01T00:06:17.958 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/730 2024-04-01T00:06:17.959 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/730 2024-04-01T00:06:17.959 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:17.971 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:18.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:18.033 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-04-01T00:06:18.778 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:18.793 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:18.795 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:18.798 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:19.695 INFO:teuthology.orchestra.run.smithi120.stdout:generic/731 [not run] require 172.21.15.120:6789:/test to be valid block disk 2024-04-01T00:06:19.705 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/731 2024-04-01T00:06:19.705 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/731 2024-04-01T00:06:19.705 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:19.716 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:19.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:19.783 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-04-01T00:06:20.475 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:20.488 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:20.490 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:20.494 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:20.494 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:22.869 INFO:teuthology.orchestra.run.smithi120.stdout:generic/732 2s 2024-04-01T00:06:22.892 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/732 2024-04-01T00:06:22.893 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:22.902 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:22.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:22.943 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-04-01T00:06:23.542 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:23.560 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:23.561 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:23.563 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:23.563 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:25.090 INFO:teuthology.orchestra.run.smithi120.stdout:generic/733 [not run] Reflink not supported by scratch filesystem type: ceph 2024-04-01T00:06:25.107 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/733 2024-04-01T00:06:25.108 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/733 2024-04-01T00:06:25.108 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:25.118 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:25.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:25.573 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-04-01T00:06:26.367 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:26.380 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:26.382 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:26.384 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:26.384 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:27.211 INFO:teuthology.orchestra.run.smithi120.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph 2024-04-01T00:06:27.221 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/734 2024-04-01T00:06:27.221 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/734 2024-04-01T00:06:27.221 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:27.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:27.467 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-04-01T00:06:28.435 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:28.447 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:28.449 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:28.452 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:28.453 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:29.489 INFO:teuthology.orchestra.run.smithi120.stdout:generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-04-01T00:06:29.502 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/735 2024-04-01T00:06:29.502 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/735 2024-04-01T00:06:29.503 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:06:29.508 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:06:29.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:06:29.710 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-04-01T00:06:30.561 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:06:30.576 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:06:30.578 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:06:30.581 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:06:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:08:21.968 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T00:08:21.972 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T00:08:52.129 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T00:08:52.135 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T00:09:22.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T00:09:22.290 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T00:09:52.441 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T00:09:52.448 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-01T00:09:52.564 INFO:tasks.ceph.mds.a.smithi120.stderr:2024-04-01T00:09:52.563+0000 7ff86c86b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 845212) UID: 0 2024-04-01T00:09:52.565 INFO:tasks.ceph.mds.c.smithi120.stderr:2024-04-01T00:09:52.564+0000 7f9e83ed4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 845212) UID: 0 2024-04-01T00:11:51.854 INFO:teuthology.orchestra.run.smithi120.stdout:generic/736 321s 2024-04-01T00:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/736 2024-04-01T00:11:51.881 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:11:51.889 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:11:52.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:11:52.179 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-04-01T00:11:52.935 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:11:52.949 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:11:52.951 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:11:52.954 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:11:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:11:53.851 INFO:teuthology.orchestra.run.smithi120.stdout:generic/737 [not run] ceph does not support shutdown 2024-04-01T00:11:53.871 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/737 2024-04-01T00:11:53.871 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/737 2024-04-01T00:11:53.871 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:11:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:11:53.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:11:53.913 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-04-01T00:11:54.543 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:11:54.559 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:11:54.561 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:11:54.564 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:11:54.565 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:11:55.318 INFO:teuthology.orchestra.run.smithi120.stdout:generic/738 [not run] ceph does not support freezing 2024-04-01T00:11:55.330 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/738 2024-04-01T00:11:55.331 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/738 2024-04-01T00:11:55.331 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:11:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:11:55.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:11:55.375 DEBUG:teuthology.orchestra.run.smithi120:> (cd /tmp/tmp.HCjZqVXECMxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-04-01T00:11:56.031 INFO:teuthology.orchestra.run.smithi120.stdout:FSTYP -- ceph 2024-04-01T00:11:56.047 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM -- Linux/x86_64 smithi120 5.14.0-434.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Mar 26 19:20:47 UTC 2024 2024-04-01T00:11:56.048 INFO:teuthology.orchestra.run.smithi120.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2024-04-01T00:11:56.051 INFO:teuthology.orchestra.run.smithi120.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCZkAlmZ7/gExAAZTFjQ6et/z5bYuQUIeuKCA== -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.QrZcf5mS2uscratch 2024-04-01T00:11:56.051 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:11:56.848 INFO:teuthology.orchestra.run.smithi120.stdout:generic/739 [not run] xfs_io set_encpolicy doesn't support -s 2024-04-01T00:11:56.858 INFO:teuthology.orchestra.run.smithi120.stdout:Ran: generic/739 2024-04-01T00:11:56.858 INFO:teuthology.orchestra.run.smithi120.stdout:Not run: generic/739 2024-04-01T00:11:56.858 INFO:teuthology.orchestra.run.smithi120.stdout:Passed all 1 tests 2024-04-01T00:11:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:11:56.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-04-01T00:11:56.897 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 2========================================================= 2024-04-01T00:11:56.898 DEBUG:teuthology.orchestra.run.smithi120:> sudo userdel --force --remove fsgqa 2024-04-01T00:11:58.503 DEBUG:teuthology.orchestra.run.smithi120:> sudo userdel --force --remove 123456-fsgqa 2024-04-01T00:11:59.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo groupdel fsgqa 2024-04-01T00:11:59.521 INFO:teuthology.orchestra.run.smithi120.stderr:groupdel: group 'fsgqa' does not exist 2024-04-01T00:11:59.525 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-01T00:11:59.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:11:59.526 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.HCjZqVXECMxfstests-dev/results) 2024-04-01T00:11:59.614 INFO:teuthology.orchestra.run.smithi120.stdout: File: /tmp/tmp.HCjZqVXECMxfstests-dev/results 2024-04-01T00:11:59.614 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-04-01T00:11:59.614 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 801h/2049d Inode: 423812 Links: 3 2024-04-01T00:11:59.614 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T00:11:59.614 INFO:teuthology.orchestra.run.smithi120.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2024-04-01T00:11:59.614 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-03-31 16:38:17.673047377 +0000 2024-04-01T00:11:59.615 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-01 00:11:51.874555731 +0000 2024-04-01T00:11:59.615 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-01 00:11:51.874555731 +0000 2024-04-01T00:11:59.615 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-03-31 16:38:17.673047377 +0000 2024-04-01T00:11:59.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:11:59.617 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-04-01T00:11:59.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:11:59.724 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.HCjZqVXECMxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-04-01T00:12:02.291 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.HCjZqVXECMxfstests-dev to /var/log/ceph. 2024-04-01T00:12:02.292 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf /tmp/tmp.HCjZqVXECMxfstests-dev 2024-04-01T00:12:03.021 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-01T00:12:03.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-01T00:12:03.193 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-01T00:12:03.274 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-01T00:12:03.274 INFO:tasks.cephfs.mount:Terminating background process 2024-04-01T00:12:03.275 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-01T00:12:03.275 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:03.342 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-01T00:12:03.342 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:03.433 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T00:12:04.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.130+0000 7f5794989640 1 Processor -- start 2024-04-01T00:12:04.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.130+0000 7f5794989640 1 -- start start 2024-04-01T00:12:04.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.134+0000 7f5794989640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f57900d2a40 0x7f57900d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:04.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.134+0000 7f5794989640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f57900d0be0 0x7f57900d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.134+0000 7f5794989640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57900d3360 con 0x7f5790163ba0 2024-04-01T00:12:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.134+0000 7f5794989640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f57900d1980 con 0x7f57900d0be0 2024-04-01T00:12:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.134+0000 7f5794989640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5790163710 con 0x7f57900d2a40 2024-04-01T00:12:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.135+0000 7f578dd9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f57900d0be0 0x7f57900d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.135+0000 7f578dd9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f57900d0be0 0x7f57900d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59032/0 (socket says 172.21.15.120:59032) 2024-04-01T00:12:04.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.135+0000 7f578dd9b640 1 -- 172.21.15.120:0/398191578 learned_addr learned my addr 172.21.15.120:0/398191578 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.135+0000 7f578dd9b640 1 -- 172.21.15.120:0/398191578 >> v2:172.21.15.203:3300/0 conn(0x7f57900d2a40 msgr2=0x7f57900d2410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T00:12:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.135+0000 7f578dd9b640 1 --2- 172.21.15.120:0/398191578 >> v2:172.21.15.203:3300/0 conn(0x7f57900d2a40 0x7f57900d2410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.135+0000 7f578dd9b640 1 -- 172.21.15.120:0/398191578 >> v1:172.21.15.203:6789/0 conn(0x7f5790163ba0 legacy=0x7f57900cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:04.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.135+0000 7f578dd9b640 1 -- 172.21.15.120:0/398191578 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57900d13c0 con 0x7f57900d0be0 2024-04-01T00:12:04.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.136+0000 7f578dd9b640 1 --2- 172.21.15.120:0/398191578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d0be0 0x7f57900d2e20 secure :-1 s=READY pgs=3226 cs=0 l=1 rev1=1 crypto rx=0x7f57900d1b30 tx=0x7f578402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2b4efca1f31c64 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:04.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.137+0000 7f578d59a640 1 -- 172.21.15.120:0/398191578 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784035020 con 0x7f57900d0be0 2024-04-01T00:12:04.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.137+0000 7f578d59a640 1 -- 172.21.15.120:0/398191578 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5784031890 con 0x7f57900d0be0 2024-04-01T00:12:04.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.137+0000 7f578d59a640 1 -- 172.21.15.120:0/398191578 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784031c60 con 0x7f57900d0be0 2024-04-01T00:12:04.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.138+0000 7f5794989640 1 -- 172.21.15.120:0/398191578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d0be0 msgr2=0x7f57900d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:04.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.138+0000 7f5794989640 1 --2- 172.21.15.120:0/398191578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d0be0 0x7f57900d2e20 secure :-1 s=READY pgs=3226 cs=0 l=1 rev1=1 crypto rx=0x7f57900d1b30 tx=0x7f578402b930 comp rx=0 tx=0).stop 2024-04-01T00:12:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.138+0000 7f5794989640 1 -- 172.21.15.120:0/398191578 shutdown_connections 2024-04-01T00:12:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.138+0000 7f5794989640 1 --2- 172.21.15.120:0/398191578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d0be0 0x7f57900d2e20 unknown :-1 s=CLOSED pgs=3226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.138+0000 7f5794989640 1 --2- 172.21.15.120:0/398191578 >> v2:172.21.15.203:3300/0 conn(0x7f57900d2a40 0x7f57900d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.138+0000 7f5794989640 1 -- 172.21.15.120:0/398191578 >> 172.21.15.120:0/398191578 conn(0x7f579008bfb0 msgr2=0x7f57900d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:04.143 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.140+0000 7f5794989640 1 -- 172.21.15.120:0/398191578 shutdown_connections 2024-04-01T00:12:04.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.140+0000 7f5794989640 1 -- 172.21.15.120:0/398191578 wait complete. 2024-04-01T00:12:04.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.145+0000 7f5794989640 1 Processor -- start 2024-04-01T00:12:04.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.145+0000 7f5794989640 1 -- start start 2024-04-01T00:12:04.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.149+0000 7f5794989640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57900d0be0 0x7f5790164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:04.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.149+0000 7f578e59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57900d0be0 0x7f5790164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:04.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.149+0000 7f578e59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57900d0be0 0x7f5790164b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:47590/0 (socket says 172.21.15.120:47590) 2024-04-01T00:12:04.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.149+0000 7f578e59c640 1 -- 172.21.15.120:0/1791932045 learned_addr learned my addr 172.21.15.120:0/1791932045 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:04.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.150+0000 7f5794989640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d2a40 0x7f57901fc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:04.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.151+0000 7f578dd9b640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d2a40 0x7f57901fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:04.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.151+0000 7f5794989640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5790163ba0 0x7f57900ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:04.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.151+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f57900d1040 con 0x7f57900d2a40 2024-04-01T00:12:04.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.151+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f57901633a0 con 0x7f5790163ba0 2024-04-01T00:12:04.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.151+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5790164030 con 0x7f57900d0be0 2024-04-01T00:12:04.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.152+0000 7f578e59c640 1 -- 172.21.15.120:0/1791932045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5790163ba0 msgr2=0x7f57900ca350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T00:12:04.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.152+0000 7f578e59c640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5790163ba0 0x7f57900ca350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.152+0000 7f578e59c640 1 -- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d2a40 msgr2=0x7f57901fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:04.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.152+0000 7f578e59c640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d2a40 0x7f57901fc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.152+0000 7f578e59c640 1 -- 172.21.15.120:0/1791932045 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5790165090 con 0x7f57900d0be0 2024-04-01T00:12:04.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.152+0000 7f578dd9b640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d2a40 0x7f57901fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T00:12:04.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.153+0000 7f578e59c640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57900d0be0 0x7f5790164b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f578000ba80 tx=0x7f578000bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:04.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.153+0000 7f577effd640 1 -- 172.21.15.120:0/1791932045 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780019070 con 0x7f57900d0be0 2024-04-01T00:12:04.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.153+0000 7f577effd640 1 -- 172.21.15.120:0/1791932045 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578000cc20 con 0x7f57900d0be0 2024-04-01T00:12:04.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.153+0000 7f577effd640 1 -- 172.21.15.120:0/1791932045 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780014440 con 0x7f57900d0be0 2024-04-01T00:12:04.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.153+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57900b1d10 con 0x7f57900d0be0 2024-04-01T00:12:04.155 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.154+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f57900b22d0 con 0x7f57900d0be0 2024-04-01T00:12:04.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.158+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5774005290 con 0x7f57900d0be0 2024-04-01T00:12:04.160 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.158+0000 7f577effd640 1 -- 172.21.15.120:0/1791932045 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f578001c360 con 0x7f57900d0be0 2024-04-01T00:12:04.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.160+0000 7f577effd640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f577006c920 0x7f577006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:04.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.161+0000 7f577effd640 1 -- 172.21.15.120:0/1791932045 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f578008b810 con 0x7f57900d0be0 2024-04-01T00:12:04.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.162+0000 7f578dd9b640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f577006c920 0x7f577006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:04.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.163+0000 7f578dd9b640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f577006c920 0x7f577006ede0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5784036000 tx=0x7f578403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:04.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.182+0000 7f577effd640 1 -- 172.21.15.120:0/1791932045 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5780059bb0 con 0x7f57900d0be0 2024-04-01T00:12:04.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.552+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5774005580 con 0x7f57900d0be0 2024-04-01T00:12:04.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.572+0000 7f577effd640 1 -- 172.21.15.120:0/1791932045 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7f57800594b0 con 0x7f57900d0be0 2024-04-01T00:12:04.579 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:04.579 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:24.828471+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:36:21.024330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-31T16:36:22.128594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f577006c920 msgr2=0x7f577006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f577006c920 0x7f577006ede0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5784036000 tx=0x7f578403c040 comp rx=0 tx=0).stop 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57900d0be0 msgr2=0x7f5790164b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57900d0be0 0x7f5790164b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f578000ba80 tx=0x7f578000bf40 comp rx=0 tx=0).stop 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 shutdown_connections 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f577006c920 0x7f577006ede0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5790163ba0 0x7f57900ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f57900d2a40 0x7f57901fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 --2- 172.21.15.120:0/1791932045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57900d0be0 0x7f5790164b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.578+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 >> 172.21.15.120:0/1791932045 conn(0x7f579008bfb0 msgr2=0x7f57900cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:04.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.584+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 shutdown_connections 2024-04-01T00:12:04.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:04.584+0000 7f5794989640 1 -- 172.21.15.120:0/1791932045 wait complete. 2024-04-01T00:12:04.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:36:21.024330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:36:22.128594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T00:12:04.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T00:12:05.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.019+0000 7fe9060d9640 1 Processor -- start 2024-04-01T00:12:05.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.019+0000 7fe9060d9640 1 -- start start 2024-04-01T00:12:05.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe9060d9640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe9001660d0 0x7fe9000b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:05.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe9060d9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe900099bb0 0x7fe9000b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:05.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe9060d9640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9000b3ab0 0x7fe9000afab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe9060d9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe9000ad010 con 0x7fe900099bb0 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe9060d9640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe9000ad260 con 0x7fe9001660d0 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe9060d9640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe9000ad540 con 0x7fe9000b3ab0 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8ff7fe640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe9001660d0 0x7fe9000b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8ff7fe640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe9001660d0 0x7fe9000b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:42590/0 (socket says 172.21.15.120:42590) 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8ff7fe640 1 -- 172.21.15.120:0/2550972195 learned_addr learned my addr 172.21.15.120:0/2550972195 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8feffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe900099bb0 0x7fe9000b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8ff7fe640 1 -- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9000b3ab0 msgr2=0x7fe9000afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8fffff640 1 --2- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9000b3ab0 0x7fe9000afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8ff7fe640 1 --2- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9000b3ab0 0x7fe9000afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:05.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8ff7fe640 1 -- 172.21.15.120:0/2550972195 >> v2:172.21.15.120:3300/0 conn(0x7fe900099bb0 msgr2=0x7fe9000b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:05.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8ff7fe640 1 --2- 172.21.15.120:0/2550972195 >> v2:172.21.15.120:3300/0 conn(0x7fe900099bb0 0x7fe9000b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:05.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8ff7fe640 1 -- 172.21.15.120:0/2550972195 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9000ad820 con 0x7fe9001660d0 2024-04-01T00:12:05.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.023+0000 7fe8fffff640 1 --2- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9000b3ab0 0x7fe9000afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T00:12:05.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.025+0000 7fe8ff7fe640 1 --2- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 0x7fe9000b3030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe9000691b0 tx=0x7fe8f402b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9e418fbf4baf8b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:05.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.025+0000 7fe8fe7fc640 1 -- 172.21.15.120:0/2550972195 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40317f0 con 0x7fe9001660d0 2024-04-01T00:12:05.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.025+0000 7fe8fe7fc640 1 -- 172.21.15.120:0/2550972195 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f4037070 con 0x7fe9001660d0 2024-04-01T00:12:05.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.025+0000 7fe8fe7fc640 1 -- 172.21.15.120:0/2550972195 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f4031bb0 con 0x7fe9001660d0 2024-04-01T00:12:05.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.027+0000 7fe9060d9640 1 -- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 msgr2=0x7fe9000b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:05.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.027+0000 7fe9060d9640 1 --2- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 0x7fe9000b3030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe9000691b0 tx=0x7fe8f402b890 comp rx=0 tx=0).stop 2024-04-01T00:12:05.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.032+0000 7fe9060d9640 1 -- 172.21.15.120:0/2550972195 shutdown_connections 2024-04-01T00:12:05.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.032+0000 7fe9060d9640 1 --2- 172.21.15.120:0/2550972195 >> v2:172.21.15.120:3300/0 conn(0x7fe900099bb0 0x7fe9000b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:05.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.032+0000 7fe9060d9640 1 --2- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9000b3ab0 0x7fe9000afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:05.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.032+0000 7fe9060d9640 1 --2- 172.21.15.120:0/2550972195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 0x7fe9000b3030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:05.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.032+0000 7fe9060d9640 1 -- 172.21.15.120:0/2550972195 >> 172.21.15.120:0/2550972195 conn(0x7fe900072a00 msgr2=0x7fe900072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:05.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.034+0000 7fe9060d9640 1 -- 172.21.15.120:0/2550972195 shutdown_connections 2024-04-01T00:12:05.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.034+0000 7fe9060d9640 1 -- 172.21.15.120:0/2550972195 wait complete. 2024-04-01T00:12:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.036+0000 7fe9060d9640 1 Processor -- start 2024-04-01T00:12:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.036+0000 7fe9060d9640 1 -- start start 2024-04-01T00:12:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.037+0000 7fe9060d9640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe900099bb0 0x7fe900161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.037+0000 7fe9060d9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000b3ab0 0x7fe9001616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:05.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8feffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000b3ab0 0x7fe9001616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8feffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000b3ab0 0x7fe9001616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40136/0 (socket says 172.21.15.120:40136) 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8feffd640 1 -- 172.21.15.120:0/678683810 learned_addr learned my addr 172.21.15.120:0/678683810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe9060d9640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 0x7fe9001fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8ff7fe640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe900099bb0 0x7fe900161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe900166630 con 0x7fe9000b3ab0 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9001664b0 con 0x7fe9001660d0 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe9000afff0 con 0x7fe900099bb0 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8fffff640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 0x7fe9001fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8feffd640 1 -- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe900099bb0 msgr2=0x7fe900161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8feffd640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe900099bb0 0x7fe900161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:05.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8feffd640 1 -- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 msgr2=0x7fe9001fbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:05.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8feffd640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 0x7fe9001fbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:05.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.038+0000 7fe8feffd640 1 -- 172.21.15.120:0/678683810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9001f85e0 con 0x7fe9000b3ab0 2024-04-01T00:12:05.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.039+0000 7fe8fffff640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 0x7fe9001fbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T00:12:05.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.039+0000 7fe8feffd640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000b3ab0 0x7fe9001616d0 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800eeb0 tx=0x7fe8f800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:05.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.040+0000 7fe8e7fff640 1 -- 172.21.15.120:0/678683810 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8018020 con 0x7fe9000b3ab0 2024-04-01T00:12:05.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.040+0000 7fe8e7fff640 1 -- 172.21.15.120:0/678683810 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f800be50 con 0x7fe9000b3ab0 2024-04-01T00:12:05.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.040+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9001f88c0 con 0x7fe9000b3ab0 2024-04-01T00:12:05.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.041+0000 7fe8e7fff640 1 -- 172.21.15.120:0/678683810 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8014620 con 0x7fe9000b3ab0 2024-04-01T00:12:05.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.041+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9001f8e80 con 0x7fe9000b3ab0 2024-04-01T00:12:05.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.047+0000 7fe8e7fff640 1 -- 172.21.15.120:0/678683810 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8f8005d10 con 0x7fe9000b3ab0 2024-04-01T00:12:05.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.049+0000 7fe8e7fff640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8ec06c9c0 0x7fe8ec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:05.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.049+0000 7fe8ff7fe640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8ec06c9c0 0x7fe8ec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:05.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.050+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9000685c0 con 0x7fe9000b3ab0 2024-04-01T00:12:05.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.054+0000 7fe8e7fff640 1 -- 172.21.15.120:0/678683810 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe8f808c400 con 0x7fe9000b3ab0 2024-04-01T00:12:05.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.063+0000 7fe8ff7fe640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8ec06c9c0 0x7fe8ec06ee80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4036000 tx=0x7fe8f403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:05.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:05.079+0000 7fe8e7fff640 1 -- 172.21.15.120:0/678683810 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe8f8022030 con 0x7fe9000b3ab0 2024-04-01T00:12:06.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.111+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe9000af030 con 0x7fe9000b3ab0 2024-04-01T00:12:06.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.183+0000 7fe8e7fff640 1 -- 172.21.15.120:0/678683810 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7fe8f805a8a0 con 0x7fe9000b3ab0 2024-04-01T00:12:06.185 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-01T00:12:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.188+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8ec06c9c0 msgr2=0x7fe8ec06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.188+0000 7fe9060d9640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8ec06c9c0 0x7fe8ec06ee80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4036000 tx=0x7fe8f403d040 comp rx=0 tx=0).stop 2024-04-01T00:12:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000b3ab0 msgr2=0x7fe9001616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000b3ab0 0x7fe9001616d0 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800eeb0 tx=0x7fe8f800b480 comp rx=0 tx=0).stop 2024-04-01T00:12:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 shutdown_connections 2024-04-01T00:12:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8ec06c9c0 0x7fe8ec06ee80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9001660d0 0x7fe9001fbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:06.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9000b3ab0 0x7fe9001616d0 unknown :-1 s=CLOSED pgs=3227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:06.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 --2- 172.21.15.120:0/678683810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe900099bb0 0x7fe900161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:06.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 >> 172.21.15.120:0/678683810 conn(0x7fe900072a00 msgr2=0x7fe9000b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:06.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.189+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 shutdown_connections 2024-04-01T00:12:06.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.190+0000 7fe9060d9640 1 -- 172.21.15.120:0/678683810 wait complete. 2024-04-01T00:12:06.228 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T00:12:06.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.632+0000 7f1a4d0b7640 1 Processor -- start 2024-04-01T00:12:06.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.632+0000 7f1a4d0b7640 1 -- start start 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.633+0000 7f1a4d0b7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1a481670b0 0x7f1a48163ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.633+0000 7f1a4d0b7640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a48071d60 con 0x7f1a480d0990 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.633+0000 7f1a4d0b7640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a481665d0 con 0x7f1a48162920 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.633+0000 7f1a4d0b7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f1a481674d0 con 0x7f1a481670b0 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.633+0000 7f1a4759e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1a481670b0 0x7f1a48163ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.633+0000 7f1a4759e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1a481670b0 0x7f1a48163ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40152/0 (socket says 172.21.15.120:40152) 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.633+0000 7f1a4759e640 1 -- 172.21.15.120:0/4257220361 learned_addr learned my addr 172.21.15.120:0/4257220361 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.634+0000 7f1a4759e640 1 -- 172.21.15.120:0/4257220361 >> v1:172.21.15.203:6789/0 conn(0x7f1a48162920 legacy=0x7f1a480d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.634+0000 7f1a4759e640 1 -- 172.21.15.120:0/4257220361 >> v1:172.21.15.120:6789/0 conn(0x7f1a480d0990 legacy=0x7f1a480ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:06.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.634+0000 7f1a4759e640 1 -- 172.21.15.120:0/4257220361 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a481668b0 con 0x7f1a481670b0 2024-04-01T00:12:06.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.635+0000 7f1a4759e640 1 --2- 172.21.15.120:0/4257220361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481670b0 0x7f1a48163ac0 secure :-1 s=READY pgs=3229 cs=0 l=1 rev1=1 crypto rx=0x7f1a48167650 tx=0x7f1a3802bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65380786ee0df218 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:06.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.636+0000 7f1a45d9b640 1 -- 172.21.15.120:0/4257220361 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38039070 con 0x7f1a481670b0 2024-04-01T00:12:06.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.636+0000 7f1a45d9b640 1 -- 172.21.15.120:0/4257220361 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3802c790 con 0x7f1a481670b0 2024-04-01T00:12:06.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.636+0000 7f1a45d9b640 1 -- 172.21.15.120:0/4257220361 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3802cb60 con 0x7f1a481670b0 2024-04-01T00:12:06.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.638+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/4257220361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481670b0 msgr2=0x7f1a48163ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:06.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.638+0000 7f1a4d0b7640 1 --2- 172.21.15.120:0/4257220361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481670b0 0x7f1a48163ac0 secure :-1 s=READY pgs=3229 cs=0 l=1 rev1=1 crypto rx=0x7f1a48167650 tx=0x7f1a3802bbf0 comp rx=0 tx=0).stop 2024-04-01T00:12:06.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.638+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/4257220361 shutdown_connections 2024-04-01T00:12:06.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.638+0000 7f1a4d0b7640 1 --2- 172.21.15.120:0/4257220361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481670b0 0x7f1a48163ac0 unknown :-1 s=CLOSED pgs=3229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:06.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.638+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/4257220361 >> 172.21.15.120:0/4257220361 conn(0x7f1a4806b750 msgr2=0x7f1a4806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:06.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.638+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/4257220361 shutdown_connections 2024-04-01T00:12:06.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.638+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/4257220361 wait complete. 2024-04-01T00:12:06.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.644+0000 7f1a4d0b7640 1 Processor -- start 2024-04-01T00:12:06.645 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.644+0000 7f1a4d0b7640 1 -- start start 2024-04-01T00:12:06.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.647+0000 7f1a4d0b7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a480d0990 0x7f1a480cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:06.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.647+0000 7f1a46d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a480d0990 0x7f1a480cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:06.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.648+0000 7f1a46d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a480d0990 0x7f1a480cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:42620/0 (socket says 172.21.15.120:42620) 2024-04-01T00:12:06.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.648+0000 7f1a4d0b7640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a48162920 0x7f1a480ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:06.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.648+0000 7f1a46d9d640 1 -- 172.21.15.120:0/2830537719 learned_addr learned my addr 172.21.15.120:0/2830537719 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:06.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.648+0000 7f1a4659c640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a48162920 0x7f1a480ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:06.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.648+0000 7f1a4d0b7640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481670b0 0x7f1a480ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:06.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.649+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/2830537719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1a48072040 con 0x7f1a481670b0 2024-04-01T00:12:06.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.649+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/2830537719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a48162d00 con 0x7f1a480d0990 2024-04-01T00:12:06.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.649+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/2830537719 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1a480721c0 con 0x7f1a48162920 2024-04-01T00:12:06.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.650+0000 7f1a46d9d640 1 -- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a48162920 msgr2=0x7f1a480ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:06.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.650+0000 7f1a46d9d640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a48162920 0x7f1a480ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:06.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.650+0000 7f1a46d9d640 1 -- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481670b0 msgr2=0x7f1a480ce900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T00:12:06.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.650+0000 7f1a46d9d640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481670b0 0x7f1a480ce900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:06.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.650+0000 7f1a46d9d640 1 -- 172.21.15.120:0/2830537719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a481ecb70 con 0x7f1a480d0990 2024-04-01T00:12:06.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.651+0000 7f1a46d9d640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a480d0990 0x7f1a480cc560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c8a0 tx=0x7f1a4000cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:06.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.651+0000 7f1a4659c640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a48162920 0x7f1a480ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T00:12:06.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.652+0000 7f1a2f7fe640 1 -- 172.21.15.120:0/2830537719 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40003b70 con 0x7f1a480d0990 2024-04-01T00:12:06.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.652+0000 7f1a2f7fe640 1 -- 172.21.15.120:0/2830537719 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a40003d30 con 0x7f1a480d0990 2024-04-01T00:12:06.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.652+0000 7f1a2f7fe640 1 -- 172.21.15.120:0/2830537719 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000aa90 con 0x7f1a480d0990 2024-04-01T00:12:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.652+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/2830537719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a481642e0 con 0x7f1a480d0990 2024-04-01T00:12:06.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.653+0000 7f1a4d0b7640 1 -- 172.21.15.120:0/2830537719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a480cee40 con 0x7f1a480d0990 2024-04-01T00:12:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.659+0000 7f1a2d7fa640 1 -- 172.21.15.120:0/2830537719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a28005290 con 0x7f1a480d0990 2024-04-01T00:12:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.659+0000 7f1a2f7fe640 1 -- 172.21.15.120:0/2830537719 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a4000ac30 con 0x7f1a480d0990 2024-04-01T00:12:06.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.659+0000 7f1a2f7fe640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a3406c9f0 0x7f1a3406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:06.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.659+0000 7f1a2f7fe640 1 -- 172.21.15.120:0/2830537719 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1a4008bae0 con 0x7f1a480d0990 2024-04-01T00:12:06.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.660+0000 7f1a4659c640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a3406c9f0 0x7f1a3406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:06.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.662+0000 7f1a4659c640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a3406c9f0 0x7f1a3406eeb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1a48072b10 tx=0x7f1a3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:06.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:06.670+0000 7f1a2f7fe640 1 -- 172.21.15.120:0/2830537719 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1a40059ef0 con 0x7f1a480d0990 2024-04-01T00:12:07.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.676+0000 7f1a2d7fa640 1 -- 172.21.15.120:0/2830537719 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1a28005d90 con 0x7f1a480d0990 2024-04-01T00:12:07.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.677+0000 7f1a2f7fe640 1 -- 172.21.15.120:0/2830537719 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) ==== 104+0+11 (secure 0 0 0) 0x7f1a40059ef0 con 0x7f1a480d0990 2024-04-01T00:12:07.678 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-01T00:12:07.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.681+0000 7f1a2d7fa640 1 -- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a3406c9f0 msgr2=0x7f1a3406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:07.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.681+0000 7f1a2d7fa640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a3406c9f0 0x7f1a3406eeb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1a48072b10 tx=0x7f1a3c009040 comp rx=0 tx=0).stop 2024-04-01T00:12:07.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.681+0000 7f1a2d7fa640 1 -- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a480d0990 msgr2=0x7f1a480cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:07.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.681+0000 7f1a2d7fa640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a480d0990 0x7f1a480cc560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c8a0 tx=0x7f1a4000cd60 comp rx=0 tx=0).stop 2024-04-01T00:12:07.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.682+0000 7f1a2d7fa640 1 -- 172.21.15.120:0/2830537719 shutdown_connections 2024-04-01T00:12:07.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.682+0000 7f1a2d7fa640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1a3406c9f0 0x7f1a3406eeb0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:07.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.682+0000 7f1a2d7fa640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a481670b0 0x7f1a480ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:07.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.682+0000 7f1a2d7fa640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1a48162920 0x7f1a480ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:07.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.682+0000 7f1a2d7fa640 1 --2- 172.21.15.120:0/2830537719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a480d0990 0x7f1a480cc560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:07.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.682+0000 7f1a2d7fa640 1 -- 172.21.15.120:0/2830537719 >> 172.21.15.120:0/2830537719 conn(0x7f1a4806b750 msgr2=0x7f1a480ad3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:07.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.682+0000 7f1a2d7fa640 1 -- 172.21.15.120:0/2830537719 shutdown_connections 2024-04-01T00:12:07.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:07.682+0000 7f1a2d7fa640 1 -- 172.21.15.120:0/2830537719 wait complete. 2024-04-01T00:12:07.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T00:12:08.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.134+0000 7fe8ef59e640 1 Processor -- start 2024-04-01T00:12:08.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.135+0000 7fe8ef59e640 1 -- start start 2024-04-01T00:12:08.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.139+0000 7fe8ef59e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e80e3260 0x7fe8e804f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:08.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.139+0000 7fe8ef59e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e80e3640 con 0x7fe8e804fdb0 2024-04-01T00:12:08.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.139+0000 7fe8ef59e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e8053930 con 0x7fe8e8053380 2024-04-01T00:12:08.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.139+0000 7fe8ef59e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e8050210 con 0x7fe8e80e3260 2024-04-01T00:12:08.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.139+0000 7fe8ee59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e80e3260 0x7fe8e804f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:08.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.139+0000 7fe8edd9b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe8e804fdb0 0x7fe8e8052c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51348/0 (socket says 172.21.15.120:51348) 2024-04-01T00:12:08.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.140+0000 7fe8edd9b640 1 -- 172.21.15.120:0/3190858436 learned_addr learned my addr 172.21.15.120:0/3190858436 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:08.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.140+0000 7fe8ee59c640 1 -- 172.21.15.120:0/3190858436 >> v1:172.21.15.203:6789/0 conn(0x7fe8e8053380 legacy=0x7fe8e8037bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T00:12:08.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.141+0000 7fe8ee59c640 1 -- 172.21.15.120:0/3190858436 >> v1:172.21.15.120:6789/0 conn(0x7fe8e804fdb0 legacy=0x7fe8e8052c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:08.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.141+0000 7fe8ee59c640 1 -- 172.21.15.120:0/3190858436 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e8053c10 con 0x7fe8e80e3260 2024-04-01T00:12:08.144 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.143+0000 7fe8ee59c640 1 --2- 172.21.15.120:0/3190858436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e80e3260 0x7fe8e804f870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00097d0 tx=0x7fe8e002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d860bc2a0ddb0e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:08.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.149+0000 7fe8ed59a640 1 -- 172.21.15.120:0/3190858436 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0035020 con 0x7fe8e80e3260 2024-04-01T00:12:08.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.150+0000 7fe8ed59a640 1 -- 172.21.15.120:0/3190858436 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e0031800 con 0x7fe8e80e3260 2024-04-01T00:12:08.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.150+0000 7fe8ed59a640 1 -- 172.21.15.120:0/3190858436 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0031bd0 con 0x7fe8e80e3260 2024-04-01T00:12:08.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.151+0000 7fe8ef59e640 1 -- 172.21.15.120:0/3190858436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e80e3260 msgr2=0x7fe8e804f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:08.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.151+0000 7fe8ef59e640 1 --2- 172.21.15.120:0/3190858436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e80e3260 0x7fe8e804f870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00097d0 tx=0x7fe8e002b8a0 comp rx=0 tx=0).stop 2024-04-01T00:12:08.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.152+0000 7fe8ef59e640 1 -- 172.21.15.120:0/3190858436 shutdown_connections 2024-04-01T00:12:08.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.152+0000 7fe8ef59e640 1 --2- 172.21.15.120:0/3190858436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e80e3260 0x7fe8e804f870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:08.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.152+0000 7fe8ef59e640 1 -- 172.21.15.120:0/3190858436 >> 172.21.15.120:0/3190858436 conn(0x7fe8e8009fb0 msgr2=0x7fe8e800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:08.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.153+0000 7fe8ef59e640 1 -- 172.21.15.120:0/3190858436 shutdown_connections 2024-04-01T00:12:08.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.153+0000 7fe8ef59e640 1 -- 172.21.15.120:0/3190858436 wait complete. 2024-04-01T00:12:08.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.158+0000 7fe8ef59e640 1 Processor -- start 2024-04-01T00:12:08.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.159+0000 7fe8ef59e640 1 -- start start 2024-04-01T00:12:08.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.162+0000 7fe8ef59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e804fdb0 0x7fe8e80e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:08.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.163+0000 7fe8ef59e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e8053380 0x7fe8e80e4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:08.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.163+0000 7fe8ef59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8e80e3260 0x7fe8e80e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:08.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.163+0000 7fe8edd9b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e8053380 0x7fe8e80e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:08.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.164+0000 7fe8edd9b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e8053380 0x7fe8e80e4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:44812/0 (socket says 172.21.15.120:44812) 2024-04-01T00:12:08.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.164+0000 7fe8edd9b640 1 -- 172.21.15.120:0/2745428960 learned_addr learned my addr 172.21.15.120:0/2745428960 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:08.164 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.164+0000 7fe8eed9d640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8e80e3260 0x7fe8e80e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:08.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.165+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e80544b0 con 0x7fe8e804fdb0 2024-04-01T00:12:08.165 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.165+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e80541d0 con 0x7fe8e80e3260 2024-04-01T00:12:08.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.165+0000 7fe8ee59c640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e804fdb0 0x7fe8e80e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:08.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.166+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e80382c0 con 0x7fe8e8053380 2024-04-01T00:12:08.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.167+0000 7fe8ee59c640 1 -- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e8053380 msgr2=0x7fe8e80e4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:08.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.168+0000 7fe8ee59c640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e8053380 0x7fe8e80e4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:08.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.168+0000 7fe8ee59c640 1 -- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8e80e3260 msgr2=0x7fe8e80e4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:08.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.168+0000 7fe8ee59c640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8e80e3260 0x7fe8e80e4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:08.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.168+0000 7fe8ee59c640 1 -- 172.21.15.120:0/2745428960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e80e1680 con 0x7fe8e804fdb0 2024-04-01T00:12:08.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.168+0000 7fe8eed9d640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8e80e3260 0x7fe8e80e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T00:12:08.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.168+0000 7fe8edd9b640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e8053380 0x7fe8e80e4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T00:12:08.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.169+0000 7fe8ee59c640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e804fdb0 0x7fe8e80e0c40 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0033000 tx=0x7fe8e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:08.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.169+0000 7fe8deffd640 1 -- 172.21.15.120:0/2745428960 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0041070 con 0x7fe8e804fdb0 2024-04-01T00:12:08.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.170+0000 7fe8deffd640 1 -- 172.21.15.120:0/2745428960 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e003b430 con 0x7fe8e804fdb0 2024-04-01T00:12:08.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.170+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e8030460 con 0x7fe8e804fdb0 2024-04-01T00:12:08.171 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.171+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e8048890 con 0x7fe8e804fdb0 2024-04-01T00:12:08.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.173+0000 7fe8deffd640 1 -- 172.21.15.120:0/2745428960 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0035040 con 0x7fe8e804fdb0 2024-04-01T00:12:08.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.177+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e8005390 con 0x7fe8e804fdb0 2024-04-01T00:12:08.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.178+0000 7fe8deffd640 1 -- 172.21.15.120:0/2745428960 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8e0038020 con 0x7fe8e804fdb0 2024-04-01T00:12:08.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.179+0000 7fe8deffd640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8d006c8f0 0x7fe8d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:08.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.180+0000 7fe8deffd640 1 -- 172.21.15.120:0/2745428960 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe8e00ad7c0 con 0x7fe8e804fdb0 2024-04-01T00:12:08.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.190+0000 7fe8edd9b640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8d006c8f0 0x7fe8d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:08.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.192+0000 7fe8edd9b640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8d006c8f0 0x7fe8d006edb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80e5420 tx=0x7fe8e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:08.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:08.208+0000 7fe8deffd640 1 -- 172.21.15.120:0/2745428960 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe8e80e1680 con 0x7fe8e804fdb0 2024-04-01T00:12:09.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.217+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8e8048390 con 0x7fe8e804fdb0 2024-04-01T00:12:09.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.219+0000 7fe8deffd640 1 -- 172.21.15.120:0/2745428960 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) ==== 100+0+11 (secure 0 0 0) 0x7fe8e007bb50 con 0x7fe8e804fdb0 2024-04-01T00:12:09.227 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-01T00:12:09.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.232+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8d006c8f0 msgr2=0x7fe8d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:09.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.232+0000 7fe8ef59e640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8d006c8f0 0x7fe8d006edb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80e5420 tx=0x7fe8e4009040 comp rx=0 tx=0).stop 2024-04-01T00:12:09.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.232+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e804fdb0 msgr2=0x7fe8e80e0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:09.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.232+0000 7fe8ef59e640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e804fdb0 0x7fe8e80e0c40 secure :-1 s=READY pgs=3231 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0033000 tx=0x7fe8e00046c0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.233+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 shutdown_connections 2024-04-01T00:12:09.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.233+0000 7fe8ef59e640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe8d006c8f0 0x7fe8d006edb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.233+0000 7fe8ef59e640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8e80e3260 0x7fe8e80e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.233+0000 7fe8ef59e640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe8e8053380 0x7fe8e80e4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.233+0000 7fe8ef59e640 1 --2- 172.21.15.120:0/2745428960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8e804fdb0 0x7fe8e80e0c40 unknown :-1 s=CLOSED pgs=3231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.233+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 >> 172.21.15.120:0/2745428960 conn(0x7fe8e8009fb0 msgr2=0x7fe8e8034640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:09.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.237+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 shutdown_connections 2024-04-01T00:12:09.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.237+0000 7fe8ef59e640 1 -- 172.21.15.120:0/2745428960 wait complete. 2024-04-01T00:12:09.277 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T00:12:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.648+0000 7f869eb0e640 1 Processor -- start 2024-04-01T00:12:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.651+0000 7f869eb0e640 1 -- start start 2024-04-01T00:12:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f869eb0e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f869815e750 0x7f86980b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f869eb0e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8698072040 0x7f86980d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f869eb0e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f869806ea60 con 0x7f86980d0800 2024-04-01T00:12:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f869eb0e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f86980b34c0 con 0x7f869815e750 2024-04-01T00:12:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f869eb0e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f869815eb30 con 0x7f8698072040 2024-04-01T00:12:09.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f869c8aa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f869815e750 0x7f86980b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:09.656 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f869d0ab640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f86980d0800 0x7f869806b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:50450/0 (socket says 172.21.15.120:50450) 2024-04-01T00:12:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f869d0ab640 1 -- 172.21.15.120:0/3040727681 learned_addr learned my addr 172.21.15.120:0/3040727681 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.655+0000 7f8697fff640 1 --2- 172.21.15.120:0/3040727681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8698072040 0x7f86980d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.656+0000 7f869c8aa640 1 -- 172.21.15.120:0/3040727681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8698072040 msgr2=0x7f86980d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.656+0000 7f869c8aa640 1 --2- 172.21.15.120:0/3040727681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8698072040 0x7f86980d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.656+0000 7f869c8aa640 1 -- 172.21.15.120:0/3040727681 >> v1:172.21.15.203:6789/0 conn(0x7f86980d0800 legacy=0x7f869806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.656+0000 7f869c8aa640 1 -- 172.21.15.120:0/3040727681 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86980b5590 con 0x7f869815e750 2024-04-01T00:12:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.657+0000 7f869c8aa640 1 --2- 172.21.15.120:0/3040727681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869815e750 0x7f86980b4d60 secure :-1 s=READY pgs=3232 cs=0 l=1 rev1=1 crypto rx=0x7f86800097a0 tx=0x7f868002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eccaa5402538fb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.657+0000 7f86977fe640 1 -- 172.21.15.120:0/3040727681 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680035020 con 0x7f869815e750 2024-04-01T00:12:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.657+0000 7f86977fe640 1 -- 172.21.15.120:0/3040727681 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8680031830 con 0x7f869815e750 2024-04-01T00:12:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.658+0000 7f86977fe640 1 -- 172.21.15.120:0/3040727681 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680035020 con 0x7f869815e750 2024-04-01T00:12:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.659+0000 7f869eb0e640 1 -- 172.21.15.120:0/3040727681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869815e750 msgr2=0x7f86980b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.659+0000 7f869eb0e640 1 --2- 172.21.15.120:0/3040727681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869815e750 0x7f86980b4d60 secure :-1 s=READY pgs=3232 cs=0 l=1 rev1=1 crypto rx=0x7f86800097a0 tx=0x7f868002b8d0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.660+0000 7f869eb0e640 1 -- 172.21.15.120:0/3040727681 shutdown_connections 2024-04-01T00:12:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.660+0000 7f869eb0e640 1 --2- 172.21.15.120:0/3040727681 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8698072040 0x7f86980d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.660+0000 7f869eb0e640 1 --2- 172.21.15.120:0/3040727681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f869815e750 0x7f86980b4d60 unknown :-1 s=CLOSED pgs=3232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.660+0000 7f869eb0e640 1 -- 172.21.15.120:0/3040727681 >> 172.21.15.120:0/3040727681 conn(0x7f86980b21c0 msgr2=0x7f86980b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.660+0000 7f869eb0e640 1 -- 172.21.15.120:0/3040727681 shutdown_connections 2024-04-01T00:12:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.661+0000 7f869eb0e640 1 -- 172.21.15.120:0/3040727681 wait complete. 2024-04-01T00:12:09.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.665+0000 7f869eb0e640 1 Processor -- start 2024-04-01T00:12:09.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.666+0000 7f869eb0e640 1 -- start start 2024-04-01T00:12:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.669+0000 7f869eb0e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8698072040 0x7f86980aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.669+0000 7f869eb0e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86980d0800 0x7f869815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:09.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.670+0000 7f8697fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86980d0800 0x7f869815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:09.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.670+0000 7f8697fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86980d0800 0x7f869815ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:44834/0 (socket says 172.21.15.120:44834) 2024-04-01T00:12:09.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.670+0000 7f869c8aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8698072040 0x7f86980aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:09.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.670+0000 7f869c8aa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8698072040 0x7f86980aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40178/0 (socket says 172.21.15.120:40178) 2024-04-01T00:12:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.670+0000 7f869eb0e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f869815e750 0x7f869815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:09.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.671+0000 7f8697fff640 1 -- 172.21.15.120:0/1569338203 learned_addr learned my addr 172.21.15.120:0/1569338203 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.671+0000 7f869d0ab640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f869815e750 0x7f869815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.671+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f86980cfac0 con 0x7f8698072040 2024-04-01T00:12:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.671+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f86980cf7e0 con 0x7f869815e750 2024-04-01T00:12:09.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.672+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f86980b52a0 con 0x7f86980d0800 2024-04-01T00:12:09.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.674+0000 7f8697fff640 1 -- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f869815e750 msgr2=0x7f869815f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:09.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.674+0000 7f8697fff640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f869815e750 0x7f869815f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.674+0000 7f8697fff640 1 -- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8698072040 msgr2=0x7f86980aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:09.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.674+0000 7f8697fff640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8698072040 0x7f86980aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:09.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.674+0000 7f8697fff640 1 -- 172.21.15.120:0/1569338203 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869815f7c0 con 0x7f86980d0800 2024-04-01T00:12:09.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.675+0000 7f8697fff640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86980d0800 0x7f869815ed40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f868800d7d0 tx=0x7f868800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:09.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.675+0000 7f86957fa640 1 -- 172.21.15.120:0/1569338203 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688018020 con 0x7f86980d0800 2024-04-01T00:12:09.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.676+0000 7f86957fa640 1 -- 172.21.15.120:0/1569338203 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86880096c0 con 0x7f86980d0800 2024-04-01T00:12:09.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.676+0000 7f86957fa640 1 -- 172.21.15.120:0/1569338203 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688009ab0 con 0x7f86980d0800 2024-04-01T00:12:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.676+0000 7f869d0ab640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f869815e750 0x7f869815f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T00:12:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.677+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86980add20 con 0x7f86980d0800 2024-04-01T00:12:09.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.677+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f86980ae2e0 con 0x7f86980d0800 2024-04-01T00:12:09.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.683+0000 7f86957fa640 1 -- 172.21.15.120:0/1569338203 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f868801b020 con 0x7f86980d0800 2024-04-01T00:12:09.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.685+0000 7f86957fa640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867806c9c0 0x7f867806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:09.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.685+0000 7f86957fa640 1 -- 172.21.15.120:0/1569338203 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f868808bfe0 con 0x7f86980d0800 2024-04-01T00:12:09.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.686+0000 7f869c8aa640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867806c9c0 0x7f867806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:09.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.687+0000 7f869c8aa640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867806c9c0 0x7f867806ee80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8680036000 tx=0x7f868003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:09.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.689+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f867c005290 con 0x7f86980d0800 2024-04-01T00:12:09.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:09.698+0000 7f86957fa640 1 -- 172.21.15.120:0/1569338203 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8688022020 con 0x7f86980d0800 2024-04-01T00:12:10.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.739+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f867c005580 con 0x7f86980d0800 2024-04-01T00:12:10.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.740+0000 7f86957fa640 1 -- 172.21.15.120:0/1569338203 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f868805a480 con 0x7f86980d0800 2024-04-01T00:12:10.741 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2024-04-01T00:12:10.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.749+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867806c9c0 msgr2=0x7f867806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:10.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867806c9c0 0x7f867806ee80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8680036000 tx=0x7f868003c040 comp rx=0 tx=0).stop 2024-04-01T00:12:10.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86980d0800 msgr2=0x7f869815ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:10.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86980d0800 0x7f869815ed40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f868800d7d0 tx=0x7f868800dc90 comp rx=0 tx=0).stop 2024-04-01T00:12:10.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 shutdown_connections 2024-04-01T00:12:10.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f867806c9c0 0x7f867806ee80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:10.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f869815e750 0x7f869815f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:10.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f86980d0800 0x7f869815ed40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:10.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 --2- 172.21.15.120:0/1569338203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8698072040 0x7f86980aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:10.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.750+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 >> 172.21.15.120:0/1569338203 conn(0x7f86980b21c0 msgr2=0x7f86980b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:10.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.751+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 shutdown_connections 2024-04-01T00:12:10.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:10.751+0000 7f869eb0e640 1 -- 172.21.15.120:0/1569338203 wait complete. 2024-04-01T00:12:10.787 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-01T00:12:10.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:10.787 DEBUG:teuthology.orchestra.run.smithi120:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-01T00:12:10.896 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-04-01T00:12:10.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:10.897 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-01T00:12:10.977 INFO:tasks.cephfs.mount:Terminating background process 2024-04-01T00:12:10.977 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-01T00:12:10.978 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:11.075 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056352,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=387 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-01T00:12:11.075 INFO:tasks.cephfs.mount:Terminating background process 2024-04-01T00:12:11.075 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-01T00:12:11.076 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:11.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=563 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-01T00:12:11.121 INFO:tasks.cephfs.mount:Terminating background process 2024-04-01T00:12:11.122 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-01T00:12:11.122 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:11.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056352,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=387 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-01T00:12:11.138 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T00:12:11.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.583+0000 7f046a132640 1 Processor -- start 2024-04-01T00:12:11.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.584+0000 7f046a132640 1 -- start start 2024-04-01T00:12:11.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.587+0000 7f046a132640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f04640d0280 0x7f04640d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:11.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.587+0000 7f046a132640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f0464071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:11.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.588+0000 7f046a132640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046415ec80 con 0x7f0464071eb0 2024-04-01T00:12:11.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.588+0000 7f046a132640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f04640d0ba0 con 0x7f04640d0280 2024-04-01T00:12:11.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.588+0000 7f046a132640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f046415ef20 con 0x7f0464141c10 2024-04-01T00:12:11.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.588+0000 7f0463fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0464071eb0 0x7f046406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51356/0 (socket says 172.21.15.120:51356) 2024-04-01T00:12:11.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.588+0000 7f0463fff640 1 -- 172.21.15.120:0/1608786040 learned_addr learned my addr 172.21.15.120:0/1608786040 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:11.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.588+0000 7f0462ffd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f0464071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:11.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.589+0000 7f04637fe640 1 --2- 172.21.15.120:0/1608786040 >> v2:172.21.15.203:3300/0 conn(0x7f04640d0280 0x7f04640d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:11.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.589+0000 7f0462ffd640 1 -- 172.21.15.120:0/1608786040 >> v2:172.21.15.203:3300/0 conn(0x7f04640d0280 msgr2=0x7f04640d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:11.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.589+0000 7f0462ffd640 1 --2- 172.21.15.120:0/1608786040 >> v2:172.21.15.203:3300/0 conn(0x7f04640d0280 0x7f04640d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:11.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.589+0000 7f0462ffd640 1 -- 172.21.15.120:0/1608786040 >> v1:172.21.15.120:6789/0 conn(0x7f0464071eb0 legacy=0x7f046406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:11.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.589+0000 7f0462ffd640 1 -- 172.21.15.120:0/1608786040 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046415f200 con 0x7f0464141c10 2024-04-01T00:12:11.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.589+0000 7f04637fe640 1 --2- 172.21.15.120:0/1608786040 >> v2:172.21.15.203:3300/0 conn(0x7f04640d0280 0x7f04640d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T00:12:11.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.590+0000 7f0462ffd640 1 --2- 172.21.15.120:0/1608786040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f0464071970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04580097a0 tx=0x7f045802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af6ad438df7d449a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:11.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.590+0000 7f04627fc640 1 -- 172.21.15.120:0/1608786040 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458035020 con 0x7f0464141c10 2024-04-01T00:12:11.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.590+0000 7f04627fc640 1 -- 172.21.15.120:0/1608786040 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0458031810 con 0x7f0464141c10 2024-04-01T00:12:11.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.591+0000 7f04627fc640 1 -- 172.21.15.120:0/1608786040 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458035020 con 0x7f0464141c10 2024-04-01T00:12:11.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.591+0000 7f046a132640 1 -- 172.21.15.120:0/1608786040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 msgr2=0x7f0464071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:11.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.591+0000 7f046a132640 1 --2- 172.21.15.120:0/1608786040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f0464071970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f04580097a0 tx=0x7f045802b8b0 comp rx=0 tx=0).stop 2024-04-01T00:12:11.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.592+0000 7f046a132640 1 -- 172.21.15.120:0/1608786040 shutdown_connections 2024-04-01T00:12:11.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.592+0000 7f046a132640 1 --2- 172.21.15.120:0/1608786040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f0464071970 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:11.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.592+0000 7f046a132640 1 --2- 172.21.15.120:0/1608786040 >> v2:172.21.15.203:3300/0 conn(0x7f04640d0280 0x7f04640d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:11.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.592+0000 7f046a132640 1 -- 172.21.15.120:0/1608786040 >> 172.21.15.120:0/1608786040 conn(0x7f046406b750 msgr2=0x7f046406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:11.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.592+0000 7f046a132640 1 -- 172.21.15.120:0/1608786040 shutdown_connections 2024-04-01T00:12:11.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.592+0000 7f046a132640 1 -- 172.21.15.120:0/1608786040 wait complete. 2024-04-01T00:12:11.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.599+0000 7f046a132640 1 Processor -- start 2024-04-01T00:12:11.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.599+0000 7f046a132640 1 -- start start 2024-04-01T00:12:11.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.602+0000 7f046a132640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0464071eb0 0x7f0464099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:11.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.602+0000 7f046a132640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04640d0280 0x7f046414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:11.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.603+0000 7f046a132640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f04640b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:11.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.603+0000 7f0462ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04640d0280 0x7f046414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:11.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.603+0000 7f0462ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04640d0280 0x7f046414d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:42646/0 (socket says 172.21.15.120:42646) 2024-04-01T00:12:11.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.603+0000 7f0462ffd640 1 -- 172.21.15.120:0/3844835818 learned_addr learned my addr 172.21.15.120:0/3844835818 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.603+0000 7f0463fff640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f04640b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.603+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0464158e90 con 0x7f0464071eb0 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.603+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f046415f7c0 con 0x7f04640d0280 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.603+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f04640ae100 con 0x7f0464141c10 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.604+0000 7f0462ffd640 1 -- 172.21.15.120:0/3844835818 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 msgr2=0x7f04640b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.604+0000 7f0462ffd640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f04640b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.604+0000 7f0462ffd640 1 -- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0464071eb0 msgr2=0x7f0464099840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.604+0000 7f0462ffd640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0464071eb0 0x7f0464099840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.604+0000 7f0462ffd640 1 -- 172.21.15.120:0/3844835818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04640ae3e0 con 0x7f04640d0280 2024-04-01T00:12:11.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.605+0000 7f0462ffd640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04640d0280 0x7f046414d5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f045802b8f0 tx=0x7f04580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:11.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.605+0000 7f044bfff640 1 -- 172.21.15.120:0/3844835818 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458035020 con 0x7f04640d0280 2024-04-01T00:12:11.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.605+0000 7f044bfff640 1 -- 172.21.15.120:0/3844835818 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045804bd70 con 0x7f04640d0280 2024-04-01T00:12:11.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.605+0000 7f044bfff640 1 -- 172.21.15.120:0/3844835818 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458044660 con 0x7f04640d0280 2024-04-01T00:12:11.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.605+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04640ae6c0 con 0x7f04640d0280 2024-04-01T00:12:11.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.606+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0464099d80 con 0x7f04640d0280 2024-04-01T00:12:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.608+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0450005290 con 0x7f04640d0280 2024-04-01T00:12:11.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.618+0000 7f044bfff640 1 -- 172.21.15.120:0/3844835818 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0458038020 con 0x7f04640d0280 2024-04-01T00:12:11.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.621+0000 7f044bfff640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f044c06cb00 0x7f044c06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:11.622 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.622+0000 7f044bfff640 1 -- 172.21.15.120:0/3844835818 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f04580cf930 con 0x7f04640d0280 2024-04-01T00:12:11.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.623+0000 7f04637fe640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f044c06cb00 0x7f044c06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:11.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.625+0000 7f04637fe640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f044c06cb00 0x7f044c06efc0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f045400a8b0 tx=0x7f0454008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:11.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:11.626+0000 7f044bfff640 1 -- 172.21.15.120:0/3844835818 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f045809d780 con 0x7f04640d0280 2024-04-01T00:12:12.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.870+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0450005580 con 0x7f04640d0280 2024-04-01T00:12:12.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.871+0000 7f044bfff640 1 -- 172.21.15.120:0/3844835818 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f04580a1a80 con 0x7f04640d0280 2024-04-01T00:12:12.871 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:12.871 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/4016494046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4016494046},{"type":"v1","addr":"172.21.15.203:6834","nonce":4016494046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1319253278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":1319253278},{"type":"v1","addr":"172.21.15.203:6835","nonce":1319253278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1766153586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1766153586},{"type":"v1","addr":"172.21.15.120:6836","nonce":1766153586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:36:23.168388+0000","modified":"2024-03-31T16:36:25.178205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/2154626843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2154626843},{"type":"v1","addr":"172.21.15.120:6837","nonce":2154626843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-04-01T00:12:12.872 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 14 2024-04-01T00:12:12.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f044c06cb00 msgr2=0x7f044c06efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:12.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f044c06cb00 0x7f044c06efc0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f045400a8b0 tx=0x7f0454008040 comp rx=0 tx=0).stop 2024-04-01T00:12:12.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04640d0280 msgr2=0x7f046414d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:12.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04640d0280 0x7f046414d5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f045802b8f0 tx=0x7f04580046c0 comp rx=0 tx=0).stop 2024-04-01T00:12:12.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 shutdown_connections 2024-04-01T00:12:12.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f044c06cb00 0x7f044c06efc0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:12.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0464141c10 0x7f04640b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:12.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04640d0280 0x7f046414d5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:12.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 --2- 172.21.15.120:0/3844835818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0464071eb0 0x7f0464099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:12.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.874+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 >> 172.21.15.120:0/3844835818 conn(0x7f046406b750 msgr2=0x7f0464156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:12.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.875+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 shutdown_connections 2024-04-01T00:12:12.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:12.875+0000 7f046a132640 1 -- 172.21.15.120:0/3844835818 wait complete. 2024-04-01T00:12:12.892 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T00:12:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.170+0000 7f9a3f0a5640 1 Processor -- start 2024-04-01T00:12:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.170+0000 7f9a3f0a5640 1 -- start start 2024-04-01T00:12:13.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.174+0000 7f9a3f0a5640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9a381630d0 0x7f9a381665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:13.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.175+0000 7f9a3d642640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9a3806c680 0x7f9a3806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:51368/0 (socket says 172.21.15.120:51368) 2024-04-01T00:12:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.175+0000 7f9a3d642640 1 -- 172.21.15.120:0/3894069741 learned_addr learned my addr 172.21.15.120:0/3894069741 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.175+0000 7f9a37fff640 1 --2- 172.21.15.120:0/3894069741 >> v2:172.21.15.203:3300/0 conn(0x7f9a381630d0 0x7f9a381665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.175+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/3894069741 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a38166f10 con 0x7f9a3806c680 2024-04-01T00:12:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.175+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/3894069741 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a381671f0 con 0x7f9a380d1880 2024-04-01T00:12:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.175+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/3894069741 --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9a38162ea0 con 0x7f9a381630d0 2024-04-01T00:12:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.176+0000 7f9a37fff640 1 -- 172.21.15.120:0/3894069741 >> v1:172.21.15.203:6789/0 conn(0x7f9a380d1880 legacy=0x7f9a38071930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T00:12:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.176+0000 7f9a37fff640 1 -- 172.21.15.120:0/3894069741 >> v1:172.21.15.120:6789/0 conn(0x7f9a3806c680 legacy=0x7f9a3806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:13.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.176+0000 7f9a37fff640 1 -- 172.21.15.120:0/3894069741 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a38071130 con 0x7f9a381630d0 2024-04-01T00:12:13.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.180+0000 7f9a37fff640 1 --2- 172.21.15.120:0/3894069741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a381630d0 0x7f9a381665a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0097a0 tx=0x7f9a2c02b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14b5dd1c8cb7d6a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:13.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.181+0000 7f9a377fe640 1 -- 172.21.15.120:0/3894069741 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c037070 con 0x7f9a381630d0 2024-04-01T00:12:13.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.181+0000 7f9a377fe640 1 -- 172.21.15.120:0/3894069741 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2c030710 con 0x7f9a381630d0 2024-04-01T00:12:13.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.181+0000 7f9a377fe640 1 -- 172.21.15.120:0/3894069741 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c030ae0 con 0x7f9a381630d0 2024-04-01T00:12:13.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.189+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/3894069741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a381630d0 msgr2=0x7f9a381665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:13.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.189+0000 7f9a3f0a5640 1 --2- 172.21.15.120:0/3894069741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a381630d0 0x7f9a381665a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0097a0 tx=0x7f9a2c02b680 comp rx=0 tx=0).stop 2024-04-01T00:12:13.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.189+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/3894069741 shutdown_connections 2024-04-01T00:12:13.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.189+0000 7f9a3f0a5640 1 --2- 172.21.15.120:0/3894069741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a381630d0 0x7f9a381665a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:13.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.189+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/3894069741 >> 172.21.15.120:0/3894069741 conn(0x7f9a380d2240 msgr2=0x7f9a380d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:13.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.190+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/3894069741 shutdown_connections 2024-04-01T00:12:13.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.190+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/3894069741 wait complete. 2024-04-01T00:12:13.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.194+0000 7f9a3f0a5640 1 Processor -- start 2024-04-01T00:12:13.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.194+0000 7f9a3f0a5640 1 -- start start 2024-04-01T00:12:13.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.195+0000 7f9a3f0a5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a3806c680 0x7f9a3814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:13.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3f0a5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a380d1880 0x7f9a381ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3f0a5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a381630d0 0x7f9a380b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3f0a5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9a38166ae0 con 0x7f9a3806c680 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3f0a5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a381674d0 con 0x7f9a380d1880 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3f0a5640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a38166c60 con 0x7f9a381630d0 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3ce41640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a3806c680 0x7f9a3814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3ce41640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a3806c680 0x7f9a3814e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40184/0 (socket says 172.21.15.120:40184) 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3ce41640 1 -- 172.21.15.120:0/2070506590 learned_addr learned my addr 172.21.15.120:0/2070506590 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3d642640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a381630d0 0x7f9a380b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:13.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a37fff640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a380d1880 0x7f9a381ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3d642640 1 -- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a380d1880 msgr2=0x7f9a381ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3d642640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a380d1880 0x7f9a381ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3d642640 1 -- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a3806c680 msgr2=0x7f9a3814e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3d642640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a3806c680 0x7f9a3814e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.196+0000 7f9a3d642640 1 -- 172.21.15.120:0/2070506590 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a381ed6a0 con 0x7f9a381630d0 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.197+0000 7f9a3d642640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a381630d0 0x7f9a380b3d70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800c460 tx=0x7f9a2800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.197+0000 7f9a357fa640 1 -- 172.21.15.120:0/2070506590 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28018070 con 0x7f9a381630d0 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.197+0000 7f9a357fa640 1 -- 172.21.15.120:0/2070506590 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a280075a0 con 0x7f9a381630d0 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.197+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/2070506590 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a381ed980 con 0x7f9a381630d0 2024-04-01T00:12:13.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.197+0000 7f9a3f0a5640 1 -- 172.21.15.120:0/2070506590 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3814e980 con 0x7f9a381630d0 2024-04-01T00:12:13.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.197+0000 7f9a357fa640 1 -- 172.21.15.120:0/2070506590 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28004a20 con 0x7f9a381630d0 2024-04-01T00:12:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.203+0000 7f9a357fa640 1 -- 172.21.15.120:0/2070506590 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a2801b070 con 0x7f9a381630d0 2024-04-01T00:12:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.205+0000 7f9a357fa640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a2406c9c0 0x7f9a2406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.205+0000 7f9a357fa640 1 -- 172.21.15.120:0/2070506590 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9a2808aec0 con 0x7f9a381630d0 2024-04-01T00:12:13.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.205+0000 7f9a3ce41640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a2406c9c0 0x7f9a2406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:13.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.207+0000 7f9a1effd640 1 -- 172.21.15.120:0/2070506590 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a381edd70 con 0x7f9a381630d0 2024-04-01T00:12:13.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.207+0000 7f9a3ce41640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a2406c9c0 0x7f9a2406ee80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000e200 tx=0x7f9a3000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:13.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:13.217+0000 7f9a357fa640 1 -- 172.21.15.120:0/2070506590 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9a28058d10 con 0x7f9a381630d0 2024-04-01T00:12:14.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.212+0000 7f9a1effd640 1 -- 172.21.15.120:0/2070506590 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a380685c0 con 0x7f9a381630d0 2024-04-01T00:12:14.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.216+0000 7f9a357fa640 1 -- 172.21.15.120:0/2070506590 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7f9a2805d010 con 0x7f9a381630d0 2024-04-01T00:12:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:14.218 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:24.828471+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:36:21.024330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-31T16:36:22.128594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T00:12:14.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.223+0000 7f9a1effd640 1 -- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a2406c9c0 msgr2=0x7f9a2406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:14.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.223+0000 7f9a1effd640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a2406c9c0 0x7f9a2406ee80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000e200 tx=0x7f9a3000b040 comp rx=0 tx=0).stop 2024-04-01T00:12:14.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.224+0000 7f9a1effd640 1 -- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a381630d0 msgr2=0x7f9a380b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:14.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.224+0000 7f9a1effd640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a381630d0 0x7f9a380b3d70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800c460 tx=0x7f9a2800c920 comp rx=0 tx=0).stop 2024-04-01T00:12:14.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.224+0000 7f9a1effd640 1 -- 172.21.15.120:0/2070506590 shutdown_connections 2024-04-01T00:12:14.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.224+0000 7f9a1effd640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a2406c9c0 0x7f9a2406ee80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.225+0000 7f9a1effd640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a381630d0 0x7f9a380b3d70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.225+0000 7f9a1effd640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a380d1880 0x7f9a381ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.225+0000 7f9a1effd640 1 --2- 172.21.15.120:0/2070506590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a3806c680 0x7f9a3814e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.225+0000 7f9a1effd640 1 -- 172.21.15.120:0/2070506590 >> 172.21.15.120:0/2070506590 conn(0x7f9a380d2240 msgr2=0x7f9a38163e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:14.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.230+0000 7f9a1effd640 1 -- 172.21.15.120:0/2070506590 shutdown_connections 2024-04-01T00:12:14.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.231+0000 7f9a1effd640 1 -- 172.21.15.120:0/2070506590 wait complete. 2024-04-01T00:12:14.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-31T16:35:19.872716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-31T16:36:21.024330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-31T16:36:22.128594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T00:12:14.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T00:12:14.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.686+0000 7fba85c0d640 1 Processor -- start 2024-04-01T00:12:14.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.687+0000 7fba85c0d640 1 -- start start 2024-04-01T00:12:14.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.690+0000 7fba85c0d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fba800d43d0 0x7fba800d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:14.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.690+0000 7fba85c0d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba800cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:14.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.691+0000 7fba7f7fe640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fba8015e860 0x7fba8006d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:54496/0 (socket says 172.21.15.120:54496) 2024-04-01T00:12:14.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.691+0000 7fba7effd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fba800d43d0 0x7fba800d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.691+0000 7fba7effd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fba800d43d0 0x7fba800d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40478/0 (socket says 172.21.15.120:40478) 2024-04-01T00:12:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.691+0000 7fba7f7fe640 1 -- 172.21.15.120:0/183766163 learned_addr learned my addr 172.21.15.120:0/183766163 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.691+0000 7fba85c0d640 1 -- 172.21.15.120:0/183766163 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba800d4d20 con 0x7fba8015e860 2024-04-01T00:12:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.691+0000 7fba85c0d640 1 -- 172.21.15.120:0/183766163 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fba800cf220 con 0x7fba800d43d0 2024-04-01T00:12:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.691+0000 7fba85c0d640 1 -- 172.21.15.120:0/183766163 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba8006dfa0 con 0x7fba800cf6b0 2024-04-01T00:12:14.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.691+0000 7fba7ffff640 1 --2- 172.21.15.120:0/183766163 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba800cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:14.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.692+0000 7fba7ffff640 1 -- 172.21.15.120:0/183766163 >> v2:172.21.15.120:3300/0 conn(0x7fba800d43d0 msgr2=0x7fba800d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:14.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.692+0000 7fba7ffff640 1 --2- 172.21.15.120:0/183766163 >> v2:172.21.15.120:3300/0 conn(0x7fba800d43d0 0x7fba800d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.692+0000 7fba7ffff640 1 -- 172.21.15.120:0/183766163 >> v1:172.21.15.203:6789/0 conn(0x7fba8015e860 legacy=0x7fba8006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:14.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.692+0000 7fba7ffff640 1 -- 172.21.15.120:0/183766163 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8006e240 con 0x7fba800cf6b0 2024-04-01T00:12:14.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.692+0000 7fba7effd640 1 --2- 172.21.15.120:0/183766163 >> v2:172.21.15.120:3300/0 conn(0x7fba800d43d0 0x7fba800d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:14.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.701+0000 7fba7ffff640 1 --2- 172.21.15.120:0/183766163 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba800cfae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba78009d90 tx=0x7fba7802bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68bc86b2bf967f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:14.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.701+0000 7fba7e7fc640 1 -- 172.21.15.120:0/183766163 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78039070 con 0x7fba800cf6b0 2024-04-01T00:12:14.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.701+0000 7fba7e7fc640 1 -- 172.21.15.120:0/183766163 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7802ca10 con 0x7fba800cf6b0 2024-04-01T00:12:14.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.701+0000 7fba7e7fc640 1 -- 172.21.15.120:0/183766163 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7802cde0 con 0x7fba800cf6b0 2024-04-01T00:12:14.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.703+0000 7fba85c0d640 1 -- 172.21.15.120:0/183766163 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 msgr2=0x7fba800cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:14.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.703+0000 7fba85c0d640 1 --2- 172.21.15.120:0/183766163 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba800cfae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba78009d90 tx=0x7fba7802bce0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.703+0000 7fba85c0d640 1 -- 172.21.15.120:0/183766163 shutdown_connections 2024-04-01T00:12:14.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.703+0000 7fba85c0d640 1 --2- 172.21.15.120:0/183766163 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba800cfae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.703+0000 7fba85c0d640 1 --2- 172.21.15.120:0/183766163 >> v2:172.21.15.120:3300/0 conn(0x7fba800d43d0 0x7fba800d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.703+0000 7fba85c0d640 1 -- 172.21.15.120:0/183766163 >> 172.21.15.120:0/183766163 conn(0x7fba8009d7d0 msgr2=0x7fba8008bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:14.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.711+0000 7fba85c0d640 1 -- 172.21.15.120:0/183766163 shutdown_connections 2024-04-01T00:12:14.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.711+0000 7fba85c0d640 1 -- 172.21.15.120:0/183766163 wait complete. 2024-04-01T00:12:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.716+0000 7fba85c0d640 1 Processor -- start 2024-04-01T00:12:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.716+0000 7fba85c0d640 1 -- start start 2024-04-01T00:12:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.719+0000 7fba85c0d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba801f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.719+0000 7fba85c0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba800d43d0 0x7fba801ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba85c0d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba8015e860 0x7fba800b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba85c0d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fba8006dc00 con 0x7fba800d43d0 2024-04-01T00:12:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba85c0d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba800d2c50 con 0x7fba8015e860 2024-04-01T00:12:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba85c0d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba8006dd80 con 0x7fba800cf6b0 2024-04-01T00:12:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba800d43d0 0x7fba801ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7f7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba801f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba8015e860 0x7fba800b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7f7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba801f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:54718/0 (socket says 172.21.15.120:54718) 2024-04-01T00:12:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7f7fe640 1 -- 172.21.15.120:0/1149642550 learned_addr learned my addr 172.21.15.120:0/1149642550 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba800d43d0 0x7fba801ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40492/0 (socket says 172.21.15.120:40492) 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7ffff640 1 -- 172.21.15.120:0/1149642550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 msgr2=0x7fba801f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7ffff640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba801f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7ffff640 1 -- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba800d43d0 msgr2=0x7fba801ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7ffff640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba800d43d0 0x7fba801ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7ffff640 1 -- 172.21.15.120:0/1149642550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba801f5260 con 0x7fba8015e860 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.720+0000 7fba7f7fe640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba801f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.721+0000 7fba7ffff640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba8015e860 0x7fba800b94f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fba78033000 tx=0x7fba78004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.721+0000 7fba67fff640 1 -- 172.21.15.120:0/1149642550 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78039050 con 0x7fba8015e860 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.721+0000 7fba67fff640 1 -- 172.21.15.120:0/1149642550 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba78045070 con 0x7fba8015e860 2024-04-01T00:12:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.721+0000 7fba67fff640 1 -- 172.21.15.120:0/1149642550 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78040450 con 0x7fba8015e860 2024-04-01T00:12:14.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.722+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8015b850 con 0x7fba8015e860 2024-04-01T00:12:14.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.722+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba800b7df0 con 0x7fba8015e860 2024-04-01T00:12:14.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.723+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba800685c0 con 0x7fba8015e860 2024-04-01T00:12:14.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.724+0000 7fba67fff640 1 -- 172.21.15.120:0/1149642550 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba780405f0 con 0x7fba8015e860 2024-04-01T00:12:14.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.725+0000 7fba67fff640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fba6c06c920 0x7fba6c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:14.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.726+0000 7fba67fff640 1 -- 172.21.15.120:0/1149642550 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fba780ae1e0 con 0x7fba8015e860 2024-04-01T00:12:14.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.726+0000 7fba7f7fe640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fba6c06c920 0x7fba6c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:14.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.727+0000 7fba7f7fe640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fba6c06c920 0x7fba6c06ede0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fba70000f60 tx=0x7fba70007f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:14.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:14.733+0000 7fba67fff640 1 -- 172.21.15.120:0/1149642550 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fba801f5260 con 0x7fba8015e860 2024-04-01T00:12:15.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.751+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fba800b34e0 con 0x7fba8015e860 2024-04-01T00:12:15.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.751+0000 7fba67fff640 1 -- 172.21.15.120:0/1149642550 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7fba7807bfb0 con 0x7fba8015e860 2024-04-01T00:12:15.752 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-04-01T00:12:15.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fba6c06c920 msgr2=0x7fba6c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:15.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fba6c06c920 0x7fba6c06ede0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fba70000f60 tx=0x7fba70007f30 comp rx=0 tx=0).stop 2024-04-01T00:12:15.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba8015e860 msgr2=0x7fba800b94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:15.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba8015e860 0x7fba800b94f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fba78033000 tx=0x7fba78004a40 comp rx=0 tx=0).stop 2024-04-01T00:12:15.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 shutdown_connections 2024-04-01T00:12:15.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fba6c06c920 0x7fba6c06ede0 secure :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fba70000f60 tx=0x7fba70007f30 comp rx=0 tx=0).stop 2024-04-01T00:12:15.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba8015e860 0x7fba800b94f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:15.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fba800d43d0 0x7fba801ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:15.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 --2- 172.21.15.120:0/1149642550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba800cf6b0 0x7fba801f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:15.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.758+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 >> 172.21.15.120:0/1149642550 conn(0x7fba8009d7d0 msgr2=0x7fba800d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:15.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.768+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 shutdown_connections 2024-04-01T00:12:15.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:15.769+0000 7fba85c0d640 1 -- 172.21.15.120:0/1149642550 wait complete. 2024-04-01T00:12:15.791 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T00:12:16.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.233+0000 7fb79ce51640 1 Processor -- start 2024-04-01T00:12:16.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.233+0000 7fb79ce51640 1 -- start start 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.237+0000 7fb79ce51640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb798070120 0x7fb79806b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.237+0000 7fb79ce51640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb79806e770 0x7fb79806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.237+0000 7fb79ce51640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7980b5b10 con 0x7fb7980b0670 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.237+0000 7fb79ce51640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fb7980b63e0 con 0x7fb79806e770 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.237+0000 7fb79ce51640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb79806c3f0 con 0x7fb798070120 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.238+0000 7fb79659c640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fb7980b0670 0x7fb79815f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:54498/0 (socket says 172.21.15.120:54498) 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.238+0000 7fb79659c640 1 -- 172.21.15.120:0/1485989859 learned_addr learned my addr 172.21.15.120:0/1485989859 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.239+0000 7fb796d9d640 1 --2- 172.21.15.120:0/1485989859 >> v2:172.21.15.120:3300/0 conn(0x7fb79806e770 0x7fb79806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.239+0000 7fb79559a640 1 -- 172.21.15.120:0/1485989859 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559354149 0 0) 0x7fb790001490 con 0x7fb7980b0670 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.239+0000 7fb79559a640 1 -- 172.21.15.120:0/1485989859 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb780003520 con 0x7fb7980b0670 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.240+0000 7fb796d9d640 1 -- 172.21.15.120:0/1485989859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb798070120 msgr2=0x7fb79806b570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T00:12:16.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.240+0000 7fb796d9d640 1 --2- 172.21.15.120:0/1485989859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb798070120 0x7fb79806b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.240+0000 7fb796d9d640 1 -- 172.21.15.120:0/1485989859 >> v1:172.21.15.203:6789/0 conn(0x7fb7980b0670 legacy=0x7fb79815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:16.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.240+0000 7fb796d9d640 1 -- 172.21.15.120:0/1485989859 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7980705e0 con 0x7fb79806e770 2024-04-01T00:12:16.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.243+0000 7fb796d9d640 1 --2- 172.21.15.120:0/1485989859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb79806e770 0x7fb79806bab0 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 crypto rx=0x7fb788009a30 tx=0x7fb78802bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345475fb58ca862d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:16.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.244+0000 7fb79559a640 1 -- 172.21.15.120:0/1485989859 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78802d700 con 0x7fb79806e770 2024-04-01T00:12:16.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.244+0000 7fb79559a640 1 -- 172.21.15.120:0/1485989859 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78802d8a0 con 0x7fb79806e770 2024-04-01T00:12:16.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.244+0000 7fb79559a640 1 -- 172.21.15.120:0/1485989859 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78802dc50 con 0x7fb79806e770 2024-04-01T00:12:16.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.245+0000 7fb79ce51640 1 -- 172.21.15.120:0/1485989859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb79806e770 msgr2=0x7fb79806bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:16.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.245+0000 7fb79ce51640 1 --2- 172.21.15.120:0/1485989859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb79806e770 0x7fb79806bab0 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 crypto rx=0x7fb788009a30 tx=0x7fb78802bb50 comp rx=0 tx=0).stop 2024-04-01T00:12:16.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.247+0000 7fb79ce51640 1 -- 172.21.15.120:0/1485989859 shutdown_connections 2024-04-01T00:12:16.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.247+0000 7fb79ce51640 1 --2- 172.21.15.120:0/1485989859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb79806e770 0x7fb79806bab0 unknown :-1 s=CLOSED pgs=3235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.247+0000 7fb79ce51640 1 --2- 172.21.15.120:0/1485989859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb798070120 0x7fb79806b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.247+0000 7fb79ce51640 1 -- 172.21.15.120:0/1485989859 >> 172.21.15.120:0/1485989859 conn(0x7fb7980b65a0 msgr2=0x7fb7980b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:16.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.249+0000 7fb79ce51640 1 -- 172.21.15.120:0/1485989859 shutdown_connections 2024-04-01T00:12:16.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.249+0000 7fb79ce51640 1 -- 172.21.15.120:0/1485989859 wait complete. 2024-04-01T00:12:16.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.251+0000 7fb79ce51640 1 Processor -- start 2024-04-01T00:12:16.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.251+0000 7fb79ce51640 1 -- start start 2024-04-01T00:12:16.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79ce51640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb79806e770 0x7fb79809ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:16.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79ce51640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb798070120 0x7fb79809d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79ce51640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7980b0670 0x7fb79809dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79659c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb79806e770 0x7fb79809ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79ce51640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb7980b0a50 con 0x7fb7980b0670 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79ce51640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb7980b6070 con 0x7fb798070120 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79ce51640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb798168450 con 0x7fb79806e770 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79659c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb79806e770 0x7fb79809ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:54728/0 (socket says 172.21.15.120:54728) 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.258+0000 7fb79659c640 1 -- 172.21.15.120:0/3601408155 learned_addr learned my addr 172.21.15.120:0/3601408155 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.259+0000 7fb796d9d640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7980b0670 0x7fb79809dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:16.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.259+0000 7fb795d9b640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb798070120 0x7fb79809d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:16.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.259+0000 7fb79659c640 1 -- 172.21.15.120:0/3601408155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb798070120 msgr2=0x7fb79809d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:16.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.259+0000 7fb79659c640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb798070120 0x7fb79809d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.259+0000 7fb79659c640 1 -- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7980b0670 msgr2=0x7fb79809dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:16.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.259+0000 7fb79659c640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7980b0670 0x7fb79809dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.259+0000 7fb79659c640 1 -- 172.21.15.120:0/3601408155 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7981564f0 con 0x7fb79806e770 2024-04-01T00:12:16.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.260+0000 7fb79659c640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb79806e770 0x7fb79809ba90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb790014350 tx=0x7fb790014810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:16.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.260+0000 7fb786ffd640 1 -- 172.21.15.120:0/3601408155 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900122e0 con 0x7fb79806e770 2024-04-01T00:12:16.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.260+0000 7fb786ffd640 1 -- 172.21.15.120:0/3601408155 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb790012480 con 0x7fb79806e770 2024-04-01T00:12:16.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.261+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79809e700 con 0x7fb79806e770 2024-04-01T00:12:16.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.261+0000 7fb786ffd640 1 -- 172.21.15.120:0/3601408155 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790010850 con 0x7fb79806e770 2024-04-01T00:12:16.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.261+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79809efa0 con 0x7fb79806e770 2024-04-01T00:12:16.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.264+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb798068cd0 con 0x7fb79806e770 2024-04-01T00:12:16.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.265+0000 7fb786ffd640 1 -- 172.21.15.120:0/3601408155 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7900109f0 con 0x7fb79806e770 2024-04-01T00:12:16.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.266+0000 7fb786ffd640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb77806c8f0 0x7fb77806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:16.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.266+0000 7fb786ffd640 1 -- 172.21.15.120:0/3601408155 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb790094450 con 0x7fb79806e770 2024-04-01T00:12:16.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.266+0000 7fb795d9b640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb77806c8f0 0x7fb77806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:16.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.266+0000 7fb795d9b640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb77806c8f0 0x7fb77806edb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb79815e8b0 tx=0x7fb78c0090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:16.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.275+0000 7fb786ffd640 1 -- 172.21.15.120:0/3601408155 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb7980b5b10 con 0x7fb79806e770 2024-04-01T00:12:16.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.614+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb7980b31a0 con 0x7fb79806e770 2024-04-01T00:12:16.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.614+0000 7fb786ffd640 1 -- 172.21.15.120:0/3601408155 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) ==== 104+0+11 (secure 0 0 0) 0x7fb790062100 con 0x7fb79806e770 2024-04-01T00:12:16.616 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-04-01T00:12:16.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.624+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb77806c8f0 msgr2=0x7fb77806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:16.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.624+0000 7fb79ce51640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb77806c8f0 0x7fb77806edb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb79815e8b0 tx=0x7fb78c0090e0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.624+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb79806e770 msgr2=0x7fb79809ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:16.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.625+0000 7fb79ce51640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb79806e770 0x7fb79809ba90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb790014350 tx=0x7fb790014810 comp rx=0 tx=0).stop 2024-04-01T00:12:16.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.625+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 shutdown_connections 2024-04-01T00:12:16.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.625+0000 7fb79ce51640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb77806c8f0 0x7fb77806edb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.625+0000 7fb79ce51640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7980b0670 0x7fb79809dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.625+0000 7fb79ce51640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb798070120 0x7fb79809d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.625+0000 7fb79ce51640 1 --2- 172.21.15.120:0/3601408155 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb79806e770 0x7fb79809ba90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:16.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.625+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 >> 172.21.15.120:0/3601408155 conn(0x7fb7980b65a0 msgr2=0x7fb7980b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:16.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.626+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 shutdown_connections 2024-04-01T00:12:16.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:16.626+0000 7fb79ce51640 1 -- 172.21.15.120:0/3601408155 wait complete. 2024-04-01T00:12:16.647 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T00:12:17.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.042+0000 7f2504de2640 1 Processor -- start 2024-04-01T00:12:17.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.042+0000 7f2504de2640 1 -- start start 2024-04-01T00:12:17.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.046+0000 7f2504de2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2500153580 0x7f25000d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:17.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.046+0000 7f2504de2640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25000afab0 con 0x7f25000d07c0 2024-04-01T00:12:17.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.046+0000 7f2504de2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f250015cc80 con 0x7f25000af4b0 2024-04-01T00:12:17.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.046+0000 7f2504de2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f25000d0c30 con 0x7f2500153580 2024-04-01T00:12:17.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.046+0000 7f24fe59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2500153580 0x7f25000d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:17.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.046+0000 7f24fed9d640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f25000af4b0 0x7f25001600d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:54508/0 (socket says 172.21.15.120:54508) 2024-04-01T00:12:17.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.046+0000 7f24fed9d640 1 -- 172.21.15.120:0/1093652176 learned_addr learned my addr 172.21.15.120:0/1093652176 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:17.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.047+0000 7f24fd59a640 1 -- 172.21.15.120:0/1093652176 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166966861 0 0) 0x7f250015cc80 con 0x7f25000af4b0 2024-04-01T00:12:17.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.047+0000 7f24fd59a640 1 -- 172.21.15.120:0/1093652176 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24e800bd30 con 0x7f25000af4b0 2024-04-01T00:12:17.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.047+0000 7f24fd59a640 1 -- 172.21.15.120:0/1093652176 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163115566 0 0) 0x7f25000afab0 con 0x7f25000d07c0 2024-04-01T00:12:17.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.047+0000 7f24fd59a640 1 -- 172.21.15.120:0/1093652176 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f250015cc80 con 0x7f25000d07c0 2024-04-01T00:12:17.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.048+0000 7f24fe59c640 1 -- 172.21.15.120:0/1093652176 >> v1:172.21.15.203:6789/0 conn(0x7f25000af4b0 legacy=0x7f25001600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:17.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.048+0000 7f24fe59c640 1 -- 172.21.15.120:0/1093652176 >> v1:172.21.15.120:6789/0 conn(0x7f25000d07c0 legacy=0x7f25000aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:17.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.048+0000 7f24fe59c640 1 -- 172.21.15.120:0/1093652176 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250015da00 con 0x7f2500153580 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.052+0000 7f24fe59c640 1 --2- 172.21.15.120:0/1093652176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 0x7f25000d0280 secure :-1 s=READY pgs=3237 cs=0 l=1 rev1=1 crypto rx=0x7f24f400dbc0 tx=0x7f24f403c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a44699739cf794d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.053+0000 7f24fd59a640 1 -- 172.21.15.120:0/1093652176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4042670 con 0x7f2500153580 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.053+0000 7f24fd59a640 1 -- 172.21.15.120:0/1093652176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f4047070 con 0x7f2500153580 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.053+0000 7f24fd59a640 1 -- 172.21.15.120:0/1093652176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4042a10 con 0x7f2500153580 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.055+0000 7f2504de2640 1 -- 172.21.15.120:0/1093652176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 msgr2=0x7f25000d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.055+0000 7f2504de2640 1 --2- 172.21.15.120:0/1093652176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 0x7f25000d0280 secure :-1 s=READY pgs=3237 cs=0 l=1 rev1=1 crypto rx=0x7f24f400dbc0 tx=0x7f24f403c920 comp rx=0 tx=0).stop 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.056+0000 7f2504de2640 1 -- 172.21.15.120:0/1093652176 shutdown_connections 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.056+0000 7f2504de2640 1 --2- 172.21.15.120:0/1093652176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 0x7f25000d0280 unknown :-1 s=CLOSED pgs=3237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.056+0000 7f2504de2640 1 -- 172.21.15.120:0/1093652176 >> 172.21.15.120:0/1093652176 conn(0x7f250006b750 msgr2=0x7f250006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.061+0000 7f2504de2640 1 -- 172.21.15.120:0/1093652176 shutdown_connections 2024-04-01T00:12:17.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.061+0000 7f2504de2640 1 -- 172.21.15.120:0/1093652176 wait complete. 2024-04-01T00:12:17.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.068+0000 7f2504de2640 1 Processor -- start 2024-04-01T00:12:17.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.068+0000 7f2504de2640 1 -- start start 2024-04-01T00:12:17.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.072+0000 7f2504de2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25000af4b0 0x7f25001f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:17.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.072+0000 7f2504de2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25000d07c0 0x7f25000b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:17.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.072+0000 7f2504de2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 0x7f25000718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:17.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.073+0000 7f2504de2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f250015d4e0 con 0x7f2500153580 2024-04-01T00:12:17.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.073+0000 7f24fdd9b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25000d07c0 0x7f25000b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:17.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.073+0000 7f24fdd9b640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25000d07c0 0x7f25000b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:54744/0 (socket says 172.21.15.120:54744) 2024-04-01T00:12:17.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.073+0000 7f24fdd9b640 1 -- 172.21.15.120:0/1410541475 learned_addr learned my addr 172.21.15.120:0/1410541475 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:17.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.073+0000 7f24fed9d640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 0x7f25000718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:17.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.074+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f250015d200 con 0x7f25000af4b0 2024-04-01T00:12:17.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.074+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2500153960 con 0x7f25000d07c0 2024-04-01T00:12:17.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.075+0000 7f24fdd9b640 1 -- 172.21.15.120:0/1410541475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25000af4b0 msgr2=0x7f25001f0600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T00:12:17.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.075+0000 7f24fdd9b640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25000af4b0 0x7f25001f0600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.075+0000 7f24fdd9b640 1 -- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 msgr2=0x7f25000718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.075+0000 7f24fdd9b640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 0x7f25000718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.075+0000 7f24fdd9b640 1 -- 172.21.15.120:0/1410541475 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25000cea60 con 0x7f25000d07c0 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.075+0000 7f24fdd9b640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25000d07c0 0x7f25000b2720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24f000c400 tx=0x7f24f000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.075+0000 7f24eeffd640 1 -- 172.21.15.120:0/1410541475 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f0017070 con 0x7f25000d07c0 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.076+0000 7f24fed9d640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 0x7f25000718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.076+0000 7f24eeffd640 1 -- 172.21.15.120:0/1410541475 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f00052d0 con 0x7f25000d07c0 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.076+0000 7f24eeffd640 1 -- 172.21.15.120:0/1410541475 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f0003810 con 0x7f25000d07c0 2024-04-01T00:12:17.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.077+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25000b3590 con 0x7f25000d07c0 2024-04-01T00:12:17.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.077+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25000b3b50 con 0x7f25000d07c0 2024-04-01T00:12:17.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.081+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25000685c0 con 0x7f25000d07c0 2024-04-01T00:12:17.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.081+0000 7f24eeffd640 1 -- 172.21.15.120:0/1410541475 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24f001a070 con 0x7f25000d07c0 2024-04-01T00:12:17.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.082+0000 7f24eeffd640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f24e006c8f0 0x7f24e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:17.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.083+0000 7f24eeffd640 1 -- 172.21.15.120:0/1410541475 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f24f008ae80 con 0x7f25000d07c0 2024-04-01T00:12:17.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.083+0000 7f24fe59c640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f24e006c8f0 0x7f24e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:17.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.085+0000 7f24fe59c640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f24e006c8f0 0x7f24e006edb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f24f4046000 tx=0x7f24f400d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:17.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.087+0000 7f24eeffd640 1 -- 172.21.15.120:0/1410541475 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f24f0058c60 con 0x7f25000d07c0 2024-04-01T00:12:17.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.531+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f250006eca0 con 0x7f25000d07c0 2024-04-01T00:12:17.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.536+0000 7f24eeffd640 1 -- 172.21.15.120:0/1410541475 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) ==== 100+0+11 (secure 0 0 0) 0x7f24f005cf60 con 0x7f25000d07c0 2024-04-01T00:12:17.537 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-04-01T00:12:17.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f24e006c8f0 msgr2=0x7f24e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:17.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f24e006c8f0 0x7f24e006edb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f24f4046000 tx=0x7f24f400d000 comp rx=0 tx=0).stop 2024-04-01T00:12:17.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25000d07c0 msgr2=0x7f25000b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:17.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25000d07c0 0x7f25000b2720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24f000c400 tx=0x7f24f000c8c0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 shutdown_connections 2024-04-01T00:12:17.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f24e006c8f0 0x7f24e006edb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2500153580 0x7f25000718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25000d07c0 0x7f25000b2720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 --2- 172.21.15.120:0/1410541475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25000af4b0 0x7f25001f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.550+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 >> 172.21.15.120:0/1410541475 conn(0x7f250006b750 msgr2=0x7f2500152860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:17.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.551+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 shutdown_connections 2024-04-01T00:12:17.553 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.551+0000 7f2504de2640 1 -- 172.21.15.120:0/1410541475 wait complete. 2024-04-01T00:12:17.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T00:12:17.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.972+0000 7fbebea03640 1 Processor -- start 2024-04-01T00:12:17.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.973+0000 7fbebea03640 1 -- start start 2024-04-01T00:12:17.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.976+0000 7fbebea03640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbeb8162920 0x7fbeb81670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:17.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.976+0000 7fbebea03640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8163ac0 0x7fbeb8071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:17.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.976+0000 7fbebea03640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb8071d60 con 0x7fbeb80d0280 2024-04-01T00:12:17.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.976+0000 7fbebea03640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbeb8163f20 con 0x7fbeb8162920 2024-04-01T00:12:17.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.976+0000 7fbebea03640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb81665d0 con 0x7fbeb8163ac0 2024-04-01T00:12:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.977+0000 7fbeb7fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbeb8162920 0x7fbeb81670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.977+0000 7fbeb7fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbeb8162920 0x7fbeb81670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43948/0 (socket says 172.21.15.120:43948) 2024-04-01T00:12:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.977+0000 7fbeb7fff640 1 -- 172.21.15.120:0/2757572922 learned_addr learned my addr 172.21.15.120:0/2757572922 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.978+0000 7fbeb7fff640 1 -- 172.21.15.120:0/2757572922 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8163ac0 msgr2=0x7fbeb8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.978+0000 7fbeb7fff640 1 --2- 172.21.15.120:0/2757572922 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8163ac0 0x7fbeb8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.978+0000 7fbeb7fff640 1 -- 172.21.15.120:0/2757572922 >> v1:172.21.15.120:6789/0 conn(0x7fbeb80d0280 legacy=0x7fbeb80ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:17.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.978+0000 7fbeb7fff640 1 -- 172.21.15.120:0/2757572922 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb81668b0 con 0x7fbeb8162920 2024-04-01T00:12:17.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.981+0000 7fbeb7fff640 1 --2- 172.21.15.120:0/2757572922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb8162920 0x7fbeb81670b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009870 tx=0x7fbea002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40132c3d552f48f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:17.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.981+0000 7fbeb77fe640 1 -- 172.21.15.120:0/2757572922 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0035020 con 0x7fbeb8162920 2024-04-01T00:12:17.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.981+0000 7fbeb77fe640 1 -- 172.21.15.120:0/2757572922 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea0031870 con 0x7fbeb8162920 2024-04-01T00:12:17.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.981+0000 7fbeb77fe640 1 -- 172.21.15.120:0/2757572922 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0031c40 con 0x7fbeb8162920 2024-04-01T00:12:17.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.986+0000 7fbebea03640 1 -- 172.21.15.120:0/2757572922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb8162920 msgr2=0x7fbeb81670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:17.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.986+0000 7fbebea03640 1 --2- 172.21.15.120:0/2757572922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb8162920 0x7fbeb81670b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009870 tx=0x7fbea002b910 comp rx=0 tx=0).stop 2024-04-01T00:12:17.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.986+0000 7fbebea03640 1 -- 172.21.15.120:0/2757572922 shutdown_connections 2024-04-01T00:12:17.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.986+0000 7fbebea03640 1 --2- 172.21.15.120:0/2757572922 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8163ac0 0x7fbeb8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.986+0000 7fbebea03640 1 --2- 172.21.15.120:0/2757572922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb8162920 0x7fbeb81670b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:17.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.986+0000 7fbebea03640 1 -- 172.21.15.120:0/2757572922 >> 172.21.15.120:0/2757572922 conn(0x7fbeb806b750 msgr2=0x7fbeb806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:17.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.986+0000 7fbebea03640 1 -- 172.21.15.120:0/2757572922 shutdown_connections 2024-04-01T00:12:18.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:17.994+0000 7fbebea03640 1 -- 172.21.15.120:0/2757572922 wait complete. 2024-04-01T00:12:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.000+0000 7fbebea03640 1 Processor -- start 2024-04-01T00:12:18.001 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.000+0000 7fbebea03640 1 -- start start 2024-04-01T00:12:18.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbebea03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeb80d0280 0x7fbeb80b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:18.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbebea03640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8162920 0x7fbeb8148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:18.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbebea03640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb8163ac0 0x7fbeb8146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbebea03640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb8072040 con 0x7fbeb80d0280 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbebea03640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb8162d00 con 0x7fbeb8163ac0 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbebea03640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb80721c0 con 0x7fbeb8162920 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbeaf7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8162920 0x7fbeb8148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbeaf7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8162920 0x7fbeb8148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:54770/0 (socket says 172.21.15.120:54770) 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbeaf7fe640 1 -- 172.21.15.120:0/3635472037 learned_addr learned my addr 172.21.15.120:0/3635472037 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.002+0000 7fbeb7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeb80d0280 0x7fbeb80b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.003+0000 7fbeaf7fe640 1 -- 172.21.15.120:0/3635472037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb8163ac0 msgr2=0x7fbeb8146d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.003+0000 7fbeaf7fe640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb8163ac0 0x7fbeb8146d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.003+0000 7fbeaf7fe640 1 -- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeb80d0280 msgr2=0x7fbeb80b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.003+0000 7fbeaf7fe640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeb80d0280 0x7fbeb80b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.004+0000 7fbeaf7fe640 1 -- 172.21.15.120:0/3635472037 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb814dab0 con 0x7fbeb8162920 2024-04-01T00:12:18.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.006+0000 7fbeaf7fe640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8162920 0x7fbeb8148800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbea800b410 tx=0x7fbea800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.008+0000 7fbeb57fa640 1 -- 172.21.15.120:0/3635472037 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea8015020 con 0x7fbeb8162920 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.008+0000 7fbeb57fa640 1 -- 172.21.15.120:0/3635472037 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea8011830 con 0x7fbeb8162920 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.008+0000 7fbeb57fa640 1 -- 172.21.15.120:0/3635472037 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea8011c20 con 0x7fbeb8162920 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.009+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb80b2610 con 0x7fbeb8162920 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.009+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb80b2bd0 con 0x7fbeb8162920 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.014+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb80685c0 con 0x7fbeb8162920 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.015+0000 7fbeb57fa640 1 -- 172.21.15.120:0/3635472037 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbea8018020 con 0x7fbeb8162920 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.016+0000 7fbeb57fa640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe9806c9c0 0x7fbe9806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:18.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.016+0000 7fbeb57fa640 1 -- 172.21.15.120:0/3635472037 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbea808bb80 con 0x7fbeb8162920 2024-04-01T00:12:18.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.021+0000 7fbeb7fff640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe9806c9c0 0x7fbe9806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:18.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.021+0000 7fbeb57fa640 1 -- 172.21.15.120:0/3635472037 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbea801f020 con 0x7fbeb8162920 2024-04-01T00:12:18.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:18.023+0000 7fbeb7fff640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe9806c9c0 0x7fbe9806ee80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbea0036000 tx=0x7fbea003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:19.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.082+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeb80af200 con 0x7fbeb8162920 2024-04-01T00:12:19.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.085+0000 7fbeb57fa640 1 -- 172.21.15.120:0/3635472037 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7fbea80172c0 con 0x7fbeb8162920 2024-04-01T00:12:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:19.087 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/4016494046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4016494046},{"type":"v1","addr":"172.21.15.203:6834","nonce":4016494046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1319253278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":1319253278},{"type":"v1","addr":"172.21.15.203:6835","nonce":1319253278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1766153586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1766153586},{"type":"v1","addr":"172.21.15.120:6836","nonce":1766153586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:36:23.168388+0000","modified":"2024-03-31T16:36:25.178205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/2154626843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2154626843},{"type":"v1","addr":"172.21.15.120:6837","nonce":2154626843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-04-01T00:12:19.088 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 14 2024-04-01T00:12:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.092+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe9806c9c0 msgr2=0x7fbe9806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.092+0000 7fbebea03640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe9806c9c0 0x7fbe9806ee80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbea0036000 tx=0x7fbea003c040 comp rx=0 tx=0).stop 2024-04-01T00:12:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.092+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8162920 msgr2=0x7fbeb8148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:19.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.092+0000 7fbebea03640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8162920 0x7fbeb8148800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbea800b410 tx=0x7fbea800b8d0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.092+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 shutdown_connections 2024-04-01T00:12:19.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.093+0000 7fbebea03640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fbe9806c9c0 0x7fbe9806ee80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.093+0000 7fbebea03640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbeb8163ac0 0x7fbeb8146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.093+0000 7fbebea03640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbeb8162920 0x7fbeb8148800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.093+0000 7fbebea03640 1 --2- 172.21.15.120:0/3635472037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbeb80d0280 0x7fbeb80b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.093+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 >> 172.21.15.120:0/3635472037 conn(0x7fbeb806b750 msgr2=0x7fbeb80ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:19.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.094+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 shutdown_connections 2024-04-01T00:12:19.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.094+0000 7fbebea03640 1 -- 172.21.15.120:0/3635472037 wait complete. 2024-04-01T00:12:19.132 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T00:12:19.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.522+0000 7f169e3db640 1 Processor -- start 2024-04-01T00:12:19.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.522+0000 7f169e3db640 1 -- start start 2024-04-01T00:12:19.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.524+0000 7f169e3db640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1698153580 0x7f16980d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:19.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.525+0000 7f169e3db640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16980af4b0 0x7f16981600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:19.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.525+0000 7f1697fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1698153580 0x7f16980d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:19.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.525+0000 7f169e3db640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16980afab0 con 0x7f16980d07c0 2024-04-01T00:12:19.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.525+0000 7f16977fe640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f16980d07c0 0x7f16980aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:54524/0 (socket says 172.21.15.120:54524) 2024-04-01T00:12:19.526 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.525+0000 7f169e3db640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f16980d0c30 con 0x7f1698153580 2024-04-01T00:12:19.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.525+0000 7f16977fe640 1 -- 172.21.15.120:0/2452585394 learned_addr learned my addr 172.21.15.120:0/2452585394 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:19.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.525+0000 7f169c978640 1 --2- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16980af4b0 0x7f16981600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:19.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.525+0000 7f169e3db640 1 -- 172.21.15.120:0/2452585394 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f169815cc80 con 0x7f16980af4b0 2024-04-01T00:12:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.526+0000 7f1696ffd640 1 -- 172.21.15.120:0/2452585394 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787652539 0 0) 0x7f16980afab0 con 0x7f16980d07c0 2024-04-01T00:12:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.526+0000 7f1696ffd640 1 -- 172.21.15.120:0/2452585394 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1680003520 con 0x7f16980d07c0 2024-04-01T00:12:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.526+0000 7f1697fff640 1 -- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16980af4b0 msgr2=0x7f16981600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.526+0000 7f1697fff640 1 --2- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16980af4b0 0x7f16981600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.526+0000 7f1697fff640 1 -- 172.21.15.120:0/2452585394 >> v1:172.21.15.203:6789/0 conn(0x7f16980d07c0 legacy=0x7f16980aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.526+0000 7f1697fff640 1 -- 172.21.15.120:0/2452585394 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169815da00 con 0x7f1698153580 2024-04-01T00:12:19.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.526+0000 7f169c978640 1 --2- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16980af4b0 0x7f16981600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:19.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.527+0000 7f1697fff640 1 --2- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1698153580 0x7f16980d0280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16880097a0 tx=0x7f168802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba53a5b2aa33327 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:19.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.527+0000 7f1696ffd640 1 -- 172.21.15.120:0/2452585394 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688031780 con 0x7f1698153580 2024-04-01T00:12:19.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.528+0000 7f1696ffd640 1 -- 172.21.15.120:0/2452585394 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1688037070 con 0x7f1698153580 2024-04-01T00:12:19.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.528+0000 7f1696ffd640 1 -- 172.21.15.120:0/2452585394 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688031b20 con 0x7f1698153580 2024-04-01T00:12:19.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.529+0000 7f169e3db640 1 -- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1698153580 msgr2=0x7f16980d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:19.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.529+0000 7f169e3db640 1 --2- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1698153580 0x7f16980d0280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16880097a0 tx=0x7f168802b820 comp rx=0 tx=0).stop 2024-04-01T00:12:19.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.529+0000 7f169e3db640 1 -- 172.21.15.120:0/2452585394 shutdown_connections 2024-04-01T00:12:19.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.529+0000 7f169e3db640 1 --2- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f16980af4b0 0x7f16981600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.529+0000 7f169e3db640 1 --2- 172.21.15.120:0/2452585394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1698153580 0x7f16980d0280 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.529+0000 7f169e3db640 1 -- 172.21.15.120:0/2452585394 >> 172.21.15.120:0/2452585394 conn(0x7f169806b750 msgr2=0x7f169806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:19.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.529+0000 7f169e3db640 1 -- 172.21.15.120:0/2452585394 shutdown_connections 2024-04-01T00:12:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.529+0000 7f169e3db640 1 -- 172.21.15.120:0/2452585394 wait complete. 2024-04-01T00:12:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.531+0000 7f169e3db640 1 Processor -- start 2024-04-01T00:12:19.532 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.531+0000 7f169e3db640 1 -- start start 2024-04-01T00:12:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f169e3db640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16980af4b0 0x7f16980afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f169e3db640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980d07c0 0x7f16980cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:19.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f169e3db640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1698153580 0x7f16980ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f169e3db640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f169815d4e0 con 0x7f16980d07c0 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f169e3db640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f169815d200 con 0x7f16980af4b0 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f169e3db640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1698153960 con 0x7f1698153580 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f1697fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16980af4b0 0x7f16980afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f1697fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16980af4b0 0x7f16980afca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43958/0 (socket says 172.21.15.120:43958) 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f1697fff640 1 -- 172.21.15.120:0/1143629477 learned_addr learned my addr 172.21.15.120:0/1143629477 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f169c978640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1698153580 0x7f16980ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.533+0000 7f16977fe640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980d07c0 0x7f16980cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.534+0000 7f169c978640 1 -- 172.21.15.120:0/1143629477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16980af4b0 msgr2=0x7f16980afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.534+0000 7f169c978640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16980af4b0 0x7f16980afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.534+0000 7f169c978640 1 -- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980d07c0 msgr2=0x7f16980cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.534+0000 7f169c978640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980d07c0 0x7f16980cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.534+0000 7f169c978640 1 -- 172.21.15.120:0/1143629477 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16980b0280 con 0x7f1698153580 2024-04-01T00:12:19.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.534+0000 7f16977fe640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980d07c0 0x7f16980cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T00:12:19.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.535+0000 7f169c978640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1698153580 0x7f16980ccf90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1690009550 tx=0x7f1690009a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:19.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.536+0000 7f1694ff9640 1 -- 172.21.15.120:0/1143629477 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690003b90 con 0x7f1698153580 2024-04-01T00:12:19.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.536+0000 7f1694ff9640 1 -- 172.21.15.120:0/1143629477 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1690003d30 con 0x7f1698153580 2024-04-01T00:12:19.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.536+0000 7f1694ff9640 1 -- 172.21.15.120:0/1143629477 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690018ad0 con 0x7f1698153580 2024-04-01T00:12:19.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.538+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16980b0560 con 0x7f1698153580 2024-04-01T00:12:19.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.538+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f16980b0b20 con 0x7f1698153580 2024-04-01T00:12:19.542 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.541+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1678005290 con 0x7f1698153580 2024-04-01T00:12:19.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.543+0000 7f1694ff9640 1 -- 172.21.15.120:0/1143629477 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1690018c70 con 0x7f1698153580 2024-04-01T00:12:19.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.544+0000 7f1694ff9640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f168406c9c0 0x7f168406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:19.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.544+0000 7f1694ff9640 1 -- 172.21.15.120:0/1143629477 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1690094830 con 0x7f1698153580 2024-04-01T00:12:19.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.546+0000 7f1697fff640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f168406c9c0 0x7f168406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:19.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.548+0000 7f1697fff640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f168406c9c0 0x7f168406ee80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f168802b860 tx=0x7f1688008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:19.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.550+0000 7f1694ff9640 1 -- 172.21.15.120:0/1143629477 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1690027020 con 0x7f1698153580 2024-04-01T00:12:19.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.967+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1678005580 con 0x7f1698153580 2024-04-01T00:12:19.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.969+0000 7f1694ff9640 1 -- 172.21.15.120:0/1143629477 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7f16900625a0 con 0x7f1698153580 2024-04-01T00:12:19.971 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:19.971 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:24.828471+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:36:21.024330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-31T16:36:22.128594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.979+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f168406c9c0 msgr2=0x7f168406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f168406c9c0 0x7f168406ee80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f168802b860 tx=0x7f1688008030 comp rx=0 tx=0).stop 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1698153580 msgr2=0x7f16980ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1698153580 0x7f16980ccf90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1690009550 tx=0x7f1690009a10 comp rx=0 tx=0).stop 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 shutdown_connections 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f168406c9c0 0x7f168406ee80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1698153580 0x7f16980ccf90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f16980d07c0 0x7f16980cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 --2- 172.21.15.120:0/1143629477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16980af4b0 0x7f16980afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.980+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 >> 172.21.15.120:0/1143629477 conn(0x7f169806b750 msgr2=0x7f169815f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.981+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 shutdown_connections 2024-04-01T00:12:19.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:19.981+0000 7f169e3db640 1 -- 172.21.15.120:0/1143629477 wait complete. 2024-04-01T00:12:20.022 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-01T00:12:20.022 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T00:12:20.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.417+0000 7f31107cd640 1 Processor -- start 2024-04-01T00:12:20.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.417+0000 7f31107cd640 1 -- start start 2024-04-01T00:12:20.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.421+0000 7f31107cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f3108073520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:20.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.421+0000 7f31107cd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3108099e60 con 0x7f31080b1420 2024-04-01T00:12:20.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.421+0000 7f31107cd640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31080adac0 con 0x7f310816bc10 2024-04-01T00:12:20.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.421+0000 7f31107cd640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f31080ae110 con 0x7f31080b3740 2024-04-01T00:12:20.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.421+0000 7f310ed6a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f3108073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:20.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.422+0000 7f310ed6a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f3108073520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:54798/0 (socket says 172.21.15.120:54798) 2024-04-01T00:12:20.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.422+0000 7f310ed6a640 1 -- 172.21.15.120:0/881613962 learned_addr learned my addr 172.21.15.120:0/881613962 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:20.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.422+0000 7f310ed6a640 1 -- 172.21.15.120:0/881613962 >> v1:172.21.15.203:6789/0 conn(0x7f310816bc10 legacy=0x7f3108099750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T00:12:20.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.422+0000 7f310ed6a640 1 -- 172.21.15.120:0/881613962 >> v1:172.21.15.120:6789/0 conn(0x7f31080b1420 legacy=0x7f31080b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:20.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.422+0000 7f310ed6a640 1 -- 172.21.15.120:0/881613962 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31080adda0 con 0x7f31080b3740 2024-04-01T00:12:20.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.425+0000 7f310ed6a640 1 --2- 172.21.15.120:0/881613962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f3108073520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3100009e80 tx=0x7f310002bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9497eccab3ec35 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:20.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.426+0000 7f310d567640 1 -- 172.21.15.120:0/881613962 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310002cae0 con 0x7f31080b3740 2024-04-01T00:12:20.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.426+0000 7f310d567640 1 -- 172.21.15.120:0/881613962 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310002cc80 con 0x7f31080b3740 2024-04-01T00:12:20.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.426+0000 7f310d567640 1 -- 172.21.15.120:0/881613962 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100034610 con 0x7f31080b3740 2024-04-01T00:12:20.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.428+0000 7f31107cd640 1 -- 172.21.15.120:0/881613962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 msgr2=0x7f3108073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:20.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.428+0000 7f31107cd640 1 --2- 172.21.15.120:0/881613962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f3108073520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3100009e80 tx=0x7f310002bf40 comp rx=0 tx=0).stop 2024-04-01T00:12:20.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.428+0000 7f31107cd640 1 -- 172.21.15.120:0/881613962 shutdown_connections 2024-04-01T00:12:20.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.428+0000 7f31107cd640 1 --2- 172.21.15.120:0/881613962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f3108073520 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:20.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.428+0000 7f31107cd640 1 -- 172.21.15.120:0/881613962 >> 172.21.15.120:0/881613962 conn(0x7f3108072a00 msgr2=0x7f3108072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:20.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.429+0000 7f31107cd640 1 -- 172.21.15.120:0/881613962 shutdown_connections 2024-04-01T00:12:20.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.429+0000 7f31107cd640 1 -- 172.21.15.120:0/881613962 wait complete. 2024-04-01T00:12:20.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.431+0000 7f31107cd640 1 Processor -- start 2024-04-01T00:12:20.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.431+0000 7f31107cd640 1 -- start start 2024-04-01T00:12:20.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.432+0000 7f31107cd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31080b1420 0x7f310809cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:20.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.432+0000 7f31107cd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f310816a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:20.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.432+0000 7f31107cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f310816bc10 0x7f3108083670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:20.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.433+0000 7f31107cd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f31081783d0 con 0x7f310816bc10 2024-04-01T00:12:20.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.433+0000 7f310e569640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31080b1420 0x7f310809cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.433+0000 7f310e569640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31080b1420 0x7f310809cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43968/0 (socket says 172.21.15.120:43968) 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.433+0000 7f310e569640 1 -- 172.21.15.120:0/2786229335 learned_addr learned my addr 172.21.15.120:0/2786229335 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.433+0000 7f310dd68640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f310816a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.433+0000 7f310ed6a640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f310816bc10 0x7f3108083670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.433+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31080b10d0 con 0x7f31080b1420 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.433+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3108178550 con 0x7f31080b3740 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.434+0000 7f310e569640 1 -- 172.21.15.120:0/2786229335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 msgr2=0x7f310816a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.434+0000 7f310e569640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f310816a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.434+0000 7f310e569640 1 -- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f310816bc10 msgr2=0x7f3108083670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.434+0000 7f310e569640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f310816bc10 0x7f3108083670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.434+0000 7f310e569640 1 -- 172.21.15.120:0/2786229335 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310816b130 con 0x7f31080b1420 2024-04-01T00:12:20.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.434+0000 7f310dd68640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f310816a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:20.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.434+0000 7f310e569640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31080b1420 0x7f310809cf70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f30f800b3e0 tx=0x7f30f800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:20.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.435+0000 7f30feffd640 1 -- 172.21.15.120:0/2786229335 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8015020 con 0x7f31080b1420 2024-04-01T00:12:20.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.435+0000 7f30feffd640 1 -- 172.21.15.120:0/2786229335 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f8011850 con 0x7f31080b1420 2024-04-01T00:12:20.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.435+0000 7f30feffd640 1 -- 172.21.15.120:0/2786229335 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f8011c40 con 0x7f31080b1420 2024-04-01T00:12:20.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.435+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310816b410 con 0x7f31080b1420 2024-04-01T00:12:20.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.435+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f310816b9d0 con 0x7f31080b1420 2024-04-01T00:12:20.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.439+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f0005290 con 0x7f31080b1420 2024-04-01T00:12:20.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.441+0000 7f30feffd640 1 -- 172.21.15.120:0/2786229335 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30f8018020 con 0x7f31080b1420 2024-04-01T00:12:20.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.443+0000 7f30feffd640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f30ec06c920 0x7f30ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:20.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.443+0000 7f30feffd640 1 -- 172.21.15.120:0/2786229335 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f30f808b8d0 con 0x7f31080b1420 2024-04-01T00:12:20.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.444+0000 7f310dd68640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f30ec06c920 0x7f30ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:20.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.445+0000 7f310dd68640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f30ec06c920 0x7f30ec06ede0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3108084650 tx=0x7f3104009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:20.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:20.448+0000 7f30feffd640 1 -- 172.21.15.120:0/2786229335 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f30f801f020 con 0x7f31080b1420 2024-04-01T00:12:21.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.663+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30f0005580 con 0x7f31080b1420 2024-04-01T00:12:21.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.664+0000 7f30feffd640 1 -- 172.21.15.120:0/2786229335 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f30f801f020 con 0x7f31080b1420 2024-04-01T00:12:21.668 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:21.668 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/4016494046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4016494046},{"type":"v1","addr":"172.21.15.203:6834","nonce":4016494046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1319253278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":1319253278},{"type":"v1","addr":"172.21.15.203:6835","nonce":1319253278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1766153586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1766153586},{"type":"v1","addr":"172.21.15.120:6836","nonce":1766153586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:36:23.168388+0000","modified":"2024-03-31T16:36:25.178205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/2154626843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2154626843},{"type":"v1","addr":"172.21.15.120:6837","nonce":2154626843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-04-01T00:12:21.668 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 14 2024-04-01T00:12:21.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f30ec06c920 msgr2=0x7f30ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:21.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f30ec06c920 0x7f30ec06ede0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3108084650 tx=0x7f3104009040 comp rx=0 tx=0).stop 2024-04-01T00:12:21.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31080b1420 msgr2=0x7f310809cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:21.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31080b1420 0x7f310809cf70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f30f800b3e0 tx=0x7f30f800b8a0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 shutdown_connections 2024-04-01T00:12:21.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f30ec06c920 0x7f30ec06ede0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f310816bc10 0x7f3108083670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31080b3740 0x7f310816a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 --2- 172.21.15.120:0/2786229335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31080b1420 0x7f310809cf70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.673+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 >> 172.21.15.120:0/2786229335 conn(0x7f3108072a00 msgr2=0x7f3108178950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:21.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.674+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 shutdown_connections 2024-04-01T00:12:21.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.674+0000 7f31107cd640 1 -- 172.21.15.120:0/2786229335 wait complete. 2024-04-01T00:12:21.713 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T00:12:21.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.969+0000 7f4b1a6c5640 1 Processor -- start 2024-04-01T00:12:21.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.969+0000 7f4b1a6c5640 1 -- start start 2024-04-01T00:12:21.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.973+0000 7f4b1a6c5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4b14162a60 0x7f4b140b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:21.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.973+0000 7f4b1a6c5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b1406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:21.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.973+0000 7f4b1a6c5640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b140b3560 con 0x7f4b140cfe70 2024-04-01T00:12:21.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.973+0000 7f4b1a6c5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f4b140b3e20 con 0x7f4b14162a60 2024-04-01T00:12:21.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.973+0000 7f4b1a6c5640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4b140b5450 con 0x7f4b1406da50 2024-04-01T00:12:21.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.974+0000 7f4b18c62640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b1406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:21.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.974+0000 7f4b18c62640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b1406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:54816/0 (socket says 172.21.15.120:54816) 2024-04-01T00:12:21.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.974+0000 7f4b18c62640 1 -- 172.21.15.120:0/2048609162 learned_addr learned my addr 172.21.15.120:0/2048609162 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:21.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.974+0000 7f4b13fff640 1 --2- 172.21.15.120:0/2048609162 >> v2:172.21.15.120:3300/0 conn(0x7f4b14162a60 0x7f4b140b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:21.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.975+0000 7f4b18c62640 1 -- 172.21.15.120:0/2048609162 >> v2:172.21.15.120:3300/0 conn(0x7f4b14162a60 msgr2=0x7f4b140b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:21.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.975+0000 7f4b18c62640 1 --2- 172.21.15.120:0/2048609162 >> v2:172.21.15.120:3300/0 conn(0x7f4b14162a60 0x7f4b140b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.975+0000 7f4b18c62640 1 -- 172.21.15.120:0/2048609162 >> v1:172.21.15.203:6789/0 conn(0x7f4b140cfe70 legacy=0x7f4b140b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:21.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.975+0000 7f4b18c62640 1 -- 172.21.15.120:0/2048609162 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b140b37d0 con 0x7f4b1406da50 2024-04-01T00:12:21.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.979+0000 7f4b18c62640 1 --2- 172.21.15.120:0/2048609162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b1406de60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e50 tx=0x7f4b0c02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b03a0734a79fa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:21.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.979+0000 7f4b12ffd640 1 -- 172.21.15.120:0/2048609162 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c02cb40 con 0x7f4b1406da50 2024-04-01T00:12:21.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.980+0000 7f4b12ffd640 1 -- 172.21.15.120:0/2048609162 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0c02cce0 con 0x7f4b1406da50 2024-04-01T00:12:21.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.980+0000 7f4b12ffd640 1 -- 172.21.15.120:0/2048609162 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c034610 con 0x7f4b1406da50 2024-04-01T00:12:21.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.980+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/2048609162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 msgr2=0x7f4b1406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:21.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.980+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/2048609162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b1406de60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e50 tx=0x7f4b0c02bfa0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.981+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/2048609162 shutdown_connections 2024-04-01T00:12:21.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.981+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/2048609162 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b1406de60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.981+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/2048609162 >> v2:172.21.15.120:3300/0 conn(0x7f4b14162a60 0x7f4b140b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:21.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.981+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/2048609162 >> 172.21.15.120:0/2048609162 conn(0x7f4b140b21c0 msgr2=0x7f4b140b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:21.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.985+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/2048609162 shutdown_connections 2024-04-01T00:12:21.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.992+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/2048609162 wait complete. 2024-04-01T00:12:21.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.994+0000 7f4b1a6c5640 1 Processor -- start 2024-04-01T00:12:21.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.994+0000 7f4b1a6c5640 1 -- start start 2024-04-01T00:12:21.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.995+0000 7f4b1a6c5640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b14165850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:21.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.996+0000 7f4b1a6c5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b140cfe70 0x7f4b141648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.996+0000 7f4b1a6c5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b14162a60 0x7f4b140b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.996+0000 7f4b137fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b140cfe70 0x7f4b141648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.996+0000 7f4b13fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b14165850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.996+0000 7f4b137fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b140cfe70 0x7f4b141648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43974/0 (socket says 172.21.15.120:43974) 2024-04-01T00:12:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.996+0000 7f4b137fe640 1 -- 172.21.15.120:0/3469194914 learned_addr learned my addr 172.21.15.120:0/3469194914 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:21.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.996+0000 7f4b13fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b14165850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:54832/0 (socket says 172.21.15.120:54832) 2024-04-01T00:12:21.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.997+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4b140b49c0 con 0x7f4b14162a60 2024-04-01T00:12:21.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.997+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4b140b5710 con 0x7f4b140cfe70 2024-04-01T00:12:21.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.997+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4b140b4b40 con 0x7f4b1406da50 2024-04-01T00:12:21.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:21.997+0000 7f4b18c62640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b14162a60 0x7f4b140b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.004+0000 7f4b137fe640 1 -- 172.21.15.120:0/3469194914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 msgr2=0x7f4b14165850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.004+0000 7f4b137fe640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b14165850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.004+0000 7f4b137fe640 1 -- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b14162a60 msgr2=0x7f4b140b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.004+0000 7f4b137fe640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b14162a60 0x7f4b140b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.004+0000 7f4b137fe640 1 -- 172.21.15.120:0/3469194914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b14165e60 con 0x7f4b140cfe70 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.004+0000 7f4b137fe640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b140cfe70 0x7f4b141648a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800c460 tx=0x7f4b0800c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.005+0000 7f4b10ff9640 1 -- 172.21.15.120:0/3469194914 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08016020 con 0x7f4b140cfe70 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.005+0000 7f4b10ff9640 1 -- 172.21.15.120:0/3469194914 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b080052f0 con 0x7f4b140cfe70 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.005+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b141fbc90 con 0x7f4b140cfe70 2024-04-01T00:12:22.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.005+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b140b1dc0 con 0x7f4b140cfe70 2024-04-01T00:12:22.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.007+0000 7f4b10ff9640 1 -- 172.21.15.120:0/3469194914 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08007260 con 0x7f4b140cfe70 2024-04-01T00:12:22.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.011+0000 7f4b10ff9640 1 -- 172.21.15.120:0/3469194914 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b08007440 con 0x7f4b140cfe70 2024-04-01T00:12:22.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.013+0000 7f4b10ff9640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4b0007d9d0 0x7f4b0007fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:22.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.013+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af4005290 con 0x7f4b140cfe70 2024-04-01T00:12:22.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.013+0000 7f4b10ff9640 1 -- 172.21.15.120:0/3469194914 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4b0808b340 con 0x7f4b140cfe70 2024-04-01T00:12:22.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.016+0000 7f4b13fff640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4b0007d9d0 0x7f4b0007fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:22.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.017+0000 7f4b13fff640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4b0007d9d0 0x7f4b0007fe90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4b04006fd0 tx=0x7f4b04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:22.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:22.024+0000 7f4b10ff9640 1 -- 172.21.15.120:0/3469194914 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4b08020020 con 0x7f4b140cfe70 2024-04-01T00:12:23.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.229+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4af4005580 con 0x7f4b140cfe70 2024-04-01T00:12:23.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.230+0000 7f4b10ff9640 1 -- 172.21.15.120:0/3469194914 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f4b08059190 con 0x7f4b140cfe70 2024-04-01T00:12:23.232 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:23.233 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/4016494046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4016494046},{"type":"v1","addr":"172.21.15.203:6834","nonce":4016494046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1319253278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":1319253278},{"type":"v1","addr":"172.21.15.203:6835","nonce":1319253278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1766153586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1766153586},{"type":"v1","addr":"172.21.15.120:6836","nonce":1766153586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-31T16:36:23.168388+0000","modified":"2024-03-31T16:36:25.178205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/2154626843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":2154626843},{"type":"v1","addr":"172.21.15.120:6837","nonce":2154626843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5088,"qdb_cluster":[5088]},"id":2}]} 2024-04-01T00:12:23.233 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 14 2024-04-01T00:12:23.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.236+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4b0007d9d0 msgr2=0x7f4b0007fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:23.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.236+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4b0007d9d0 0x7f4b0007fe90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4b04006fd0 tx=0x7f4b04008040 comp rx=0 tx=0).stop 2024-04-01T00:12:23.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.236+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b140cfe70 msgr2=0x7f4b141648a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:23.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.236+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b140cfe70 0x7f4b141648a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800c460 tx=0x7f4b0800c920 comp rx=0 tx=0).stop 2024-04-01T00:12:23.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.237+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 shutdown_connections 2024-04-01T00:12:23.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.237+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4b0007d9d0 0x7f4b0007fe90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:23.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.237+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4b14162a60 0x7f4b140b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:23.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.237+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b140cfe70 0x7f4b141648a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:23.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.237+0000 7f4b1a6c5640 1 --2- 172.21.15.120:0/3469194914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b1406da50 0x7f4b14165850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:23.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.237+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 >> 172.21.15.120:0/3469194914 conn(0x7f4b140b21c0 msgr2=0x7f4b140b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:23.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.237+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 shutdown_connections 2024-04-01T00:12:23.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.237+0000 7f4b1a6c5640 1 -- 172.21.15.120:0/3469194914 wait complete. 2024-04-01T00:12:23.275 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T00:12:23.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.684+0000 7f2ffffff640 1 Processor -- start 2024-04-01T00:12:23.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.684+0000 7f2ffffff640 1 -- start start 2024-04-01T00:12:23.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.688+0000 7f2ffffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2ff80ead00 0x7f2ff804fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:23.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.688+0000 7f2ffffff640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff8053720 con 0x7f2ff8006ea0 2024-04-01T00:12:23.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.688+0000 7f2ffffff640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff8053a00 con 0x7f2ff804ffd0 2024-04-01T00:12:23.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.688+0000 7f2ffffff640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff8054330 con 0x7f2ff80ead00 2024-04-01T00:12:23.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.688+0000 7f2ffeffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2ff80ead00 0x7f2ff804fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:23.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.688+0000 7f2ffeffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2ff80ead00 0x7f2ff804fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40576/0 (socket says 172.21.15.120:40576) 2024-04-01T00:12:23.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.688+0000 7f2ffeffd640 1 -- 172.21.15.120:0/1085195167 learned_addr learned my addr 172.21.15.120:0/1085195167 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:23.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.689+0000 7f2ffeffd640 1 -- 172.21.15.120:0/1085195167 >> v1:172.21.15.203:6789/0 conn(0x7f2ff804ffd0 legacy=0x7f2ff8037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:23.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.689+0000 7f2ffeffd640 1 -- 172.21.15.120:0/1085195167 >> v1:172.21.15.120:6789/0 conn(0x7f2ff8006ea0 legacy=0x7f2ff80382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:23.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.689+0000 7f2ffeffd640 1 -- 172.21.15.120:0/1085195167 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff8053ce0 con 0x7f2ff80ead00 2024-04-01T00:12:23.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.693+0000 7f2ffeffd640 1 --2- 172.21.15.120:0/1085195167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff804fa90 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00097f0 tx=0x7f2ff002b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614a584f2aaf9fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:23.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.694+0000 7f2ffdffb640 1 -- 172.21.15.120:0/1085195167 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0031760 con 0x7f2ff80ead00 2024-04-01T00:12:23.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.694+0000 7f2ffdffb640 1 -- 172.21.15.120:0/1085195167 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff0037070 con 0x7f2ff80ead00 2024-04-01T00:12:23.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.694+0000 7f2ffdffb640 1 -- 172.21.15.120:0/1085195167 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0031b20 con 0x7f2ff80ead00 2024-04-01T00:12:23.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.695+0000 7f2ffffff640 1 -- 172.21.15.120:0/1085195167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 msgr2=0x7f2ff804fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:23.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.695+0000 7f2ffffff640 1 --2- 172.21.15.120:0/1085195167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff804fa90 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00097f0 tx=0x7f2ff002b800 comp rx=0 tx=0).stop 2024-04-01T00:12:23.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.695+0000 7f2ffffff640 1 -- 172.21.15.120:0/1085195167 shutdown_connections 2024-04-01T00:12:23.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.695+0000 7f2ffffff640 1 --2- 172.21.15.120:0/1085195167 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff804fa90 unknown :-1 s=CLOSED pgs=3241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:23.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.695+0000 7f2ffffff640 1 -- 172.21.15.120:0/1085195167 >> 172.21.15.120:0/1085195167 conn(0x7f2ff8009fb0 msgr2=0x7f2ff800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:23.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.695+0000 7f2ffffff640 1 -- 172.21.15.120:0/1085195167 shutdown_connections 2024-04-01T00:12:23.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.695+0000 7f2ffffff640 1 -- 172.21.15.120:0/1085195167 wait complete. 2024-04-01T00:12:23.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.701+0000 7f2ffffff640 1 Processor -- start 2024-04-01T00:12:23.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.701+0000 7f2ffffff640 1 -- start start 2024-04-01T00:12:23.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.704+0000 7f2ffffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff8006ea0 0x7f2ff8043ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:23.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.704+0000 7f2ffffff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff804ffd0 0x7f2ff80458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:23.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.704+0000 7f2ffeffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff8006ea0 0x7f2ff8043ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:23.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.704+0000 7f2ffeffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff8006ea0 0x7f2ff8043ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:43978/0 (socket says 172.21.15.120:43978) 2024-04-01T00:12:23.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.704+0000 7f2ffe7fc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff804ffd0 0x7f2ff80458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:23.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.705+0000 7f2ffe7fc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff804ffd0 0x7f2ff80458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:54842/0 (socket says 172.21.15.120:54842) 2024-04-01T00:12:23.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.705+0000 7f2ffffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff8046410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.705+0000 7f2ffffff640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8054940 con 0x7f2ff80ead00 2024-04-01T00:12:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.705+0000 7f2ffffff640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff80547c0 con 0x7f2ff8006ea0 2024-04-01T00:12:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.705+0000 7f2ffffff640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff804f550 con 0x7f2ff804ffd0 2024-04-01T00:12:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.705+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff8046410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.705+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff8046410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40590/0 (socket says 172.21.15.120:40590) 2024-04-01T00:12:23.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.705+0000 7f2fff7fe640 1 -- 172.21.15.120:0/2542876332 learned_addr learned my addr 172.21.15.120:0/2542876332 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.706+0000 7f2fff7fe640 1 -- 172.21.15.120:0/2542876332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff804ffd0 msgr2=0x7f2ff80458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.706+0000 7f2fff7fe640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff804ffd0 0x7f2ff80458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.706+0000 7f2fff7fe640 1 -- 172.21.15.120:0/2542876332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff8006ea0 msgr2=0x7f2ff8043ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.706+0000 7f2fff7fe640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff8006ea0 0x7f2ff8043ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.706+0000 7f2fff7fe640 1 -- 172.21.15.120:0/2542876332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff8044020 con 0x7f2ff80ead00 2024-04-01T00:12:23.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.706+0000 7f2ffe7fc640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff804ffd0 0x7f2ff80458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T00:12:23.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.707+0000 7f2fff7fe640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff8046410 secure :-1 s=READY pgs=3242 cs=0 l=1 rev1=1 crypto rx=0x7f3000050b20 tx=0x7f300006c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.709+0000 7f2fe77fe640 1 -- 172.21.15.120:0/2542876332 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30000733c0 con 0x7f2ff80ead00 2024-04-01T00:12:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.709+0000 7f2fe77fe640 1 -- 172.21.15.120:0/2542876332 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30000735a0 con 0x7f2ff80ead00 2024-04-01T00:12:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.709+0000 7f2fe77fe640 1 -- 172.21.15.120:0/2542876332 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000073a10 con 0x7f2ff80ead00 2024-04-01T00:12:23.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.709+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff80e9c80 con 0x7f2ff80ead00 2024-04-01T00:12:23.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.710+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff8044b10 con 0x7f2ff80ead00 2024-04-01T00:12:23.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.714+0000 7f2fe77fe640 1 -- 172.21.15.120:0/2542876332 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3000093400 con 0x7f2ff80ead00 2024-04-01T00:12:23.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.715+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe0005290 con 0x7f2ff80ead00 2024-04-01T00:12:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.716+0000 7f2fe77fe640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2fec06c9c0 0x7f2fec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.716+0000 7f2fe77fe640 1 -- 172.21.15.120:0/2542876332 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3000106af0 con 0x7f2ff80ead00 2024-04-01T00:12:23.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.717+0000 7f2ffeffd640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2fec06c9c0 0x7f2fec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:23.725 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.724+0000 7f2ffeffd640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2fec06c9c0 0x7f2fec06ee80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0036000 tx=0x7f2ff003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:23.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:23.746+0000 7f2fe77fe640 1 -- 172.21.15.120:0/2542876332 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f300008f030 con 0x7f2ff80ead00 2024-04-01T00:12:24.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.749+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fe0005580 con 0x7f2ff80ead00 2024-04-01T00:12:24.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.754+0000 7f2fe77fe640 1 -- 172.21.15.120:0/2542876332 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7f30000d4f00 con 0x7f2ff80ead00 2024-04-01T00:12:24.761 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:24.761 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":32,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-03-31T16:36:24.828471+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-31T16:36:21.024330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-31T16:36:22.128594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T00:12:24.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2fec06c9c0 msgr2=0x7f2fec06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:24.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2fec06c9c0 0x7f2fec06ee80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0036000 tx=0x7f2ff003d040 comp rx=0 tx=0).stop 2024-04-01T00:12:24.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 msgr2=0x7f2ff8046410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:24.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff8046410 secure :-1 s=READY pgs=3242 cs=0 l=1 rev1=1 crypto rx=0x7f3000050b20 tx=0x7f300006c950 comp rx=0 tx=0).stop 2024-04-01T00:12:24.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 shutdown_connections 2024-04-01T00:12:24.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f2fec06c9c0 0x7f2fec06ee80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:24.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2ff80ead00 0x7f2ff8046410 unknown :-1 s=CLOSED pgs=3242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:24.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff804ffd0 0x7f2ff80458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:24.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 --2- 172.21.15.120:0/2542876332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff8006ea0 0x7f2ff8043ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:24.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 >> 172.21.15.120:0/2542876332 conn(0x7f2ff8009fb0 msgr2=0x7f2ff8049da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:24.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.767+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 shutdown_connections 2024-04-01T00:12:24.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:24.768+0000 7f2ffffff640 1 -- 172.21.15.120:0/2542876332 wait complete. 2024-04-01T00:12:24.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-01T00:12:25.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.215+0000 7f0710de1640 1 Processor -- start 2024-04-01T00:12:25.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.217+0000 7f0710de1640 1 -- start start 2024-04-01T00:12:25.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.226+0000 7f0710de1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f070c163a60 0x7f070c06ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:25.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.226+0000 7f070b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f070c159960 0x7f070c0afa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34636/0 (socket says 172.21.15.120:34636) 2024-04-01T00:12:25.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.227+0000 7f0710de1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f070c06dfa0 con 0x7f070c159960 2024-04-01T00:12:25.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.227+0000 7f070bfff640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f070c06f2a0 0x7f070c06b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:48510/0 (socket says 172.21.15.120:48510) 2024-04-01T00:12:25.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.227+0000 7f070bfff640 1 -- 172.21.15.120:0/3758740244 learned_addr learned my addr 172.21.15.120:0/3758740244 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:25.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.228+0000 7f070affd640 1 --2- 172.21.15.120:0/3758740244 >> v2:172.21.15.120:3300/0 conn(0x7f070c163a60 0x7f070c06ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:25.229 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.228+0000 7f0710de1640 1 -- 172.21.15.120:0/3758740244 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f070c06e280 con 0x7f070c06f2a0 2024-04-01T00:12:25.230 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.228+0000 7f0710de1640 1 -- 172.21.15.120:0/3758740244 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f070c06dd50 con 0x7f070c163a60 2024-04-01T00:12:25.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.229+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637654325 0 0) 0x7f070c06e280 con 0x7f070c06f2a0 2024-04-01T00:12:25.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.229+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06f4003520 con 0x7f070c06f2a0 2024-04-01T00:12:25.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.230+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627955308 0 0) 0x7f070c06dfa0 con 0x7f070c159960 2024-04-01T00:12:25.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.230+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f070c06e280 con 0x7f070c159960 2024-04-01T00:12:25.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3699289655 0 0) 0x7f070c06e280 con 0x7f070c159960 2024-04-01T00:12:25.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 >> v2:172.21.15.120:3300/0 conn(0x7f070c163a60 msgr2=0x7f070c06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:25.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 --2- 172.21.15.120:0/3758740244 >> v2:172.21.15.120:3300/0 conn(0x7f070c163a60 0x7f070c06ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:25.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 >> v1:172.21.15.203:6789/0 conn(0x7f070c06f2a0 legacy=0x7f070c06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:25.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c06e560 con 0x7f070c159960 2024-04-01T00:12:25.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2695836420 0 0) 0x7f0700001670 con 0x7f070c159960 2024-04-01T00:12:25.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 >> v1:172.21.15.120:6789/0 conn(0x7f070c159960 legacy=0x7f070c0afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:25.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06f4003b40 0x7f06f4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:25.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4004800 0x7f06f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f40053c0 0x7f06f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f070c06dd50 con 0x7f06f4004800 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f06f400c260 con 0x7f06f4003b40 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.231+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f06f400c460 con 0x7f06f40053c0 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.232+0000 7f070affd640 1 --2- 172.21.15.120:0/3758740244 >> v2:172.21.15.120:3300/0 conn(0x7f070c163a60 0x7f070c06ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.232+0000 7f070affd640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4004800 0x7f06f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.233+0000 7f070affd640 1 -- 172.21.15.120:0/3758740244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f40053c0 msgr2=0x7f06f400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.233+0000 7f070affd640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f40053c0 0x7f06f400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.233+0000 7f070affd640 1 -- 172.21.15.120:0/3758740244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06f4003b40 msgr2=0x7f06f4003f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.233+0000 7f070affd640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06f4003b40 0x7f06f4003f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.233+0000 7f070affd640 1 -- 172.21.15.120:0/3758740244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c06e560 con 0x7f06f4004800 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.234+0000 7f070bfff640 1 -- 172.21.15.120:0/3758740244 reap_dead start 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.237+0000 7f070affd640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4004800 0x7f06f4004c80 secure :-1 s=READY pgs=3244 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00aa70 tx=0x7f06f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b314951f4d8f8c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:25.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.239+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00a670 con 0x7f06f4004800 2024-04-01T00:12:25.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.239+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc037600 con 0x7f06f4004800 2024-04-01T00:12:25.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.239+0000 7f070a7fc640 1 -- 172.21.15.120:0/3758740244 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0379d0 con 0x7f06f4004800 2024-04-01T00:12:25.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.241+0000 7f0710de1640 1 -- 172.21.15.120:0/3758740244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4004800 msgr2=0x7f06f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:25.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.241+0000 7f0710de1640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4004800 0x7f06f4004c80 secure :-1 s=READY pgs=3244 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00aa70 tx=0x7f06f4005830 comp rx=0 tx=0).stop 2024-04-01T00:12:25.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.242+0000 7f0710de1640 1 -- 172.21.15.120:0/3758740244 shutdown_connections 2024-04-01T00:12:25.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.242+0000 7f0710de1640 1 --2- 172.21.15.120:0/3758740244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f06f4004800 0x7f06f4004c80 unknown :-1 s=CLOSED pgs=3244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:25.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.242+0000 7f0710de1640 1 -- 172.21.15.120:0/3758740244 >> 172.21.15.120:0/3758740244 conn(0x7f070c0d0770 msgr2=0x7f070c0d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:25.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.244+0000 7f0710de1640 1 -- 172.21.15.120:0/3758740244 shutdown_connections 2024-04-01T00:12:25.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.244+0000 7f0710de1640 1 -- 172.21.15.120:0/3758740244 wait complete. 2024-04-01T00:12:25.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.249+0000 7f0710de1640 1 Processor -- start 2024-04-01T00:12:25.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.250+0000 7f0710de1640 1 -- start start 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f0710de1640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4004800 0x7f070c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f0710de1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f070c0cf9d0 0x7f070c1428d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f0710de1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070c142e10 0x7f070c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f0710de1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f070c06f0f0 con 0x7f070c0cf9d0 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f0710de1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f070c06ef70 con 0x7f070c142e10 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f0710de1640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f070c06e8d0 con 0x7f06f4004800 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f070b7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4004800 0x7f070c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f070b7fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4004800 0x7f070c15bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:57870/0 (socket says 172.21.15.120:57870) 2024-04-01T00:12:25.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.254+0000 7f070b7fe640 1 -- 172.21.15.120:0/3052749084 learned_addr learned my addr 172.21.15.120:0/3052749084 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:25.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.255+0000 7f070b7fe640 1 -- 172.21.15.120:0/3052749084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070c142e10 msgr2=0x7f070c0cd180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T00:12:25.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.255+0000 7f070b7fe640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070c142e10 0x7f070c0cd180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:25.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.255+0000 7f070b7fe640 1 -- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f070c0cf9d0 msgr2=0x7f070c1428d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T00:12:25.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.255+0000 7f070b7fe640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f070c0cf9d0 0x7f070c1428d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:25.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.255+0000 7f070b7fe640 1 -- 172.21.15.120:0/3052749084 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c147760 con 0x7f06f4004800 2024-04-01T00:12:25.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.256+0000 7f070b7fe640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4004800 0x7f070c15bfc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f070000c800 tx=0x7f070000ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:25.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.256+0000 7f06f3fff640 1 -- 172.21.15.120:0/3052749084 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700018070 con 0x7f06f4004800 2024-04-01T00:12:25.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.256+0000 7f06f3fff640 1 -- 172.21.15.120:0/3052749084 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07000074e0 con 0x7f06f4004800 2024-04-01T00:12:25.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.256+0000 7f06f3fff640 1 -- 172.21.15.120:0/3052749084 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700004a20 con 0x7f06f4004800 2024-04-01T00:12:25.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.257+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c0cef40 con 0x7f06f4004800 2024-04-01T00:12:25.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.257+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c0cf220 con 0x7f06f4004800 2024-04-01T00:12:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.261+0000 7f06f3fff640 1 -- 172.21.15.120:0/3052749084 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f070001b070 con 0x7f06f4004800 2024-04-01T00:12:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.262+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec005290 con 0x7f06f4004800 2024-04-01T00:12:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.263+0000 7f06f3fff640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f06f806c9c0 0x7f06f806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.263+0000 7f06f3fff640 1 -- 172.21.15.120:0/3052749084 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f070008b200 con 0x7f06f4004800 2024-04-01T00:12:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.265+0000 7f070affd640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f06f806c9c0 0x7f06f806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.266+0000 7f070affd640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f06f806c9c0 0x7f06f806ee80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f06fc036000 tx=0x7f06fc031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:25.273+0000 7f06f3fff640 1 -- 172.21.15.120:0/3052749084 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f07000596a0 con 0x7f06f4004800 2024-04-01T00:12:26.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.507+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f06ec005580 con 0x7f06f4004800 2024-04-01T00:12:26.700 INFO:tasks.ceph.mon.a.smithi120.stderr:2024-04-01T00:12:26.699+0000 7fee2d7ce640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-01T00:12:26.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.703+0000 7f06f3fff640 1 -- 172.21.15.120:0/3052749084 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7f070005d350 con 0x7f06f4004800 2024-04-01T00:12:26.708 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-01T00:12:26.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.712+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f06f806c9c0 msgr2=0x7f06f806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:26.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.712+0000 7f0710de1640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f06f806c9c0 0x7f06f806ee80 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f06fc036000 tx=0x7f06fc031000 comp rx=0 tx=0).stop 2024-04-01T00:12:26.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.712+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4004800 msgr2=0x7f070c15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:26.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.712+0000 7f0710de1640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4004800 0x7f070c15bfc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f070000c800 tx=0x7f070000ccc0 comp rx=0 tx=0).stop 2024-04-01T00:12:26.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.713+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 shutdown_connections 2024-04-01T00:12:26.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.713+0000 7f0710de1640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f06f806c9c0 0x7f06f806ee80 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:26.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.713+0000 7f0710de1640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070c142e10 0x7f070c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:26.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.713+0000 7f0710de1640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f070c0cf9d0 0x7f070c1428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:26.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.713+0000 7f0710de1640 1 --2- 172.21.15.120:0/3052749084 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4004800 0x7f070c15bfc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:26.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.713+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 >> 172.21.15.120:0/3052749084 conn(0x7f070c0d0770 msgr2=0x7f070c1648d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:26.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.714+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 shutdown_connections 2024-04-01T00:12:26.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:26.717+0000 7f0710de1640 1 -- 172.21.15.120:0/3052749084 wait complete. 2024-04-01T00:12:26.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-01T00:12:26.972 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2024-04-01T00:12:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.059+0000 7f56ef59e640 1 Processor -- start 2024-04-01T00:12:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.060+0000 7f56ef59e640 1 -- start start 2024-04-01T00:12:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56ef59e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0144a80 0x7f56f0072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56ef59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f56f00cf3e0 0x7f56f006f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56ef59e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f00d0be0 con 0x7f56f0073440 2024-04-01T00:12:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56ef59e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f56f00738c0 con 0x7f56f00cf3e0 2024-04-01T00:12:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56ef59e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f56f00d1a50 con 0x7f56f0144a80 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56ee59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0144a80 0x7f56f0072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56edd9b640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f56f0073440 0x7f56f00cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:48526/0 (socket says 172.21.15.120:48526) 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56edd9b640 1 -- 172.21.15.120:0/788418924 learned_addr learned my addr 172.21.15.120:0/788418924 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.062+0000 7f56eed9d640 1 --2- 172.21.15.120:0/788418924 >> v2:172.21.15.120:3300/0 conn(0x7f56f00cf3e0 0x7f56f006f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.063+0000 7f56ed59a640 1 -- 172.21.15.120:0/788418924 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361490677 0 0) 0x7f56f00d0be0 con 0x7f56f0073440 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.063+0000 7f56ed59a640 1 -- 172.21.15.120:0/788418924 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d8003520 con 0x7f56f0073440 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.063+0000 7f56ee59c640 1 -- 172.21.15.120:0/788418924 >> v2:172.21.15.120:3300/0 conn(0x7f56f00cf3e0 msgr2=0x7f56f006f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.063+0000 7f56ee59c640 1 --2- 172.21.15.120:0/788418924 >> v2:172.21.15.120:3300/0 conn(0x7f56f00cf3e0 0x7f56f006f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.063+0000 7f56ee59c640 1 -- 172.21.15.120:0/788418924 >> v1:172.21.15.203:6789/0 conn(0x7f56f0073440 legacy=0x7f56f00cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.063+0000 7f56ee59c640 1 -- 172.21.15.120:0/788418924 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f00d0e80 con 0x7f56f0144a80 2024-04-01T00:12:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.063+0000 7f56eed9d640 1 --2- 172.21.15.120:0/788418924 >> v2:172.21.15.120:3300/0 conn(0x7f56f00cf3e0 0x7f56f006f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.065+0000 7f56ee59c640 1 --2- 172.21.15.120:0/788418924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0144a80 0x7f56f0072f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56e40097a0 tx=0x7f56e402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99e3671dd9829211 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.065+0000 7f56ed59a640 1 -- 172.21.15.120:0/788418924 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4035020 con 0x7f56f0144a80 2024-04-01T00:12:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.065+0000 7f56ed59a640 1 -- 172.21.15.120:0/788418924 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4031810 con 0x7f56f0144a80 2024-04-01T00:12:27.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.065+0000 7f56ed59a640 1 -- 172.21.15.120:0/788418924 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4031be0 con 0x7f56f0144a80 2024-04-01T00:12:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.066+0000 7f56ef59e640 1 -- 172.21.15.120:0/788418924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0144a80 msgr2=0x7f56f0072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.066+0000 7f56ef59e640 1 --2- 172.21.15.120:0/788418924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0144a80 0x7f56f0072f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56e40097a0 tx=0x7f56e402b8b0 comp rx=0 tx=0).stop 2024-04-01T00:12:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.067+0000 7f56ef59e640 1 -- 172.21.15.120:0/788418924 shutdown_connections 2024-04-01T00:12:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.067+0000 7f56ef59e640 1 --2- 172.21.15.120:0/788418924 >> v2:172.21.15.120:3300/0 conn(0x7f56f00cf3e0 0x7f56f006f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.067+0000 7f56ef59e640 1 --2- 172.21.15.120:0/788418924 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0144a80 0x7f56f0072f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:27.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.067+0000 7f56ef59e640 1 -- 172.21.15.120:0/788418924 >> 172.21.15.120:0/788418924 conn(0x7f56f006e730 msgr2=0x7f56f006eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.067+0000 7f56ef59e640 1 -- 172.21.15.120:0/788418924 shutdown_connections 2024-04-01T00:12:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.067+0000 7f56ef59e640 1 -- 172.21.15.120:0/788418924 wait complete. 2024-04-01T00:12:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.070+0000 7f56ef59e640 1 Processor -- start 2024-04-01T00:12:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.070+0000 7f56ef59e640 1 -- start start 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.072+0000 7f56ef59e640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0073440 0x7f56f014c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.072+0000 7f56ef59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f00cf3e0 0x7f56f014f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.072+0000 7f56ef59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56f0144a80 0x7f56f013f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.072+0000 7f56ef59e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f56f00d16e0 con 0x7f56f00cf3e0 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.072+0000 7f56ef59e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56f00d1400 con 0x7f56f0144a80 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.072+0000 7f56ef59e640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f56f006fed0 con 0x7f56f0073440 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56edd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f00cf3e0 0x7f56f014f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56ee59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0073440 0x7f56f014c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56ee59c640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0073440 0x7f56f014c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:57918/0 (socket says 172.21.15.120:57918) 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56ee59c640 1 -- 172.21.15.120:0/1106398405 learned_addr learned my addr 172.21.15.120:0/1106398405 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56eed9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56f0144a80 0x7f56f013f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56ee59c640 1 -- 172.21.15.120:0/1106398405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56f0144a80 msgr2=0x7f56f013f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56ee59c640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56f0144a80 0x7f56f013f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56ee59c640 1 -- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f00cf3e0 msgr2=0x7f56f014f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56ee59c640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f00cf3e0 0x7f56f014f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56ee59c640 1 -- 172.21.15.120:0/1106398405 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f014ccb0 con 0x7f56f0073440 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.073+0000 7f56edd9b640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f00cf3e0 0x7f56f014f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.074+0000 7f56ee59c640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0073440 0x7f56f014c770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56e40098c0 tx=0x7f56e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.074+0000 7f56deffd640 1 -- 172.21.15.120:0/1106398405 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4035040 con 0x7f56f0073440 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.074+0000 7f56deffd640 1 -- 172.21.15.120:0/1106398405 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4039cf0 con 0x7f56f0073440 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.074+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f013d810 con 0x7f56f0073440 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.074+0000 7f56deffd640 1 -- 172.21.15.120:0/1106398405 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4006e10 con 0x7f56f0073440 2024-04-01T00:12:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.074+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f013be20 con 0x7f56f0073440 2024-04-01T00:12:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.077+0000 7f56deffd640 1 -- 172.21.15.120:0/1106398405 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56e4038020 con 0x7f56f0073440 2024-04-01T00:12:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.077+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f0075940 con 0x7f56f0073440 2024-04-01T00:12:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.077+0000 7f56deffd640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f56d006c8f0 0x7f56d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.078+0000 7f56deffd640 1 -- 172.21.15.120:0/1106398405 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f56e40adb70 con 0x7f56f0073440 2024-04-01T00:12:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.078+0000 7f56edd9b640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f56d006c8f0 0x7f56d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.078+0000 7f56edd9b640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f56d006c8f0 0x7f56d006edb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f56f01f5420 tx=0x7f56e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:27.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.083+0000 7f56deffd640 1 -- 172.21.15.120:0/1106398405 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f56f013d810 con 0x7f56f0073440 2024-04-01T00:12:27.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:27.773+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f56f0072ab0 con 0x7f56f0073440 2024-04-01T00:12:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.707+0000 7f56deffd640 1 -- 172.21.15.120:0/1106398405 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f56e407bf40 con 0x7f56f0073440 2024-04-01T00:12:28.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f56d006c8f0 msgr2=0x7f56d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f56d006c8f0 0x7f56d006edb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f56f01f5420 tx=0x7f56e0009040 comp rx=0 tx=0).stop 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0073440 msgr2=0x7f56f014c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0073440 0x7f56f014c770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56e40098c0 tx=0x7f56e40046c0 comp rx=0 tx=0).stop 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 shutdown_connections 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f56d006c8f0 0x7f56d006edb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56f0144a80 0x7f56f013f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f00cf3e0 0x7f56f014f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 --2- 172.21.15.120:0/1106398405 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f56f0073440 0x7f56f014c770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 >> 172.21.15.120:0/1106398405 conn(0x7f56f006e730 msgr2=0x7f56f006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 shutdown_connections 2024-04-01T00:12:28.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:28.713+0000 7f56ef59e640 1 -- 172.21.15.120:0/1106398405 wait complete. 2024-04-01T00:12:28.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-01T00:12:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.028+0000 7fab2c66a640 1 Processor -- start 2024-04-01T00:12:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.029+0000 7fab2c66a640 1 -- start start 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab2c66a640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fab2415b480 0x7fab240cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab2c66a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab240cd8b0 0x7fab240cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab2c66a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2415b860 con 0x7fab240b35e0 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab2c66a640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fab240ccfe0 con 0x7fab2415b480 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab2c66a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fab240cede0 con 0x7fab240cd8b0 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab29c05640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fab240b35e0 0x7fab240cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:34642/0 (socket says 172.21.15.120:34642) 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab29c05640 1 -- 172.21.15.120:0/632004515 learned_addr learned my addr 172.21.15.120:0/632004515 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab2a406640 1 --2- 172.21.15.120:0/632004515 >> v2:172.21.15.203:3300/0 conn(0x7fab2415b480 0x7fab240cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.031+0000 7fab2ac07640 1 --2- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab240cd8b0 0x7fab240cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.032+0000 7fab29404640 1 -- 172.21.15.120:0/632004515 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180216265 0 0) 0x7fab2415b860 con 0x7fab240b35e0 2024-04-01T00:12:29.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.032+0000 7fab29404640 1 -- 172.21.15.120:0/632004515 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab10003520 con 0x7fab240b35e0 2024-04-01T00:12:29.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.032+0000 7fab2a406640 1 -- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab240cd8b0 msgr2=0x7fab240cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:29.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.032+0000 7fab2a406640 1 --2- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab240cd8b0 0x7fab240cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.032+0000 7fab2a406640 1 -- 172.21.15.120:0/632004515 >> v1:172.21.15.120:6789/0 conn(0x7fab240b35e0 legacy=0x7fab240cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.032+0000 7fab2a406640 1 -- 172.21.15.120:0/632004515 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab240cf0c0 con 0x7fab2415b480 2024-04-01T00:12:29.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.032+0000 7fab2ac07640 1 --2- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab240cd8b0 0x7fab240cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:29.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.034+0000 7fab2a406640 1 --2- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab2415b480 0x7fab240cfba0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fab200097a0 tx=0x7fab2002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=637f7d18ffdfa288 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:29.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.034+0000 7fab29404640 1 -- 172.21.15.120:0/632004515 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20035020 con 0x7fab2415b480 2024-04-01T00:12:29.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.034+0000 7fab29404640 1 -- 172.21.15.120:0/632004515 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab20031810 con 0x7fab2415b480 2024-04-01T00:12:29.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.034+0000 7fab29404640 1 -- 172.21.15.120:0/632004515 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20031bc0 con 0x7fab2415b480 2024-04-01T00:12:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.036+0000 7fab2c66a640 1 -- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab2415b480 msgr2=0x7fab240cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.036+0000 7fab2c66a640 1 --2- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab2415b480 0x7fab240cfba0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fab200097a0 tx=0x7fab2002b8b0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.036+0000 7fab2c66a640 1 -- 172.21.15.120:0/632004515 shutdown_connections 2024-04-01T00:12:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.036+0000 7fab2c66a640 1 --2- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab240cd8b0 0x7fab240cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.036+0000 7fab2c66a640 1 --2- 172.21.15.120:0/632004515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab2415b480 0x7fab240cfba0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.036+0000 7fab2c66a640 1 -- 172.21.15.120:0/632004515 >> 172.21.15.120:0/632004515 conn(0x7fab2409aa20 msgr2=0x7fab240b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.036+0000 7fab2c66a640 1 -- 172.21.15.120:0/632004515 shutdown_connections 2024-04-01T00:12:29.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.036+0000 7fab2c66a640 1 -- 172.21.15.120:0/632004515 wait complete. 2024-04-01T00:12:29.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.039+0000 7fab2c66a640 1 Processor -- start 2024-04-01T00:12:29.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.039+0000 7fab2c66a640 1 -- start start 2024-04-01T00:12:29.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.041+0000 7fab2c66a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab240b35e0 0x7fab2414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.041+0000 7fab2c66a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab240cd8b0 0x7fab240c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.041+0000 7fab2c66a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab2415b480 0x7fab240c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.041+0000 7fab2c66a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fab240d00e0 con 0x7fab240b35e0 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.041+0000 7fab2c66a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab240cf680 con 0x7fab240cd8b0 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.041+0000 7fab2c66a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fab2406e770 con 0x7fab2415b480 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab2a406640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab240b35e0 0x7fab2414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab240cd8b0 0x7fab240c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab240cd8b0 0x7fab240c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:37628/0 (socket says 172.21.15.120:37628) 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 -- 172.21.15.120:0/1399426576 learned_addr learned my addr 172.21.15.120:0/1399426576 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab2ac07640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab2415b480 0x7fab240c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 -- 172.21.15.120:0/1399426576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab2415b480 msgr2=0x7fab240c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab2415b480 0x7fab240c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 -- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab240b35e0 msgr2=0x7fab2414dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab240b35e0 0x7fab2414dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 -- 172.21.15.120:0/1399426576 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab240b5750 con 0x7fab240cd8b0 2024-04-01T00:12:29.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.042+0000 7fab29c05640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab240cd8b0 0x7fab240c7300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab1400c430 tx=0x7fab1400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:29.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.043+0000 7fab1affd640 1 -- 172.21.15.120:0/1399426576 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14017070 con 0x7fab240cd8b0 2024-04-01T00:12:29.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.043+0000 7fab1affd640 1 -- 172.21.15.120:0/1399426576 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab14005ce0 con 0x7fab240cd8b0 2024-04-01T00:12:29.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.043+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2414e600 con 0x7fab240cd8b0 2024-04-01T00:12:29.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.043+0000 7fab1affd640 1 -- 172.21.15.120:0/1399426576 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab140072f0 con 0x7fab240cd8b0 2024-04-01T00:12:29.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.043+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2414ebc0 con 0x7fab240cd8b0 2024-04-01T00:12:29.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.046+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab24068cd0 con 0x7fab240cd8b0 2024-04-01T00:12:29.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.046+0000 7fab1affd640 1 -- 172.21.15.120:0/1399426576 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab1401a070 con 0x7fab240cd8b0 2024-04-01T00:12:29.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.047+0000 7fab1affd640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab0806c8f0 0x7fab0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.048+0000 7fab2a406640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab0806c8f0 0x7fab0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.048+0000 7fab1affd640 1 -- 172.21.15.120:0/1399426576 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fab1408af20 con 0x7fab240cd8b0 2024-04-01T00:12:29.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.049+0000 7fab2a406640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab0806c8f0 0x7fab0806edb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fab20036000 tx=0x7fab2003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:29.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.052+0000 7fab1affd640 1 -- 172.21.15.120:0/1399426576 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fab14058ca0 con 0x7fab240cd8b0 2024-04-01T00:12:29.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.588+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fab240ce770 con 0x7fab240cd8b0 2024-04-01T00:12:29.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.722+0000 7fab1affd640 1 -- 172.21.15.120:0/1399426576 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) ==== 181+0+0 (secure 0 0 0) 0x7fab1405cfa0 con 0x7fab240cd8b0 2024-04-01T00:12:29.724 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2024-04-01T00:12:29.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab0806c8f0 msgr2=0x7fab0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab0806c8f0 0x7fab0806edb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fab20036000 tx=0x7fab2003d040 comp rx=0 tx=0).stop 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab240cd8b0 msgr2=0x7fab240c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab240cd8b0 0x7fab240c7300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fab1400c430 tx=0x7fab1400c830 comp rx=0 tx=0).stop 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 shutdown_connections 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab0806c8f0 0x7fab0806edb0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fab2415b480 0x7fab240c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab240cd8b0 0x7fab240c7300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 --2- 172.21.15.120:0/1399426576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fab240b35e0 0x7fab2414dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 >> 172.21.15.120:0/1399426576 conn(0x7fab2409aa20 msgr2=0x7fab240b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 shutdown_connections 2024-04-01T00:12:29.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.727+0000 7fab2c66a640 1 -- 172.21.15.120:0/1399426576 wait complete. 2024-04-01T00:12:29.753 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-01T00:12:29.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.953+0000 7f9f2bfe9640 1 Processor -- start 2024-04-01T00:12:29.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.953+0000 7f9f2bfe9640 1 -- start start 2024-04-01T00:12:29.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f2bfe9640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2415b2c0 0x7f9f240ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f2bfe9640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9f240b5d80 0x7f9f240b4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f2bfe9640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f24070830 con 0x7f9f240b0070 2024-04-01T00:12:29.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f2bfe9640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9f24070300 con 0x7f9f240b5d80 2024-04-01T00:12:29.958 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f2bfe9640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9f240678a0 con 0x7f9f2415b2c0 2024-04-01T00:12:29.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f29d85640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2415b2c0 0x7f9f240ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f29584640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f9f240b0070 0x7f9f240b5670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:48542/0 (socket says 172.21.15.120:48542) 2024-04-01T00:12:29.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f2a586640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9f240b5d80 0x7f9f240b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.957+0000 7f9f29584640 1 -- 172.21.15.120:0/2066441798 learned_addr learned my addr 172.21.15.120:0/2066441798 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:29.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.958+0000 7f9f29d85640 1 -- 172.21.15.120:0/2066441798 >> v2:172.21.15.203:3300/0 conn(0x7f9f240b5d80 msgr2=0x7f9f240b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:29.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.958+0000 7f9f29d85640 1 --2- 172.21.15.120:0/2066441798 >> v2:172.21.15.203:3300/0 conn(0x7f9f240b5d80 0x7f9f240b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.958+0000 7f9f29d85640 1 -- 172.21.15.120:0/2066441798 >> v1:172.21.15.203:6789/0 conn(0x7f9f240b0070 legacy=0x7f9f240b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.958+0000 7f9f29d85640 1 -- 172.21.15.120:0/2066441798 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f240b3bf0 con 0x7f9f2415b2c0 2024-04-01T00:12:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.959+0000 7f9f29d85640 1 --2- 172.21.15.120:0/2066441798 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2415b2c0 0x7f9f240ce910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f200097a0 tx=0x7f9f2002da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57e9c269880f8fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.959+0000 7f9f28d83640 1 -- 172.21.15.120:0/2066441798 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20031850 con 0x7f9f2415b2c0 2024-04-01T00:12:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.959+0000 7f9f28d83640 1 -- 172.21.15.120:0/2066441798 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f200319f0 con 0x7f9f2415b2c0 2024-04-01T00:12:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.959+0000 7f9f28d83640 1 -- 172.21.15.120:0/2066441798 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20031dc0 con 0x7f9f2415b2c0 2024-04-01T00:12:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.961+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2066441798 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2415b2c0 msgr2=0x7f9f240ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.961+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2066441798 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2415b2c0 0x7f9f240ce910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f200097a0 tx=0x7f9f2002da30 comp rx=0 tx=0).stop 2024-04-01T00:12:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.961+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2066441798 shutdown_connections 2024-04-01T00:12:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.961+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2066441798 >> v2:172.21.15.203:3300/0 conn(0x7f9f240b5d80 0x7f9f240b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.961+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2066441798 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f2415b2c0 0x7f9f240ce910 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.961+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2066441798 >> 172.21.15.120:0/2066441798 conn(0x7f9f240cd6f0 msgr2=0x7f9f240cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.962+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2066441798 shutdown_connections 2024-04-01T00:12:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.962+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2066441798 wait complete. 2024-04-01T00:12:29.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.965+0000 7f9f2bfe9640 1 Processor -- start 2024-04-01T00:12:29.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.965+0000 7f9f2bfe9640 1 -- start start 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.967+0000 7f9f2bfe9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f240b0070 0x7f9f241e2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.967+0000 7f9f2bfe9640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240b5d80 0x7f9f241e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.967+0000 7f9f2bfe9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2415b2c0 0x7f9f2413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.967+0000 7f9f2bfe9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9f240b4170 con 0x7f9f240b0070 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.967+0000 7f9f2bfe9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f240b3e90 con 0x7f9f2415b2c0 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.967+0000 7f9f2bfe9640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2415b6a0 con 0x7f9f240b5d80 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.967+0000 7f9f29d85640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f240b0070 0x7f9f241e2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.967+0000 7f9f29d85640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f240b0070 0x7f9f241e2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43654/0 (socket says 172.21.15.120:43654) 2024-04-01T00:12:29.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f29d85640 1 -- 172.21.15.120:0/2665014191 learned_addr learned my addr 172.21.15.120:0/2665014191 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f29584640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240b5d80 0x7f9f241e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f2a586640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2415b2c0 0x7f9f2413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f29584640 1 -- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2415b2c0 msgr2=0x7f9f2413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f29584640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2415b2c0 0x7f9f2413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f29584640 1 -- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f240b0070 msgr2=0x7f9f241e2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f29584640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f240b0070 0x7f9f241e2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f29584640 1 -- 172.21.15.120:0/2665014191 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f24159050 con 0x7f9f240b5d80 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.968+0000 7f9f29584640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240b5d80 0x7f9f241e44b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f14000f60 tx=0x7f9f1400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.969+0000 7f9f1a7fc640 1 -- 172.21.15.120:0/2665014191 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14017070 con 0x7f9f240b5d80 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.969+0000 7f9f1a7fc640 1 -- 172.21.15.120:0/2665014191 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f14005ce0 con 0x7f9f240b5d80 2024-04-01T00:12:29.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.969+0000 7f9f1a7fc640 1 -- 172.21.15.120:0/2665014191 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14007310 con 0x7f9f240b5d80 2024-04-01T00:12:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.969+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f241e2890 con 0x7f9f240b5d80 2024-04-01T00:12:29.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.969+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f241e2e50 con 0x7f9f240b5d80 2024-04-01T00:12:29.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.971+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f24067a90 con 0x7f9f240b5d80 2024-04-01T00:12:29.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.972+0000 7f9f1a7fc640 1 -- 172.21.15.120:0/2665014191 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f1401a070 con 0x7f9f240b5d80 2024-04-01T00:12:29.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.973+0000 7f9f1a7fc640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f0806c8f0 0x7f9f0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:29.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.974+0000 7f9f29d85640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f0806c8f0 0x7f9f0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:29.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.974+0000 7f9f1a7fc640 1 -- 172.21.15.120:0/2665014191 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5357+0+0 (secure 0 0 0) 0x7f9f1408ac70 con 0x7f9f240b5d80 2024-04-01T00:12:29.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.975+0000 7f9f29d85640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f0806c8f0 0x7f9f0806edb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009560 tx=0x7f9f20008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:29.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:29.978+0000 7f9f1a7fc640 1 -- 172.21.15.120:0/2665014191 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9f14058bb0 con 0x7f9f240b5d80 2024-04-01T00:12:30.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:30.816+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9f24068cd0 con 0x7f9f240b5d80 2024-04-01T00:12:31.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.729+0000 7f9f1a7fc640 1 -- 172.21.15.120:0/2665014191 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) ==== 169+0+0 (secure 0 0 0) 0x7f9f1405ceb0 con 0x7f9f240b5d80 2024-04-01T00:12:31.736 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2024-04-01T00:12:31.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f0806c8f0 msgr2=0x7f9f0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:31.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f0806c8f0 0x7f9f0806edb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009560 tx=0x7f9f20008030 comp rx=0 tx=0).stop 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240b5d80 msgr2=0x7f9f241e44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240b5d80 0x7f9f241e44b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f14000f60 tx=0x7f9f1400c800 comp rx=0 tx=0).stop 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 shutdown_connections 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9f0806c8f0 0x7f9f0806edb0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2415b2c0 0x7f9f2413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240b5d80 0x7f9f241e44b0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f14000f60 tx=0x7f9f1400c800 comp rx=0 tx=0).stop 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 --2- 172.21.15.120:0/2665014191 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9f240b0070 0x7f9f241e2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 >> 172.21.15.120:0/2665014191 conn(0x7f9f240cd6f0 msgr2=0x7f9f240b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:31.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.737+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 shutdown_connections 2024-04-01T00:12:31.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:31.738+0000 7f9f2bfe9640 1 -- 172.21.15.120:0/2665014191 wait complete. 2024-04-01T00:12:31.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-01T00:12:32.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.206+0000 7f46b7df6640 1 Processor -- start 2024-04-01T00:12:32.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.206+0000 7f46b7df6640 1 -- start start 2024-04-01T00:12:32.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.210+0000 7f46b7df6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f46b0144450 0x7f46b006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:32.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.210+0000 7f46b7df6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b006c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:32.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.210+0000 7f46b7df6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b015e8c0 con 0x7f46b006cac0 2024-04-01T00:12:32.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.210+0000 7f46b7df6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f46b006cf10 con 0x7f46b0144450 2024-04-01T00:12:32.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.210+0000 7f46b7df6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f46b0144830 con 0x7f46b015be20 2024-04-01T00:12:32.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.210+0000 7f46b5391640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:32.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.210+0000 7f46b5391640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b006c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:57976/0 (socket says 172.21.15.120:57976) 2024-04-01T00:12:32.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.210+0000 7f46b5391640 1 -- 172.21.15.120:0/3789804058 learned_addr learned my addr 172.21.15.120:0/3789804058 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:32.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.211+0000 7f46b5391640 1 -- 172.21.15.120:0/3789804058 >> v2:172.21.15.120:3300/0 conn(0x7f46b0144450 msgr2=0x7f46b006ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:32.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.211+0000 7f46b5391640 1 --2- 172.21.15.120:0/3789804058 >> v2:172.21.15.120:3300/0 conn(0x7f46b0144450 0x7f46b006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:32.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.211+0000 7f46b5391640 1 -- 172.21.15.120:0/3789804058 >> v1:172.21.15.203:6789/0 conn(0x7f46b006cac0 legacy=0x7f46b00ce8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T00:12:32.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.211+0000 7f46b5391640 1 -- 172.21.15.120:0/3789804058 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b015eba0 con 0x7f46b015be20 2024-04-01T00:12:32.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.214+0000 7f46b5391640 1 --2- 172.21.15.120:0/3789804058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b006c580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009e50 tx=0x7f46a802e060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fffaa53e41069846 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:32.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.215+0000 7f46b4b90640 1 -- 172.21.15.120:0/3789804058 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a802ec00 con 0x7f46b015be20 2024-04-01T00:12:32.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.215+0000 7f46b4b90640 1 -- 172.21.15.120:0/3789804058 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a802eda0 con 0x7f46b015be20 2024-04-01T00:12:32.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.216+0000 7f46b4b90640 1 -- 172.21.15.120:0/3789804058 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8036610 con 0x7f46b015be20 2024-04-01T00:12:32.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.218+0000 7f46b7df6640 1 -- 172.21.15.120:0/3789804058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 msgr2=0x7f46b006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:32.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.218+0000 7f46b7df6640 1 --2- 172.21.15.120:0/3789804058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b006c580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009e50 tx=0x7f46a802e060 comp rx=0 tx=0).stop 2024-04-01T00:12:32.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.220+0000 7f46b7df6640 1 -- 172.21.15.120:0/3789804058 shutdown_connections 2024-04-01T00:12:32.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.220+0000 7f46b7df6640 1 --2- 172.21.15.120:0/3789804058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b006c580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:32.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.220+0000 7f46b7df6640 1 --2- 172.21.15.120:0/3789804058 >> v2:172.21.15.120:3300/0 conn(0x7f46b0144450 0x7f46b006ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:32.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.220+0000 7f46b7df6640 1 -- 172.21.15.120:0/3789804058 >> 172.21.15.120:0/3789804058 conn(0x7f46b0071e20 msgr2=0x7f46b0072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:32.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.224+0000 7f46b7df6640 1 -- 172.21.15.120:0/3789804058 shutdown_connections 2024-04-01T00:12:32.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.224+0000 7f46b7df6640 1 -- 172.21.15.120:0/3789804058 wait complete. 2024-04-01T00:12:32.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.235+0000 7f46b7df6640 1 Processor -- start 2024-04-01T00:12:32.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.236+0000 7f46b7df6640 1 -- start start 2024-04-01T00:12:32.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.240+0000 7f46b7df6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b006cac0 0x7f46b00cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:32.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.240+0000 7f46b7df6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46b0144450 0x7f46b0137410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:32.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.241+0000 7f46b7df6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:32.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.241+0000 7f46b5391640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46b0144450 0x7f46b0137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:32.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.241+0000 7f46b5b92640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b006cac0 0x7f46b00cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:32.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.241+0000 7f46b5391640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46b0144450 0x7f46b0137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:37664/0 (socket says 172.21.15.120:37664) 2024-04-01T00:12:32.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.241+0000 7f46b5b92640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b006cac0 0x7f46b00cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43672/0 (socket says 172.21.15.120:43672) 2024-04-01T00:12:32.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.242+0000 7f46b5391640 1 -- 172.21.15.120:0/598531836 learned_addr learned my addr 172.21.15.120:0/598531836 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:32.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.242+0000 7f46b6393640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:32.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.243+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f46b015f160 con 0x7f46b006cac0 2024-04-01T00:12:32.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.243+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46b015e670 con 0x7f46b0144450 2024-04-01T00:12:32.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.243+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f46b006f160 con 0x7f46b015be20 2024-04-01T00:12:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.244+0000 7f46b5391640 1 -- 172.21.15.120:0/598531836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 msgr2=0x7f46b015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.244+0000 7f46b5391640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b015a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.244+0000 7f46b5391640 1 -- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b006cac0 msgr2=0x7f46b00cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.244+0000 7f46b5391640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b006cac0 0x7f46b00cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.244+0000 7f46b5391640 1 -- 172.21.15.120:0/598531836 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b0137b40 con 0x7f46b0144450 2024-04-01T00:12:32.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.245+0000 7f46b5b92640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b006cac0 0x7f46b00cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-01T00:12:32.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.245+0000 7f46b5391640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46b0144450 0x7f46b0137410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009e50 tx=0x7f46a8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:32.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.245+0000 7f46a67fc640 1 -- 172.21.15.120:0/598531836 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a802ea00 con 0x7f46b0144450 2024-04-01T00:12:32.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.246+0000 7f46a67fc640 1 -- 172.21.15.120:0/598531836 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a802eba0 con 0x7f46b0144450 2024-04-01T00:12:32.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.246+0000 7f46a67fc640 1 -- 172.21.15.120:0/598531836 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8040420 con 0x7f46b0144450 2024-04-01T00:12:32.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.247+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b0137e20 con 0x7f46b0144450 2024-04-01T00:12:32.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.249+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b01383e0 con 0x7f46b0144450 2024-04-01T00:12:32.254 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.253+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b0068cd0 con 0x7f46b0144450 2024-04-01T00:12:32.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.257+0000 7f46a67fc640 1 -- 172.21.15.120:0/598531836 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46a8047030 con 0x7f46b0144450 2024-04-01T00:12:32.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.260+0000 7f46a67fc640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f469406c9f0 0x7f469406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:32.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.261+0000 7f46a67fc640 1 -- 172.21.15.120:0/598531836 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f46a80ad250 con 0x7f46b0144450 2024-04-01T00:12:32.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.262+0000 7f46b5b92640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f469406c9f0 0x7f469406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:32.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.265+0000 7f46b5b92640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f469406c9f0 0x7f469406eeb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f46a0006fd0 tx=0x7f46a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:32.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:32.268+0000 7f46a67fc640 1 -- 172.21.15.120:0/598531836 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f46a807bab0 con 0x7f46b0144450 2024-04-01T00:12:33.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.388+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f46b0073120 con 0x7f46b0144450 2024-04-01T00:12:33.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.403+0000 7f46a67fc640 1 -- 172.21.15.120:0/598531836 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f46a807b3b0 con 0x7f46b0144450 2024-04-01T00:12:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.417+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f469406c9f0 msgr2=0x7f469406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.417+0000 7f46b7df6640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f469406c9f0 0x7f469406eeb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f46a0006fd0 tx=0x7f46a0008040 comp rx=0 tx=0).stop 2024-04-01T00:12:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.417+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46b0144450 msgr2=0x7f46b0137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:33.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.417+0000 7f46b7df6640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46b0144450 0x7f46b0137410 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009e50 tx=0x7f46a8004a40 comp rx=0 tx=0).stop 2024-04-01T00:12:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.417+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 shutdown_connections 2024-04-01T00:12:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.417+0000 7f46b7df6640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f469406c9f0 0x7f469406eeb0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.417+0000 7f46b7df6640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f46b015be20 0x7f46b015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.417+0000 7f46b7df6640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46b0144450 0x7f46b0137410 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.418+0000 7f46b7df6640 1 --2- 172.21.15.120:0/598531836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46b006cac0 0x7f46b00cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:33.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.418+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 >> 172.21.15.120:0/598531836 conn(0x7f46b0071e20 msgr2=0x7f46b006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:33.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.418+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 shutdown_connections 2024-04-01T00:12:33.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.418+0000 7f46b7df6640 1 -- 172.21.15.120:0/598531836 wait complete. 2024-04-01T00:12:33.458 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-04-01T00:12:33.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.723+0000 7efede238640 1 Processor -- start 2024-04-01T00:12:33.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.725+0000 7efede238640 1 -- start start 2024-04-01T00:12:33.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.732+0000 7efede238640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efed8070350 0x7efed8167040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:33.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.732+0000 7efede238640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed80b3ac0 con 0x7efed806ca20 2024-04-01T00:12:33.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.732+0000 7efede238640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed80b3d80 con 0x7efed80cf400 2024-04-01T00:12:33.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.733+0000 7efede238640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7efed80d0280 con 0x7efed8070350 2024-04-01T00:12:33.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.734+0000 7efed6ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efed8070350 0x7efed8167040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:33.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.734+0000 7efed6ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efed8070350 0x7efed8167040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43676/0 (socket says 172.21.15.120:43676) 2024-04-01T00:12:33.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.734+0000 7efed6ffd640 1 -- 172.21.15.120:0/2077939363 learned_addr learned my addr 172.21.15.120:0/2077939363 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:33.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.737+0000 7efed6ffd640 1 -- 172.21.15.120:0/2077939363 >> v1:172.21.15.203:6789/0 conn(0x7efed80cf400 legacy=0x7efed806e6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T00:12:33.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.737+0000 7efed6ffd640 1 -- 172.21.15.120:0/2077939363 >> v1:172.21.15.120:6789/0 conn(0x7efed806ca20 legacy=0x7efed8163a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T00:12:33.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.737+0000 7efed6ffd640 1 -- 172.21.15.120:0/2077939363 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed8163210 con 0x7efed8070350 2024-04-01T00:12:33.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.740+0000 7efed6ffd640 1 --2- 172.21.15.120:0/2077939363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8167040 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7efed0009e50 tx=0x7efed002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf88220126c3bca7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.743+0000 7efed67fc640 1 -- 172.21.15.120:0/2077939363 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed002c960 con 0x7efed8070350 2024-04-01T00:12:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.743+0000 7efed67fc640 1 -- 172.21.15.120:0/2077939363 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed002cb00 con 0x7efed8070350 2024-04-01T00:12:33.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.745+0000 7efede238640 1 -- 172.21.15.120:0/2077939363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 msgr2=0x7efed8167040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:33.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.745+0000 7efede238640 1 --2- 172.21.15.120:0/2077939363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8167040 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7efed0009e50 tx=0x7efed002bdc0 comp rx=0 tx=0).stop 2024-04-01T00:12:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.760+0000 7efede238640 1 -- 172.21.15.120:0/2077939363 shutdown_connections 2024-04-01T00:12:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.760+0000 7efede238640 1 --2- 172.21.15.120:0/2077939363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8167040 unknown :-1 s=CLOSED pgs=3246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:33.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.760+0000 7efede238640 1 -- 172.21.15.120:0/2077939363 >> 172.21.15.120:0/2077939363 conn(0x7efed80ce400 msgr2=0x7efed8071e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:33.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.765+0000 7efede238640 1 -- 172.21.15.120:0/2077939363 shutdown_connections 2024-04-01T00:12:33.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.771+0000 7efede238640 1 -- 172.21.15.120:0/2077939363 wait complete. 2024-04-01T00:12:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.776+0000 7efede238640 1 Processor -- start 2024-04-01T00:12:33.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.781+0000 7efede238640 1 -- start start 2024-04-01T00:12:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.782+0000 7efede238640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efed806ca20 0x7efed8158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.785+0000 7efede238640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8204a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:33.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.785+0000 7efede238640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efed80cf400 0x7efed8201c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.786+0000 7efede238640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efed8163580 con 0x7efed8070350 2024-04-01T00:12:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.786+0000 7efed6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8204a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:33.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.786+0000 7efed6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8204a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43688/0 (socket says 172.21.15.120:43688) 2024-04-01T00:12:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.786+0000 7efed6ffd640 1 -- 172.21.15.120:0/2797919081 learned_addr learned my addr 172.21.15.120:0/2797919081 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.786+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efed80b4060 con 0x7efed80cf400 2024-04-01T00:12:33.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.786+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efed80cf890 con 0x7efed806ca20 2024-04-01T00:12:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.787+0000 7efed7fff640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efed80cf400 0x7efed8201c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.788+0000 7efed6ffd640 1 -- 172.21.15.120:0/2797919081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efed806ca20 msgr2=0x7efed8158930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T00:12:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.788+0000 7efed6ffd640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efed806ca20 0x7efed8158930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.788+0000 7efed6ffd640 1 -- 172.21.15.120:0/2797919081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efed80cf400 msgr2=0x7efed8201c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.788+0000 7efed6ffd640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efed80cf400 0x7efed8201c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.788+0000 7efed6ffd640 1 -- 172.21.15.120:0/2797919081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed8204fb0 con 0x7efed8070350 2024-04-01T00:12:33.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.789+0000 7efed6ffd640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8204a70 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7efed0009e50 tx=0x7efed0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.790+0000 7efebffff640 1 -- 172.21.15.120:0/2797919081 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0043020 con 0x7efed8070350 2024-04-01T00:12:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.791+0000 7efebffff640 1 -- 172.21.15.120:0/2797919081 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed003e660 con 0x7efed8070350 2024-04-01T00:12:33.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.791+0000 7efebffff640 1 -- 172.21.15.120:0/2797919081 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed003ea30 con 0x7efed8070350 2024-04-01T00:12:33.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.794+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed8205280 con 0x7efed8070350 2024-04-01T00:12:33.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.799+0000 7efebffff640 1 -- 172.21.15.120:0/2797919081 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efed0046020 con 0x7efed8070350 2024-04-01T00:12:33.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.801+0000 7efebffff640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efec406c940 0x7efec406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:33.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.802+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed8205840 con 0x7efed8070350 2024-04-01T00:12:33.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.806+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed8068cd0 con 0x7efed8070350 2024-04-01T00:12:33.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.808+0000 7efed77fe640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efec406c940 0x7efec406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:33.809 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.808+0000 7efebffff640 1 -- 172.21.15.120:0/2797919081 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7efed0079fc0 con 0x7efed8070350 2024-04-01T00:12:33.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.810+0000 7efed77fe640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efec406c940 0x7efec406ee00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7efecc009670 tx=0x7efecc006bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:33.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:33.836+0000 7efebffff640 1 -- 172.21.15.120:0/2797919081 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efed007c620 con 0x7efed8070350 2024-04-01T00:12:35.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.351+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7efed80cec90 con 0x7efed8070350 2024-04-01T00:12:35.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.749+0000 7efebffff640 1 -- 172.21.15.120:0/2797919081 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v13795) ==== 144+0+0 (secure 0 0 0) 0x7efed007bf20 con 0x7efed8070350 2024-04-01T00:12:35.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efec406c940 msgr2=0x7efec406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:35.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efec406c940 0x7efec406ee00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7efecc009670 tx=0x7efecc006bd0 comp rx=0 tx=0).stop 2024-04-01T00:12:35.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 msgr2=0x7efed8204a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:35.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8204a70 secure :-1 s=READY pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7efed0009e50 tx=0x7efed0004a40 comp rx=0 tx=0).stop 2024-04-01T00:12:35.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 shutdown_connections 2024-04-01T00:12:35.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7efec406c940 0x7efec406ee00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:35.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efed80cf400 0x7efed8201c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:35.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efed8070350 0x7efed8204a70 secure :-1 s=CLOSED pgs=3247 cs=0 l=1 rev1=1 crypto rx=0x7efed0009e50 tx=0x7efed0004a40 comp rx=0 tx=0).stop 2024-04-01T00:12:35.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 --2- 172.21.15.120:0/2797919081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efed806ca20 0x7efed8158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:35.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.756+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 >> 172.21.15.120:0/2797919081 conn(0x7efed80ce400 msgr2=0x7efed806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:35.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.757+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 shutdown_connections 2024-04-01T00:12:35.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:35.762+0000 7efede238640 1 -- 172.21.15.120:0/2797919081 wait complete. 2024-04-01T00:12:35.889 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-04-01T00:12:35.889 INFO:tasks.cephfs_test_runner: 2024-04-01T00:12:35.889 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner: 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner:Ran 1 test in 27395.476s 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner: 2024-04-01T00:12:35.890 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner: 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2024-04-01T00:12:35.891 INFO:tasks.cephfs_test_runner: 2024-04-01T00:12:35.892 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-01T00:12:36.177 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8c448b2f64474086875934a782e41e51 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d2271579d5e735cfd6d436b8349c004f06527cb0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-04-01T00:12:36.179 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-01T00:12:36.188 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-01T00:12:36.196 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-01T00:12:36.196 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-01T00:12:36.196 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:36.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=563 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-01T00:12:36.257 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-01T00:12:36.257 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:36.312 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=563 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-01T00:12:36.312 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-01T00:12:36.312 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:36.331 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056352,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=387 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-01T00:12:36.332 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-01T00:12:36.332 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T00:12:36.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056352,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=387 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248828k,nr_inodes=812207,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-01T00:12:36.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:36.390 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-04-01T00:12:36.483 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-01T00:12:36.483 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-01T00:12:36.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:36.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-01T00:12:36.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:36.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T00:12:36.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:36.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-04-01T00:12:36.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:36.775 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-04-01T00:12:36.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:36.811 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-04-01T00:12:36.950 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-04-01T00:12:36.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T00:12:36.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:36.953 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-01T00:12:37.045 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-01T00:12:37.045 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-01T00:12:37.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:37.045 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-01T00:12:37.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:37.079 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-01T00:12:37.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:37.151 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-01T00:12:37.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:37.252 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-01T00:12:37.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T00:12:37.267 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-01T00:12:37.411 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-04-01T00:12:37.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T00:12:37.413 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-01T00:12:37.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-01T00:12:37.423 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T00:12:37.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.695+0000 7f62193fa640 1 Processor -- start 2024-04-01T00:12:37.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.695+0000 7f62193fa640 1 -- start start 2024-04-01T00:12:37.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62193fa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f62140d43d0 0x7f62140d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:37.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62193fa640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f62140cf6b0 0x7f62140cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:37.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62193fa640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62140d4d20 con 0x7f621415e860 2024-04-01T00:12:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62193fa640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f62140cf220 con 0x7f62140d43d0 2024-04-01T00:12:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62193fa640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f621406dfa0 con 0x7f62140cf6b0 2024-04-01T00:12:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62127fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f62140d43d0 0x7f62140d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62127fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f62140d43d0 0x7f62140d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40588/0 (socket says 172.21.15.120:40588) 2024-04-01T00:12:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62127fc640 1 -- 172.21.15.120:0/3117455733 learned_addr learned my addr 172.21.15.120:0/3117455733 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.697+0000 7f62137fe640 1 --2- 172.21.15.120:0/3117455733 >> v2:172.21.15.203:3300/0 conn(0x7f62140cf6b0 0x7f62140cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.698+0000 7f62137fe640 1 -- 172.21.15.120:0/3117455733 >> v2:172.21.15.120:3300/0 conn(0x7f62140d43d0 msgr2=0x7f62140d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:37.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.698+0000 7f62137fe640 1 --2- 172.21.15.120:0/3117455733 >> v2:172.21.15.120:3300/0 conn(0x7f62140d43d0 0x7f62140d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:37.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.698+0000 7f62137fe640 1 -- 172.21.15.120:0/3117455733 >> v1:172.21.15.203:6789/0 conn(0x7f621415e860 legacy=0x7f621406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:37.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.698+0000 7f6211ffb640 1 -- 172.21.15.120:0/3117455733 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400833219 0 0) 0x7f6204001110 con 0x7f621415e860 2024-04-01T00:12:37.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.698+0000 7f62137fe640 1 -- 172.21.15.120:0/3117455733 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621406e240 con 0x7f62140cf6b0 2024-04-01T00:12:37.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.700+0000 7f62137fe640 1 --2- 172.21.15.120:0/3117455733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62140cf6b0 0x7f62140cfa90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f621406c8c0 tx=0x7f620c02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a38008464740eb22 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:37.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.700+0000 7f6211ffb640 1 -- 172.21.15.120:0/3117455733 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c039070 con 0x7f62140cf6b0 2024-04-01T00:12:37.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.700+0000 7f6211ffb640 1 -- 172.21.15.120:0/3117455733 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c02cc80 con 0x7f62140cf6b0 2024-04-01T00:12:37.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.700+0000 7f6211ffb640 1 -- 172.21.15.120:0/3117455733 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c034660 con 0x7f62140cf6b0 2024-04-01T00:12:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.701+0000 7f62193fa640 1 -- 172.21.15.120:0/3117455733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62140cf6b0 msgr2=0x7f62140cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:37.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.701+0000 7f62193fa640 1 --2- 172.21.15.120:0/3117455733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62140cf6b0 0x7f62140cfa90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f621406c8c0 tx=0x7f620c02bed0 comp rx=0 tx=0).stop 2024-04-01T00:12:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.702+0000 7f62193fa640 1 -- 172.21.15.120:0/3117455733 shutdown_connections 2024-04-01T00:12:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.702+0000 7f62193fa640 1 --2- 172.21.15.120:0/3117455733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f62140cf6b0 0x7f62140cfa90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.702+0000 7f62193fa640 1 --2- 172.21.15.120:0/3117455733 >> v2:172.21.15.120:3300/0 conn(0x7f62140d43d0 0x7f62140d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.702+0000 7f62193fa640 1 -- 172.21.15.120:0/3117455733 >> 172.21.15.120:0/3117455733 conn(0x7f621409d7d0 msgr2=0x7f621408bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.702+0000 7f62193fa640 1 -- 172.21.15.120:0/3117455733 shutdown_connections 2024-04-01T00:12:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.702+0000 7f62193fa640 1 -- 172.21.15.120:0/3117455733 wait complete. 2024-04-01T00:12:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.705+0000 7f62193fa640 1 Processor -- start 2024-04-01T00:12:37.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.705+0000 7f62193fa640 1 -- start start 2024-04-01T00:12:37.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f62193fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62140cf6b0 0x7f6214152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:37.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f62193fa640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62140d43d0 0x7f62141593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:37.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f62193fa640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621415e860 0x7f62140c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:37.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f62193fa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f621406dc00 con 0x7f62140cf6b0 2024-04-01T00:12:37.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f62193fa640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f62140d2c50 con 0x7f621415e860 2024-04-01T00:12:37.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f62193fa640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f621406dd80 con 0x7f62140d43d0 2024-04-01T00:12:37.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f6212ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62140cf6b0 0x7f6214152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:37.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f6212ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62140cf6b0 0x7f6214152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40594/0 (socket says 172.21.15.120:40594) 2024-04-01T00:12:37.711 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f62127fc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62140d43d0 0x7f62141593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f6212ffd640 1 -- 172.21.15.120:0/1360711065 learned_addr learned my addr 172.21.15.120:0/1360711065 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.707+0000 7f62137fe640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621415e860 0x7f62140c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.708+0000 7f62127fc640 1 -- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621415e860 msgr2=0x7f62140c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.708+0000 7f62127fc640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621415e860 0x7f62140c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.708+0000 7f62127fc640 1 -- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62140cf6b0 msgr2=0x7f6214152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.708+0000 7f62127fc640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62140cf6b0 0x7f6214152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.708+0000 7f62127fc640 1 -- 172.21.15.120:0/1360711065 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62140b71c0 con 0x7f62140d43d0 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.708+0000 7f62137fe640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621415e860 0x7f62140c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:37.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.708+0000 7f62127fc640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62140d43d0 0x7f62141593e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00e850 tx=0x7f61fc00ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:37.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.709+0000 7f620b7fe640 1 -- 172.21.15.120:0/1360711065 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc017070 con 0x7f62140d43d0 2024-04-01T00:12:37.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.709+0000 7f620b7fe640 1 -- 172.21.15.120:0/1360711065 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61fc00c940 con 0x7f62140d43d0 2024-04-01T00:12:37.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.709+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6214153080 con 0x7f62140d43d0 2024-04-01T00:12:37.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.709+0000 7f620b7fe640 1 -- 172.21.15.120:0/1360711065 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc00ccf0 con 0x7f62140d43d0 2024-04-01T00:12:37.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.709+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f62140b7740 con 0x7f62140d43d0 2024-04-01T00:12:37.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.712+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62140685c0 con 0x7f62140d43d0 2024-04-01T00:12:37.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.712+0000 7f620b7fe640 1 -- 172.21.15.120:0/1360711065 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61fc01a070 con 0x7f62140d43d0 2024-04-01T00:12:37.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.713+0000 7f620b7fe640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f61f406c8f0 0x7f61f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:37.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.713+0000 7f620b7fe640 1 -- 172.21.15.120:0/1360711065 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f61fc08b750 con 0x7f62140d43d0 2024-04-01T00:12:37.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.713+0000 7f6212ffd640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f61f406c8f0 0x7f61f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:37.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.714+0000 7f6212ffd640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f61f406c8f0 0x7f61f406edb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6204000f60 tx=0x7f6204009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:37.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:37.717+0000 7f620b7fe640 1 -- 172.21.15.120:0/1360711065 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f61fc059830 con 0x7f62140d43d0 2024-04-01T00:12:38.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.244+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f621406b570 con 0x7f61f406c8f0 2024-04-01T00:12:38.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.275+0000 7f620b7fe640 1 -- 172.21.15.120:0/1360711065 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13733 (secure 0 0 0) 0x7f621406b570 con 0x7f61f406c8f0 2024-04-01T00:12:38.277 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:38.277 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-01T00:12:38.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f61f406c8f0 msgr2=0x7f61f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:38.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f61f406c8f0 0x7f61f406edb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6204000f60 tx=0x7f6204009040 comp rx=0 tx=0).stop 2024-04-01T00:12:38.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62140d43d0 msgr2=0x7f62141593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:38.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62140d43d0 0x7f62141593e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00e850 tx=0x7f61fc00ed10 comp rx=0 tx=0).stop 2024-04-01T00:12:38.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 shutdown_connections 2024-04-01T00:12:38.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f61f406c8f0 0x7f61f406edb0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f621415e860 0x7f62140c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f62140d43d0 0x7f62141593e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 --2- 172.21.15.120:0/1360711065 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f62140cf6b0 0x7f6214152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 >> 172.21.15.120:0/1360711065 conn(0x7f621409d7d0 msgr2=0x7f62140b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:38.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 shutdown_connections 2024-04-01T00:12:38.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.279+0000 7f62193fa640 1 -- 172.21.15.120:0/1360711065 wait complete. 2024-04-01T00:12:38.305 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":13744,"stamp":"2024-04-01T00:12:37.675770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":15007444,"kb_used_data":2456384,"kb_used_omap":34667,"kb_used_meta":12487380,"kb_avail":739967276,"statfs":{"total":773094113280,"available":757726490624,"internally_reserved":0,"allocated":2515337216,"data_stored":2512554350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35499560,"internal_metadata":12787077592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":579,"apply_latency_ms":579,"commit_latency_ns":579000000,"apply_latency_ns":579000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36457133425,"num_objects":-26420,"num_object_clones":0,"num_object_copies":-52840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26420,"num_whiteouts":0,"num_read":-1545802,"num_read_kb":-392064320,"num_write":-3142256,"num_write_kb":-589339890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1802,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002644"},"pg_stats":[{"pgid":"1.0","version":"32'161","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-01T00:12:31.750543+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-04-01T00:12:31.750543+0000","last_peered":"2024-04-01T00:12:31.750543+0000","last_clean":"2024-04-01T00:12:31.750543+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-04-01T00:12:31.750543+0000","last_undegraded":"2024-04-01T00:12:31.750543+0000","last_fullsized":"2024-04-01T00:12:31.750543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580333,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1731164,"kb_used_data":976,"kb_used_omap":2477,"kb_used_meta":1727698,"kb_avail":92640676,"statfs":{"total":96636764160,"available":94864052224,"internally_reserved":0,"allocated":999424,"data_stored":748616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2536788,"internal_metadata":1769163436},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580338,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":2100348,"kb_used_data":479792,"kb_used_omap":3627,"kb_used_meta":1616916,"kb_avail":92271492,"statfs":{"total":96636764160,"available":94486007808,"internally_reserved":0,"allocated":491307008,"data_stored":490865664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3714337,"internal_metadata":1655722719},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580335,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1455956,"kb_used_data":396,"kb_used_omap":3630,"kb_used_meta":1451921,"kb_avail":92915884,"statfs":{"total":96636764160,"available":95145865216,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3717507,"internal_metadata":1486767741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580334,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1811416,"kb_used_data":396,"kb_used_omap":5924,"kb_used_meta":1805083,"kb_avail":92560424,"statfs":{"total":96636764160,"available":94781874176,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6066593,"internal_metadata":1848405599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580262,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2690052,"kb_used_data":989372,"kb_used_omap":8985,"kb_used_meta":1691686,"kb_avail":91681788,"statfs":{"total":96636764160,"available":93882150912,"internally_reserved":0,"allocated":1013116928,"data_stored":1012520467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9201363,"internal_metadata":1732286765},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":132,"apply_latency_ms":132,"commit_latency_ns":132000000,"apply_latency_ns":132000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580295,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1486560,"kb_used_data":55252,"kb_used_omap":1600,"kb_used_meta":1400767,"kb_avail":92885280,"statfs":{"total":96636764160,"available":95114526720,"internally_reserved":0,"allocated":56578048,"data_stored":56313648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1639054,"internal_metadata":1434385778},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":122,"apply_latency_ms":122,"commit_latency_ns":122000000,"apply_latency_ns":122000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580279,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1340628,"kb_used_data":396,"kb_used_omap":6692,"kb_used_meta":1333531,"kb_avail":93031212,"statfs":{"total":96636764160,"available":95263961088,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6852695,"internal_metadata":1365536681},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580318,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2391320,"kb_used_data":929804,"kb_used_omap":1729,"kb_used_meta":1459774,"kb_avail":91980520,"statfs":{"total":96636764160,"available":94188052480,"internally_reserved":0,"allocated":952119296,"data_stored":951631211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1771223,"internal_metadata":1494808873},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T00:12:38.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T00:12:38.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.576+0000 7f085cd22640 1 Processor -- start 2024-04-01T00:12:38.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.576+0000 7f085cd22640 1 -- start start 2024-04-01T00:12:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f085cd22640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f08580b0670 0x7f085815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f085cd22640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f085806bc80 0x7f0858168450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f085cd22640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08580b5b10 con 0x7f0858070120 2024-04-01T00:12:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f085cd22640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f08580b63e0 con 0x7f08580b0670 2024-04-01T00:12:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f085cd22640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f085806c3f0 con 0x7f085806bc80 2024-04-01T00:12:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f0856d9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f085806bc80 0x7f0858168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:38.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f085659c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f08580b0670 0x7f085815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f085659c640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f08580b0670 0x7f085815f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:35472/0 (socket says 172.21.15.120:35472) 2024-04-01T00:12:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f0856d9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f085806bc80 0x7f0858168450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:37522/0 (socket says 172.21.15.120:37522) 2024-04-01T00:12:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f0855d9b640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f0858070120 0x7f085806b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:37306/0 (socket says 172.21.15.120:37306) 2024-04-01T00:12:38.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.579+0000 7f085659c640 1 -- 172.21.15.120:0/3150517336 learned_addr learned my addr 172.21.15.120:0/3150517336 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.580+0000 7f085659c640 1 -- 172.21.15.120:0/3150517336 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f085806bc80 msgr2=0x7f0858168450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.580+0000 7f085659c640 1 --2- 172.21.15.120:0/3150517336 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f085806bc80 0x7f0858168450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.580+0000 7f085659c640 1 -- 172.21.15.120:0/3150517336 >> v1:172.21.15.203:6789/0 conn(0x7f0858070120 legacy=0x7f085806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.580+0000 7f085559a640 1 -- 172.21.15.120:0/3150517336 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1737606868 0 0) 0x7f084c001110 con 0x7f0858070120 2024-04-01T00:12:38.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.580+0000 7f085659c640 1 -- 172.21.15.120:0/3150517336 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085815fdf0 con 0x7f08580b0670 2024-04-01T00:12:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.580+0000 7f0856d9d640 1 --2- 172.21.15.120:0/3150517336 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f085806bc80 0x7f0858168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.582+0000 7f085659c640 1 --2- 172.21.15.120:0/3150517336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 0x7f085815f8b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f08480098a0 tx=0x7f084802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea2e2b62d18fb451 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:38.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.582+0000 7f085559a640 1 -- 172.21.15.120:0/3150517336 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848034070 con 0x7f08580b0670 2024-04-01T00:12:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.582+0000 7f085559a640 1 -- 172.21.15.120:0/3150517336 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0848030840 con 0x7f08580b0670 2024-04-01T00:12:38.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.582+0000 7f085559a640 1 -- 172.21.15.120:0/3150517336 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848030c10 con 0x7f08580b0670 2024-04-01T00:12:38.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.584+0000 7f085cd22640 1 -- 172.21.15.120:0/3150517336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 msgr2=0x7f085815f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:38.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.584+0000 7f085cd22640 1 --2- 172.21.15.120:0/3150517336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 0x7f085815f8b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f08480098a0 tx=0x7f084802b980 comp rx=0 tx=0).stop 2024-04-01T00:12:38.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.584+0000 7f085cd22640 1 -- 172.21.15.120:0/3150517336 shutdown_connections 2024-04-01T00:12:38.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.584+0000 7f085cd22640 1 --2- 172.21.15.120:0/3150517336 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f085806bc80 0x7f0858168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.584+0000 7f085cd22640 1 --2- 172.21.15.120:0/3150517336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 0x7f085815f8b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.584+0000 7f085cd22640 1 -- 172.21.15.120:0/3150517336 >> 172.21.15.120:0/3150517336 conn(0x7f08580b65a0 msgr2=0x7f08580b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:38.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.584+0000 7f085cd22640 1 -- 172.21.15.120:0/3150517336 shutdown_connections 2024-04-01T00:12:38.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.584+0000 7f085cd22640 1 -- 172.21.15.120:0/3150517336 wait complete. 2024-04-01T00:12:38.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.587+0000 7f085cd22640 1 Processor -- start 2024-04-01T00:12:38.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.587+0000 7f085cd22640 1 -- start start 2024-04-01T00:12:38.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.589+0000 7f085cd22640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085806bc80 0x7f08580cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:38.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.589+0000 7f085cd22640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0858070120 0x7f08580b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:38.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.589+0000 7f085cd22640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 0x7f085813f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:38.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.589+0000 7f085cd22640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f08580b6070 con 0x7f085806bc80 2024-04-01T00:12:38.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.589+0000 7f085cd22640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08580b5d90 con 0x7f08580b0670 2024-04-01T00:12:38.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.589+0000 7f085cd22640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f08580b0a50 con 0x7f0858070120 2024-04-01T00:12:38.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f085659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085806bc80 0x7f08580cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f085659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085806bc80 0x7f08580cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40602/0 (socket says 172.21.15.120:40602) 2024-04-01T00:12:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f085659c640 1 -- 172.21.15.120:0/1560998285 learned_addr learned my addr 172.21.15.120:0/1560998285 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f0856d9d640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 0x7f085813f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:38.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f0855d9b640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0858070120 0x7f08580b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f0856d9d640 1 -- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0858070120 msgr2=0x7f08580b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f0856d9d640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0858070120 0x7f08580b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f0856d9d640 1 -- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085806bc80 msgr2=0x7f08580cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.590+0000 7f0856d9d640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085806bc80 0x7f08580cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.591+0000 7f0856d9d640 1 -- 172.21.15.120:0/1560998285 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08581f4a90 con 0x7f08580b0670 2024-04-01T00:12:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.591+0000 7f085659c640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085806bc80 0x7f08580cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:38.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.591+0000 7f0855d9b640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0858070120 0x7f08580b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.591+0000 7f0856d9d640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 0x7f085813f510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f085000efc0 tx=0x7f085000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.591+0000 7f0846ffd640 1 -- 172.21.15.120:0/1560998285 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0850018030 con 0x7f08580b0670 2024-04-01T00:12:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.591+0000 7f0846ffd640 1 -- 172.21.15.120:0/1560998285 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085000cd30 con 0x7f08580b0670 2024-04-01T00:12:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.591+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08581f4d70 con 0x7f08580b0670 2024-04-01T00:12:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.591+0000 7f0846ffd640 1 -- 172.21.15.120:0/1560998285 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0850003bb0 con 0x7f08580b0670 2024-04-01T00:12:38.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.592+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08581f5330 con 0x7f08580b0670 2024-04-01T00:12:38.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.594+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0858068cd0 con 0x7f08580b0670 2024-04-01T00:12:38.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.595+0000 7f0846ffd640 1 -- 172.21.15.120:0/1560998285 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f085001b070 con 0x7f08580b0670 2024-04-01T00:12:38.597 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.595+0000 7f0846ffd640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f083806c8f0 0x7f083806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:38.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.596+0000 7f085659c640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f083806c8f0 0x7f083806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:38.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.596+0000 7f0846ffd640 1 -- 172.21.15.120:0/1560998285 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f085008c0b0 con 0x7f08580b0670 2024-04-01T00:12:38.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.597+0000 7f085659c640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f083806c8f0 0x7f083806edb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f08480097f0 tx=0x7f084803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:38.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:38.600+0000 7f0846ffd640 1 -- 172.21.15.120:0/1560998285 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0850010040 con 0x7f08580b0670 2024-04-01T00:12:39.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.124+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08580ae0c0 con 0x7f083806c8f0 2024-04-01T00:12:39.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.126+0000 7f0846ffd640 1 -- 172.21.15.120:0/1560998285 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13733 (secure 0 0 0) 0x7f08580ae0c0 con 0x7f083806c8f0 2024-04-01T00:12:39.128 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:39.128 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-01T00:12:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f083806c8f0 msgr2=0x7f083806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f083806c8f0 0x7f083806edb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f08480097f0 tx=0x7f084803b040 comp rx=0 tx=0).stop 2024-04-01T00:12:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 msgr2=0x7f085813f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 0x7f085813f510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f085000efc0 tx=0x7f085000c490 comp rx=0 tx=0).stop 2024-04-01T00:12:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 shutdown_connections 2024-04-01T00:12:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f083806c8f0 0x7f083806edb0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08580b0670 0x7f085813f510 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0858070120 0x7f08580b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 --2- 172.21.15.120:0/1560998285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f085806bc80 0x7f08580cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 >> 172.21.15.120:0/1560998285 conn(0x7f08580b65a0 msgr2=0x7f085806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 shutdown_connections 2024-04-01T00:12:39.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.130+0000 7f085cd22640 1 -- 172.21.15.120:0/1560998285 wait complete. 2024-04-01T00:12:39.156 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":13744,"stamp":"2024-04-01T00:12:37.675770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":15007444,"kb_used_data":2456384,"kb_used_omap":34667,"kb_used_meta":12487380,"kb_avail":739967276,"statfs":{"total":773094113280,"available":757726490624,"internally_reserved":0,"allocated":2515337216,"data_stored":2512554350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35499560,"internal_metadata":12787077592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":579,"apply_latency_ms":579,"commit_latency_ns":579000000,"apply_latency_ns":579000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36457133425,"num_objects":-26420,"num_object_clones":0,"num_object_copies":-52840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26420,"num_whiteouts":0,"num_read":-1545802,"num_read_kb":-392064320,"num_write":-3142256,"num_write_kb":-589339890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1802,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002644"},"pg_stats":[{"pgid":"1.0","version":"32'161","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-01T00:12:31.750543+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-04-01T00:12:31.750543+0000","last_peered":"2024-04-01T00:12:31.750543+0000","last_clean":"2024-04-01T00:12:31.750543+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-04-01T00:12:31.750543+0000","last_undegraded":"2024-04-01T00:12:31.750543+0000","last_fullsized":"2024-04-01T00:12:31.750543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580333,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1731164,"kb_used_data":976,"kb_used_omap":2477,"kb_used_meta":1727698,"kb_avail":92640676,"statfs":{"total":96636764160,"available":94864052224,"internally_reserved":0,"allocated":999424,"data_stored":748616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2536788,"internal_metadata":1769163436},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580338,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":2100348,"kb_used_data":479792,"kb_used_omap":3627,"kb_used_meta":1616916,"kb_avail":92271492,"statfs":{"total":96636764160,"available":94486007808,"internally_reserved":0,"allocated":491307008,"data_stored":490865664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3714337,"internal_metadata":1655722719},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580335,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1455956,"kb_used_data":396,"kb_used_omap":3630,"kb_used_meta":1451921,"kb_avail":92915884,"statfs":{"total":96636764160,"available":95145865216,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3717507,"internal_metadata":1486767741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580334,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1811416,"kb_used_data":396,"kb_used_omap":5924,"kb_used_meta":1805083,"kb_avail":92560424,"statfs":{"total":96636764160,"available":94781874176,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6066593,"internal_metadata":1848405599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580262,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2690052,"kb_used_data":989372,"kb_used_omap":8985,"kb_used_meta":1691686,"kb_avail":91681788,"statfs":{"total":96636764160,"available":93882150912,"internally_reserved":0,"allocated":1013116928,"data_stored":1012520467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9201363,"internal_metadata":1732286765},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":132,"apply_latency_ms":132,"commit_latency_ns":132000000,"apply_latency_ns":132000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580295,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1486560,"kb_used_data":55252,"kb_used_omap":1600,"kb_used_meta":1400767,"kb_avail":92885280,"statfs":{"total":96636764160,"available":95114526720,"internally_reserved":0,"allocated":56578048,"data_stored":56313648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1639054,"internal_metadata":1434385778},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":122,"apply_latency_ms":122,"commit_latency_ns":122000000,"apply_latency_ns":122000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580279,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1340628,"kb_used_data":396,"kb_used_omap":6692,"kb_used_meta":1333531,"kb_avail":93031212,"statfs":{"total":96636764160,"available":95263961088,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6852695,"internal_metadata":1365536681},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580318,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2391320,"kb_used_data":929804,"kb_used_omap":1729,"kb_used_meta":1459774,"kb_avail":91980520,"statfs":{"total":96636764160,"available":94188052480,"internally_reserved":0,"allocated":952119296,"data_stored":951631211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1771223,"internal_metadata":1494808873},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T00:12:39.157 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-01T00:12:39.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T00:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.430+0000 7f4bb9c0d640 1 Processor -- start 2024-04-01T00:12:39.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.430+0000 7f4bb9c0d640 1 -- start start 2024-04-01T00:12:39.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb9c0d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4bb40afd80 0x7f4bb415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb9c0d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4bb406cc90 0x7f4bb40ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb9c0d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb40b4710 con 0x7f4bb40ccc40 2024-04-01T00:12:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb9c0d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb40b5740 con 0x7f4bb40afd80 2024-04-01T00:12:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb9c0d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb415da00 con 0x7f4bb406cc90 2024-04-01T00:12:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb37fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4bb40afd80 0x7f4bb415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb3fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4bb406cc90 0x7f4bb40ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:39.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb37fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4bb40afd80 0x7f4bb415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40608/0 (socket says 172.21.15.120:40608) 2024-04-01T00:12:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb3fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4bb406cc90 0x7f4bb40ce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:35494/0 (socket says 172.21.15.120:35494) 2024-04-01T00:12:39.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.432+0000 7f4bb37fe640 1 -- 172.21.15.120:0/617352045 learned_addr learned my addr 172.21.15.120:0/617352045 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.433+0000 7f4bb3fff640 1 -- 172.21.15.120:0/617352045 >> v2:172.21.15.120:3300/0 conn(0x7f4bb40afd80 msgr2=0x7f4bb415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.433+0000 7f4bb3fff640 1 --2- 172.21.15.120:0/617352045 >> v2:172.21.15.120:3300/0 conn(0x7f4bb40afd80 0x7f4bb415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.433+0000 7f4bb3fff640 1 -- 172.21.15.120:0/617352045 >> v1:172.21.15.203:6789/0 conn(0x7f4bb40ccc40 legacy=0x7f4bb406c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.433+0000 7f4bb3fff640 1 -- 172.21.15.120:0/617352045 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb40b4980 con 0x7f4bb406cc90 2024-04-01T00:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.434+0000 7f4bb3fff640 1 --2- 172.21.15.120:0/617352045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb406cc90 0x7f4bb40ce8a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40cd0d0 tx=0x7f4bac02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b145061e1017e1b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.434+0000 7f4bb27fc640 1 -- 172.21.15.120:0/617352045 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac039070 con 0x7f4bb406cc90 2024-04-01T00:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.434+0000 7f4bb27fc640 1 -- 172.21.15.120:0/617352045 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bac02cc80 con 0x7f4bb406cc90 2024-04-01T00:12:39.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.434+0000 7f4bb27fc640 1 -- 172.21.15.120:0/617352045 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac034660 con 0x7f4bb406cc90 2024-04-01T00:12:39.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.436+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/617352045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb406cc90 msgr2=0x7f4bb40ce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:39.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.436+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/617352045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb406cc90 0x7f4bb40ce8a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40cd0d0 tx=0x7f4bac02bed0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.436+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/617352045 shutdown_connections 2024-04-01T00:12:39.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.436+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/617352045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb406cc90 0x7f4bb40ce8a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.436+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/617352045 >> v2:172.21.15.120:3300/0 conn(0x7f4bb40afd80 0x7f4bb415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.436+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/617352045 >> 172.21.15.120:0/617352045 conn(0x7f4bb4071e20 msgr2=0x7f4bb4072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:39.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.436+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/617352045 shutdown_connections 2024-04-01T00:12:39.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.436+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/617352045 wait complete. 2024-04-01T00:12:39.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.439+0000 7f4bb9c0d640 1 Processor -- start 2024-04-01T00:12:39.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.439+0000 7f4bb9c0d640 1 -- start start 2024-04-01T00:12:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.441+0000 7f4bb9c0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bb406cc90 0x7f4bb4158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.441+0000 7f4bb9c0d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb40afd80 0x7f4bb415f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.441+0000 7f4bb9c0d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4bb40ccc40 0x7f4bb414a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:39.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.441+0000 7f4bb9c0d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb40b5220 con 0x7f4bb406cc90 2024-04-01T00:12:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.441+0000 7f4bb9c0d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb40b4f40 con 0x7f4bb40afd80 2024-04-01T00:12:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.441+0000 7f4bb9c0d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb40b0160 con 0x7f4bb40ccc40 2024-04-01T00:12:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bb406cc90 0x7f4bb4158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bb406cc90 0x7f4bb4158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40624/0 (socket says 172.21.15.120:40624) 2024-04-01T00:12:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb3fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4bb40ccc40 0x7f4bb414a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 -- 172.21.15.120:0/1709466810 learned_addr learned my addr 172.21.15.120:0/1709466810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb2ffd640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb40afd80 0x7f4bb415f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:39.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 -- 172.21.15.120:0/1709466810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4bb40ccc40 msgr2=0x7f4bb414a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4bb40ccc40 0x7f4bb414a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 -- 172.21.15.120:0/1709466810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb40afd80 msgr2=0x7f4bb415f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb40afd80 0x7f4bb415f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:39.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 -- 172.21.15.120:0/1709466810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb4158750 con 0x7f4bb406cc90 2024-04-01T00:12:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.442+0000 7f4bb37fe640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bb406cc90 0x7f4bb4158210 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400e8b0 tx=0x7f4ba400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.443+0000 7f4b9bfff640 1 -- 172.21.15.120:0/1709466810 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4017070 con 0x7f4bb406cc90 2024-04-01T00:12:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.443+0000 7f4b9bfff640 1 -- 172.21.15.120:0/1709466810 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba400c940 con 0x7f4bb406cc90 2024-04-01T00:12:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.443+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb415fb50 con 0x7f4bb406cc90 2024-04-01T00:12:39.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.443+0000 7f4b9bfff640 1 -- 172.21.15.120:0/1709466810 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400cd10 con 0x7f4bb406cc90 2024-04-01T00:12:39.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.443+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb4157450 con 0x7f4bb406cc90 2024-04-01T00:12:39.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.445+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb4068cd0 con 0x7f4bb406cc90 2024-04-01T00:12:39.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.446+0000 7f4b9bfff640 1 -- 172.21.15.120:0/1709466810 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ba401a070 con 0x7f4bb406cc90 2024-04-01T00:12:39.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.447+0000 7f4b9bfff640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4ba006c8f0 0x7f4ba006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:39.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.447+0000 7f4b9bfff640 1 -- 172.21.15.120:0/1709466810 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f4ba408b780 con 0x7f4bb406cc90 2024-04-01T00:12:39.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.447+0000 7f4bb2ffd640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4ba006c8f0 0x7f4ba006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:39.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.448+0000 7f4bb2ffd640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4ba006c8f0 0x7f4ba006edb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4bb415f580 tx=0x7f4ba8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:39.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.460+0000 7f4b9bfff640 1 -- 172.21.15.120:0/1709466810 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4ba40597d0 con 0x7f4bb406cc90 2024-04-01T00:12:39.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.992+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4bb4156950 con 0x7f4ba006c8f0 2024-04-01T00:12:39.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.993+0000 7f4b9bfff640 1 -- 172.21.15.120:0/1709466810 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13651 (secure 0 0 0) 0x7f4bb4156950 con 0x7f4ba006c8f0 2024-04-01T00:12:39.995 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:39.995 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-01T00:12:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4ba006c8f0 msgr2=0x7f4ba006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4ba006c8f0 0x7f4ba006edb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4bb415f580 tx=0x7f4ba8009040 comp rx=0 tx=0).stop 2024-04-01T00:12:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bb406cc90 msgr2=0x7f4bb4158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:39.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bb406cc90 0x7f4bb4158210 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400e8b0 tx=0x7f4ba400ed70 comp rx=0 tx=0).stop 2024-04-01T00:12:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 shutdown_connections 2024-04-01T00:12:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f4ba006c8f0 0x7f4ba006edb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4bb40ccc40 0x7f4bb414a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4bb40afd80 0x7f4bb415f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 --2- 172.21.15.120:0/1709466810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4bb406cc90 0x7f4bb4158210 unknown :-1 s=CLOSED pgs=3248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.997+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 >> 172.21.15.120:0/1709466810 conn(0x7f4bb4071e20 msgr2=0x7f4bb40b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.998+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 shutdown_connections 2024-04-01T00:12:40.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:39.998+0000 7f4bb9c0d640 1 -- 172.21.15.120:0/1709466810 wait complete. 2024-04-01T00:12:40.023 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":13745,"stamp":"2024-04-01T00:12:39.676238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":14534704,"kb_used_data":1976988,"kb_used_omap":34667,"kb_used_meta":12494036,"kb_avail":740440016,"statfs":{"total":773094113280,"available":758210576384,"internally_reserved":0,"allocated":2024435712,"data_stored":2021846934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35499560,"internal_metadata":12793893336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":435,"apply_latency_ms":435,"commit_latency_ns":435000000,"apply_latency_ns":435000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36185701480,"num_objects":-24543,"num_object_clones":0,"num_object_copies":-49086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24543,"num_whiteouts":0,"num_read":-1497828,"num_read_kb":-392027973,"num_write":-1465904,"num_write_kb":-579266295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.956405"},"pg_stats":[{"pgid":"1.0","version":"32'161","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-01T00:12:31.750543+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-04-01T00:12:31.750543+0000","last_peered":"2024-04-01T00:12:31.750543+0000","last_clean":"2024-04-01T00:12:31.750543+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-04-01T00:12:31.750543+0000","last_undegraded":"2024-04-01T00:12:31.750543+0000","last_fullsized":"2024-04-01T00:12:31.750543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580334,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1731164,"kb_used_data":976,"kb_used_omap":2477,"kb_used_meta":1727698,"kb_avail":92640676,"statfs":{"total":96636764160,"available":94864052224,"internally_reserved":0,"allocated":999424,"data_stored":748616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2536788,"internal_metadata":1769163436},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1639000,"kb_used_data":396,"kb_used_omap":3627,"kb_used_meta":1634964,"kb_avail":92732840,"statfs":{"total":96636764160,"available":94958428160,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3714337,"internal_metadata":1674203871},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580336,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1455956,"kb_used_data":396,"kb_used_omap":3630,"kb_used_meta":1451921,"kb_avail":92915884,"statfs":{"total":96636764160,"available":95145865216,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3717507,"internal_metadata":1486767741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580335,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1800024,"kb_used_data":396,"kb_used_omap":5924,"kb_used_meta":1793691,"kb_avail":92571816,"statfs":{"total":96636764160,"available":94793539584,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6066593,"internal_metadata":1836740191},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580262,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2690052,"kb_used_data":989372,"kb_used_omap":8985,"kb_used_meta":1691686,"kb_avail":91681788,"statfs":{"total":96636764160,"available":93882150912,"internally_reserved":0,"allocated":1013116928,"data_stored":1012520467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9201363,"internal_metadata":1732286765},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":132,"apply_latency_ms":132,"commit_latency_ns":132000000,"apply_latency_ns":132000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580295,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1486560,"kb_used_data":55252,"kb_used_omap":1600,"kb_used_meta":1400767,"kb_avail":92885280,"statfs":{"total":96636764160,"available":95114526720,"internally_reserved":0,"allocated":56578048,"data_stored":56313648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1639054,"internal_metadata":1434385778},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":122,"apply_latency_ms":122,"commit_latency_ns":122000000,"apply_latency_ns":122000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580279,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1340628,"kb_used_data":396,"kb_used_omap":6692,"kb_used_meta":1333531,"kb_avail":93031212,"statfs":{"total":96636764160,"available":95263961088,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6852695,"internal_metadata":1365536681},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":76,"apply_latency_ms":76,"commit_latency_ns":76000000,"apply_latency_ns":76000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580318,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2391320,"kb_used_data":929804,"kb_used_omap":1729,"kb_used_meta":1459774,"kb_avail":91980520,"statfs":{"total":96636764160,"available":94188052480,"internally_reserved":0,"allocated":952119296,"data_stored":951631211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1771223,"internal_metadata":1494808873},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T00:12:40.024 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T00:12:40.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.296+0000 7fe13f7a8640 1 Processor -- start 2024-04-01T00:12:40.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.296+0000 7fe13f7a8640 1 -- start start 2024-04-01T00:12:40.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.298+0000 7fe13f7a8640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1380c7810 0x7fe1380b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:40.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.298+0000 7fe13f7a8640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:40.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.298+0000 7fe13f7a8640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1380d01a0 con 0x7fe13815e7b0 2024-04-01T00:12:40.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.298+0000 7fe13f7a8640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe1380d1240 con 0x7fe1380c7810 2024-04-01T00:12:40.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.298+0000 7fe13f7a8640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe1380d0480 con 0x7fe1380d1d70 2024-04-01T00:12:40.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe13cd43640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe1380c7810 0x7fe1380b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:40.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe13d544640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fe13815e7b0 0x7fe1380c7100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:37328/0 (socket says 172.21.15.120:37328) 2024-04-01T00:12:40.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe13dd45640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:40.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe13d544640 1 -- 172.21.15.120:0/547394015 learned_addr learned my addr 172.21.15.120:0/547394015 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:40.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe12ffff640 1 -- 172.21.15.120:0/547394015 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605202727 0 0) 0x7fe1380d01a0 con 0x7fe13815e7b0 2024-04-01T00:12:40.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe12ffff640 1 -- 172.21.15.120:0/547394015 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe124003520 con 0x7fe13815e7b0 2024-04-01T00:12:40.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe13dd45640 1 -- 172.21.15.120:0/547394015 >> v2:172.21.15.120:3300/0 conn(0x7fe1380c7810 msgr2=0x7fe1380b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:40.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe13dd45640 1 --2- 172.21.15.120:0/547394015 >> v2:172.21.15.120:3300/0 conn(0x7fe1380c7810 0x7fe1380b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe13dd45640 1 -- 172.21.15.120:0/547394015 >> v1:172.21.15.203:6789/0 conn(0x7fe13815e7b0 legacy=0x7fe1380c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:40.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.299+0000 7fe13dd45640 1 -- 172.21.15.120:0/547394015 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1380d0760 con 0x7fe1380d1d70 2024-04-01T00:12:40.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.302+0000 7fe13dd45640 1 --2- 172.21.15.120:0/547394015 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13806ca30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe130009d90 tx=0x7fe13002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac629ca44adf3c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:40.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.302+0000 7fe12ffff640 1 -- 172.21.15.120:0/547394015 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130039070 con 0x7fe1380d1d70 2024-04-01T00:12:40.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.302+0000 7fe12ffff640 1 -- 172.21.15.120:0/547394015 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13002cc50 con 0x7fe1380d1d70 2024-04-01T00:12:40.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.302+0000 7fe12ffff640 1 -- 172.21.15.120:0/547394015 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130034440 con 0x7fe1380d1d70 2024-04-01T00:12:40.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.303+0000 7fe13f7a8640 1 -- 172.21.15.120:0/547394015 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 msgr2=0x7fe13806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:40.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.303+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/547394015 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13806ca30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe130009d90 tx=0x7fe13002bea0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.304+0000 7fe13f7a8640 1 -- 172.21.15.120:0/547394015 shutdown_connections 2024-04-01T00:12:40.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.304+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/547394015 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13806ca30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.304+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/547394015 >> v2:172.21.15.120:3300/0 conn(0x7fe1380c7810 0x7fe1380b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.304+0000 7fe13f7a8640 1 -- 172.21.15.120:0/547394015 >> 172.21.15.120:0/547394015 conn(0x7fe1380b3e90 msgr2=0x7fe1380b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:40.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.304+0000 7fe13f7a8640 1 -- 172.21.15.120:0/547394015 shutdown_connections 2024-04-01T00:12:40.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.304+0000 7fe13f7a8640 1 -- 172.21.15.120:0/547394015 wait complete. 2024-04-01T00:12:40.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.307+0000 7fe13f7a8640 1 Processor -- start 2024-04-01T00:12:40.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.307+0000 7fe13f7a8640 1 -- start start 2024-04-01T00:12:40.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13f7a8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1380c7810 0x7fe1381f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:40.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13f7a8640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13814ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13f7a8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe13815e7b0 0x7fe1380cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13f7a8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe1380cfe30 con 0x7fe1380c7810 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13f7a8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe1380d0d20 con 0x7fe13815e7b0 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13f7a8640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe13806cf70 con 0x7fe1380d1d70 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13cd43640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13814ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13cd43640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13814ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:37548/0 (socket says 172.21.15.120:37548) 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13cd43640 1 -- 172.21.15.120:0/3351142244 learned_addr learned my addr 172.21.15.120:0/3351142244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13d544640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1380c7810 0x7fe1381f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:40.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.309+0000 7fe13dd45640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe13815e7b0 0x7fe1380cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe13cd43640 1 -- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe13815e7b0 msgr2=0x7fe1380cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe13cd43640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe13815e7b0 0x7fe1380cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe13cd43640 1 -- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1380c7810 msgr2=0x7fe1381f5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe13cd43640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1380c7810 0x7fe1381f5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe13cd43640 1 -- 172.21.15.120:0/3351142244 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1381f5010 con 0x7fe1380d1d70 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe13dd45640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe13815e7b0 0x7fe1380cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe13cd43640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13814ee30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe12800e9e0 tx=0x7fe12800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe12dffb640 1 -- 172.21.15.120:0/3351142244 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe128017070 con 0x7fe1380d1d70 2024-04-01T00:12:40.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe12dffb640 1 -- 172.21.15.120:0/3351142244 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12800c9d0 con 0x7fe1380d1d70 2024-04-01T00:12:40.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe12dffb640 1 -- 172.21.15.120:0/3351142244 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12800cdc0 con 0x7fe1380d1d70 2024-04-01T00:12:40.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.310+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1380cab30 con 0x7fe1380d1d70 2024-04-01T00:12:40.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.311+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1380cb0f0 con 0x7fe1380d1d70 2024-04-01T00:12:40.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.312+0000 7fe12dffb640 1 -- 172.21.15.120:0/3351142244 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe12801a070 con 0x7fe1380d1d70 2024-04-01T00:12:40.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.313+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe138068cd0 con 0x7fe1380d1d70 2024-04-01T00:12:40.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.313+0000 7fe12dffb640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe11c06c8f0 0x7fe11c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:40.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.314+0000 7fe12dffb640 1 -- 172.21.15.120:0/3351142244 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fe12808b9d0 con 0x7fe1380d1d70 2024-04-01T00:12:40.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.314+0000 7fe13d544640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe11c06c8f0 0x7fe11c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:40.316 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.315+0000 7fe13d544640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe11c06c8f0 0x7fe11c06edb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe134007fd0 tx=0x7fe134009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:40.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.318+0000 7fe12dffb640 1 -- 172.21.15.120:0/3351142244 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe12805a060 con 0x7fe1380d1d70 2024-04-01T00:12:40.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.866+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe13815d8f0 con 0x7fe1380d1d70 2024-04-01T00:12:40.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.867+0000 7fe12dffb640 1 -- 172.21.15.120:0/3351142244 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13034 (secure 0 0 0) 0x7fe128059960 con 0x7fe1380d1d70 2024-04-01T00:12:40.868 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:40.869 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":35,"fsid":"8cbda8ce-b993-4141-a43e-650fa7bfe1da","created":"2024-03-31T16:35:07.708326+0000","modified":"2024-04-01T00:12:31.721406+0000","last_up_change":"2024-03-31T16:35:18.845041+0000","last_in_change":"2024-03-31T16:35:09.963957+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-31T16:35:19.872716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6e0b6676-dd47-4cdc-b7af-a00b7c5bd9aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6809","nonce":220044353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6811","nonce":220044353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6815","nonce":220044353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":220044353},{"type":"v1","addr":"172.21.15.120:6813","nonce":220044353}]},"public_addr":"172.21.15.120:6809/220044353","cluster_addr":"172.21.15.120:6811/220044353","heartbeat_back_addr":"172.21.15.120:6815/220044353","heartbeat_front_addr":"172.21.15.120:6813/220044353","state":["exists","up"]},{"osd":1,"uuid":"19d8fd82-e322-48f0-bf0a-30e178c1bc70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6801","nonce":2143054953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6803","nonce":2143054953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6807","nonce":2143054953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":2143054953},{"type":"v1","addr":"172.21.15.120:6805","nonce":2143054953}]},"public_addr":"172.21.15.120:6801/2143054953","cluster_addr":"172.21.15.120:6803/2143054953","heartbeat_back_addr":"172.21.15.120:6807/2143054953","heartbeat_front_addr":"172.21.15.120:6805/2143054953","state":["exists","up"]},{"osd":2,"uuid":"a45d7996-2f81-4a76-b1e1-05d72b6c8be6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6822","nonce":261148039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6826","nonce":261148039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6831","nonce":261148039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":261148039},{"type":"v1","addr":"172.21.15.120:6829","nonce":261148039}]},"public_addr":"172.21.15.120:6822/261148039","cluster_addr":"172.21.15.120:6826/261148039","heartbeat_back_addr":"172.21.15.120:6831/261148039","heartbeat_front_addr":"172.21.15.120:6829/261148039","state":["exists","up"]},{"osd":3,"uuid":"c60e3363-59ef-41a9-a258-63463dee5b3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6817","nonce":404626686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6819","nonce":404626686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6825","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6827","nonce":404626686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6821","nonce":404626686},{"type":"v1","addr":"172.21.15.120:6823","nonce":404626686}]},"public_addr":"172.21.15.120:6817/404626686","cluster_addr":"172.21.15.120:6819/404626686","heartbeat_back_addr":"172.21.15.120:6827/404626686","heartbeat_front_addr":"172.21.15.120:6823/404626686","state":["exists","up"]},{"osd":4,"uuid":"63882813-03d3-4d45-a6c9-e7dd0f2cd774","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6801","nonce":1708181719}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6803","nonce":1708181719}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6807","nonce":1708181719}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":1708181719},{"type":"v1","addr":"172.21.15.203:6805","nonce":1708181719}]},"public_addr":"172.21.15.203:6801/1708181719","cluster_addr":"172.21.15.203:6803/1708181719","heartbeat_back_addr":"172.21.15.203:6807/1708181719","heartbeat_front_addr":"172.21.15.203:6805/1708181719","state":["exists","up"]},{"osd":5,"uuid":"4d72f3d1-6df8-4f38-99ea-21d09becfc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6809","nonce":887331617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6811","nonce":887331617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6815","nonce":887331617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":887331617},{"type":"v1","addr":"172.21.15.203:6813","nonce":887331617}]},"public_addr":"172.21.15.203:6809/887331617","cluster_addr":"172.21.15.203:6811/887331617","heartbeat_back_addr":"172.21.15.203:6815/887331617","heartbeat_front_addr":"172.21.15.203:6813/887331617","state":["exists","up"]},{"osd":6,"uuid":"a1f44a4c-b6e6-4d4d-91b1-4f3e7b377724","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6825","nonce":3768882466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6827","nonce":3768882466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6831","nonce":3768882466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":3768882466},{"type":"v1","addr":"172.21.15.203:6829","nonce":3768882466}]},"public_addr":"172.21.15.203:6825/3768882466","cluster_addr":"172.21.15.203:6827/3768882466","heartbeat_back_addr":"172.21.15.203:6831/3768882466","heartbeat_front_addr":"172.21.15.203:6829/3768882466","state":["exists","up"]},{"osd":7,"uuid":"b8d1cc04-bd3a-461f-97a7-c7e868732600","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6817","nonce":2676384654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6819","nonce":2676384654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6823","nonce":2676384654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2676384654},{"type":"v1","addr":"172.21.15.203:6821","nonce":2676384654}]},"public_addr":"172.21.15.203:6817/2676384654","cluster_addr":"172.21.15.203:6819/2676384654","heartbeat_back_addr":"172.21.15.203:6823/2676384654","heartbeat_front_addr":"172.21.15.203:6821/2676384654","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.060245+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.083424+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.114971+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.094076+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.108120+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.086046+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.150917+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-31T16:35:15.187344+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:6837/2154626843":"2024-04-02T00:12:26.544310+0000","172.21.15.120:6835/2154626843":"2024-04-02T00:12:26.544310+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T00:12:40.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe11c06c8f0 msgr2=0x7fe11c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe11c06c8f0 0x7fe11c06edb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe134007fd0 tx=0x7fe134009040 comp rx=0 tx=0).stop 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 msgr2=0x7fe13814ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13814ee30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe12800e9e0 tx=0x7fe12800eea0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 shutdown_connections 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe11c06c8f0 0x7fe11c06edb0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe13815e7b0 0x7fe1380cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe1380d1d70 0x7fe13814ee30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 --2- 172.21.15.120:0/3351142244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe1380c7810 0x7fe1381f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:40.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 >> 172.21.15.120:0/3351142244 conn(0x7fe1380b3e90 msgr2=0x7fe138159b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:40.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 shutdown_connections 2024-04-01T00:12:40.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:40.871+0000 7fe13f7a8640 1 -- 172.21.15.120:0/3351142244 wait complete. 2024-04-01T00:12:41.898 INFO:tasks.ceph:Scrubbing osd.0 2024-04-01T00:12:41.898 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-01T00:12:42.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.182+0000 7f0b19822640 1 Processor -- start 2024-04-01T00:12:42.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.182+0000 7f0b19822640 1 -- start start 2024-04-01T00:12:42.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.184+0000 7f0b19822640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b140d2cd0 0x7f0b140b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b19822640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b140d18f0 con 0x7f0b1415e9d0 2024-04-01T00:12:42.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b19822640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b140d1bd0 con 0x7f0b140d1460 2024-04-01T00:12:42.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b19822640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f0b1406c630 con 0x7f0b140d2cd0 2024-04-01T00:12:42.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b137fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0b140d2cd0 0x7f0b140b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b12ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0b1415e9d0 0x7f0b140d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36970/0 (socket says 172.21.15.120:36970) 2024-04-01T00:12:42.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b12ffd640 1 -- 172.21.15.120:0/4168339752 learned_addr learned my addr 172.21.15.120:0/4168339752 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:42.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b137fe640 1 -- 172.21.15.120:0/4168339752 >> v1:172.21.15.203:6789/0 conn(0x7f0b140d1460 legacy=0x7f0b1406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b137fe640 1 -- 172.21.15.120:0/4168339752 >> v1:172.21.15.120:6789/0 conn(0x7f0b1415e9d0 legacy=0x7f0b140d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.185+0000 7f0b137fe640 1 -- 172.21.15.120:0/4168339752 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1406c880 con 0x7f0b140d2cd0 2024-04-01T00:12:42.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.187+0000 7f0b137fe640 1 --2- 172.21.15.120:0/4168339752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b140d2cd0 0x7f0b140b38c0 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009d90 tx=0x7f0b0c02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f439b3881f9049f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:42.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.187+0000 7f0b11ffb640 1 -- 172.21.15.120:0/4168339752 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c039070 con 0x7f0b140d2cd0 2024-04-01T00:12:42.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.187+0000 7f0b11ffb640 1 -- 172.21.15.120:0/4168339752 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c02ccf0 con 0x7f0b140d2cd0 2024-04-01T00:12:42.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.187+0000 7f0b11ffb640 1 -- 172.21.15.120:0/4168339752 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c034660 con 0x7f0b140d2cd0 2024-04-01T00:12:42.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.188+0000 7f0b19822640 1 -- 172.21.15.120:0/4168339752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b140d2cd0 msgr2=0x7f0b140b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.188+0000 7f0b19822640 1 --2- 172.21.15.120:0/4168339752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b140d2cd0 0x7f0b140b38c0 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009d90 tx=0x7f0b0c02bf40 comp rx=0 tx=0).stop 2024-04-01T00:12:42.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.188+0000 7f0b19822640 1 -- 172.21.15.120:0/4168339752 shutdown_connections 2024-04-01T00:12:42.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.188+0000 7f0b19822640 1 --2- 172.21.15.120:0/4168339752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b140d2cd0 0x7f0b140b38c0 unknown :-1 s=CLOSED pgs=3250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:42.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.188+0000 7f0b19822640 1 -- 172.21.15.120:0/4168339752 >> 172.21.15.120:0/4168339752 conn(0x7f0b1408bfb0 msgr2=0x7f0b140d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:42.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.188+0000 7f0b19822640 1 -- 172.21.15.120:0/4168339752 shutdown_connections 2024-04-01T00:12:42.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.188+0000 7f0b19822640 1 -- 172.21.15.120:0/4168339752 wait complete. 2024-04-01T00:12:42.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.191+0000 7f0b19822640 1 Processor -- start 2024-04-01T00:12:42.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.192+0000 7f0b19822640 1 -- start start 2024-04-01T00:12:42.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b19822640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b140d2cd0 0x7f0b141f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b19822640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b1415e9d0 0x7f0b1415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b19822640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b140cb4f0 0x7f0b140cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b19822640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140d4f00 con 0x7f0b140d2cd0 2024-04-01T00:12:42.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b19822640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1406cbf0 con 0x7f0b1415e9d0 2024-04-01T00:12:42.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b19822640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0b140d5080 con 0x7f0b140cb4f0 2024-04-01T00:12:42.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b137fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b140cb4f0 0x7f0b140cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b137fe640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b140cb4f0 0x7f0b140cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:37554/0 (socket says 172.21.15.120:37554) 2024-04-01T00:12:42.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b137fe640 1 -- 172.21.15.120:0/3023500123 learned_addr learned my addr 172.21.15.120:0/3023500123 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:42.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b12ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b140d2cd0 0x7f0b141f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b127fc640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b1415e9d0 0x7f0b1415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b137fe640 1 -- 172.21.15.120:0/3023500123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b1415e9d0 msgr2=0x7f0b1415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b137fe640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b1415e9d0 0x7f0b1415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:42.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b137fe640 1 -- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b140d2cd0 msgr2=0x7f0b141f4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b137fe640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b140d2cd0 0x7f0b141f4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:42.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.194+0000 7f0b137fe640 1 -- 172.21.15.120:0/3023500123 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b140cd710 con 0x7f0b140cb4f0 2024-04-01T00:12:42.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.195+0000 7f0b137fe640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b140cb4f0 0x7f0b140cdba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009d90 tx=0x7f0b0c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:42.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.195+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c039050 con 0x7f0b140cb4f0 2024-04-01T00:12:42.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.195+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c045070 con 0x7f0b140cb4f0 2024-04-01T00:12:42.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.195+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b141f5350 con 0x7f0b140cb4f0 2024-04-01T00:12:42.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.195+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c03e830 con 0x7f0b140cb4f0 2024-04-01T00:12:42.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.195+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b140cbc90 con 0x7f0b140cb4f0 2024-04-01T00:12:42.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.197+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b14068cd0 con 0x7f0b140cb4f0 2024-04-01T00:12:42.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.197+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b0c03e9d0 con 0x7f0b140cb4f0 2024-04-01T00:12:42.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.198+0000 7f0afbfff640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0b0006c8f0 0x7f0b0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.198+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f0b0c0ae4b0 con 0x7f0b140cb4f0 2024-04-01T00:12:42.200 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.198+0000 7f0b12ffd640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0b0006c8f0 0x7f0b0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.198+0000 7f0afbfff640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7f0b000727b0 0x7f0b00074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.198+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 --> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b00075280 con 0x7f0b000727b0 2024-04-01T00:12:42.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.198+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0b0c0b5050 con 0x7f0b140cb4f0 2024-04-01T00:12:42.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.199+0000 7f0b127fc640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7f0b000727b0 0x7f0b00074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.199+0000 7f0b12ffd640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0b0006c8f0 0x7f0b0006edb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0b04005880 tx=0x7f0b04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:42.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.200+0000 7f0b127fc640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7f0b000727b0 0x7f0b00074bd0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:42.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.201+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 <== osd.0 v2:172.21.15.120:6808/220044353 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b00075280 con 0x7f0b000727b0 2024-04-01T00:12:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.239+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 --> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0b1406dca0 con 0x7f0b000727b0 2024-04-01T00:12:42.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.240+0000 7f0afbfff640 1 -- 172.21.15.120:0/3023500123 <== osd.0 v2:172.21.15.120:6808/220044353 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0b1406dca0 con 0x7f0b000727b0 2024-04-01T00:12:42.241 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-01T00:12:42.241 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T00:12:42.241 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-01T00:12:42.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.240+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7f0b000727b0 msgr2=0x7f0b00074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.240+0000 7f0b19822640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6808/220044353,v1:172.21.15.120:6809/220044353] conn(0x7f0b000727b0 0x7f0b00074bd0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:42.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.240+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0b0006c8f0 msgr2=0x7f0b0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.240+0000 7f0b19822640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f0b0006c8f0 0x7f0b0006edb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0b04005880 tx=0x7f0b04009040 comp rx=0 tx=0).stop 2024-04-01T00:12:42.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.240+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b140cb4f0 msgr2=0x7f0b140cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.240+0000 7f0b19822640 1 --2- 172.21.15.120:0/3023500123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b140cb4f0 0x7f0b140cdba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009d90 tx=0x7f0b0c004a40 comp rx=0 tx=0).stop 2024-04-01T00:12:42.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.240+0000 7f0b137fe640 1 -- 172.21.15.120:0/3023500123 reap_dead start 2024-04-01T00:12:42.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.241+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 shutdown_connections 2024-04-01T00:12:42.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.241+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 >> 172.21.15.120:0/3023500123 conn(0x7f0b1408bfb0 msgr2=0x7f0b140ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:42.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.241+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 shutdown_connections 2024-04-01T00:12:42.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.241+0000 7f0b19822640 1 -- 172.21.15.120:0/3023500123 wait complete. 2024-04-01T00:12:42.266 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-01T00:12:42.543 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.542+0000 7f3c24752640 1 Processor -- start 2024-04-01T00:12:42.544 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.542+0000 7f3c24752640 1 -- start start 2024-04-01T00:12:42.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.544+0000 7f3c24752640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c15b640 0x7f3c1c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c24752640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1c15ff50 con 0x7f3c1c0b04e0 2024-04-01T00:12:42.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c24752640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1c15f340 con 0x7f3c1c15b260 2024-04-01T00:12:42.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c24752640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c15f620 con 0x7f3c1c15b640 2024-04-01T00:12:42.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c22cef640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3c1c0b04e0 0x7f3c1c0aeb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:36984/0 (socket says 172.21.15.120:36984) 2024-04-01T00:12:42.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c22cef640 1 -- 172.21.15.120:0/2994471140 learned_addr learned my addr 172.21.15.120:0/2994471140 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:42.547 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c21ced640 1 --2- 172.21.15.120:0/2994471140 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c15b640 0x7f3c1c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c214ec640 1 -- 172.21.15.120:0/2994471140 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838561528 0 0) 0x7f3c1c15ff50 con 0x7f3c1c0b04e0 2024-04-01T00:12:42.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c214ec640 1 -- 172.21.15.120:0/2994471140 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c08003520 con 0x7f3c1c0b04e0 2024-04-01T00:12:42.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c214ec640 1 -- 172.21.15.120:0/2994471140 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402941910 0 0) 0x7f3c1c15f340 con 0x7f3c1c15b260 2024-04-01T00:12:42.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.545+0000 7f3c21ced640 1 -- 172.21.15.120:0/2994471140 >> v1:172.21.15.203:6789/0 conn(0x7f3c1c15b260 legacy=0x7f3c1c0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.546+0000 7f3c21ced640 1 -- 172.21.15.120:0/2994471140 >> v1:172.21.15.120:6789/0 conn(0x7f3c1c0b04e0 legacy=0x7f3c1c0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.546+0000 7f3c21ced640 1 -- 172.21.15.120:0/2994471140 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c15f900 con 0x7f3c1c15b640 2024-04-01T00:12:42.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.548+0000 7f3c21ced640 1 --2- 172.21.15.120:0/2994471140 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c15b640 0x7f3c1c0affa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0097d0 tx=0x7f3c0c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555baf54973a4a14 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:42.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.548+0000 7f3c214ec640 1 -- 172.21.15.120:0/2994471140 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c035020 con 0x7f3c1c15b640 2024-04-01T00:12:42.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.548+0000 7f3c214ec640 1 -- 172.21.15.120:0/2994471140 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0c031890 con 0x7f3c1c15b640 2024-04-01T00:12:42.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.548+0000 7f3c214ec640 1 -- 172.21.15.120:0/2994471140 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c031c40 con 0x7f3c1c15b640 2024-04-01T00:12:42.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.549+0000 7f3c24752640 1 -- 172.21.15.120:0/2994471140 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c15b640 msgr2=0x7f3c1c0affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.549+0000 7f3c24752640 1 --2- 172.21.15.120:0/2994471140 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c15b640 0x7f3c1c0affa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0097d0 tx=0x7f3c0c02b930 comp rx=0 tx=0).stop 2024-04-01T00:12:42.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.549+0000 7f3c24752640 1 -- 172.21.15.120:0/2994471140 shutdown_connections 2024-04-01T00:12:42.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.549+0000 7f3c24752640 1 --2- 172.21.15.120:0/2994471140 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c15b640 0x7f3c1c0affa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:42.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.549+0000 7f3c24752640 1 -- 172.21.15.120:0/2994471140 >> 172.21.15.120:0/2994471140 conn(0x7f3c1c0b65a0 msgr2=0x7f3c1c0b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:42.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.549+0000 7f3c24752640 1 -- 172.21.15.120:0/2994471140 shutdown_connections 2024-04-01T00:12:42.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.549+0000 7f3c24752640 1 -- 172.21.15.120:0/2994471140 wait complete. 2024-04-01T00:12:42.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.551+0000 7f3c24752640 1 Processor -- start 2024-04-01T00:12:42.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.551+0000 7f3c24752640 1 -- start start 2024-04-01T00:12:42.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.552+0000 7f3c24752640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c0b04e0 0x7f3c1c0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.552+0000 7f3c24752640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c1c15b260 0x7f3c1c159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.552+0000 7f3c24752640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c1c15b640 0x7f3c1c158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.552+0000 7f3c24752640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c06e770 con 0x7f3c1c15b260 2024-04-01T00:12:42.554 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.552+0000 7f3c24752640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c15f010 con 0x7f3c1c15b640 2024-04-01T00:12:42.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.552+0000 7f3c24752640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c0b47c0 con 0x7f3c1c0b04e0 2024-04-01T00:12:42.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c21ced640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c1c15b260 0x7f3c1c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c21ced640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c1c15b260 0x7f3c1c159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40678/0 (socket says 172.21.15.120:40678) 2024-04-01T00:12:42.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c21ced640 1 -- 172.21.15.120:0/2512485654 learned_addr learned my addr 172.21.15.120:0/2512485654 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:42.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c22cef640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c1c15b640 0x7f3c1c158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c224ee640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c0b04e0 0x7f3c1c0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c21ced640 1 -- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c0b04e0 msgr2=0x7f3c1c0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.556 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c21ced640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c0b04e0 0x7f3c1c0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c21ced640 1 -- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c1c15b640 msgr2=0x7f3c1c158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c21ced640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c1c15b640 0x7f3c1c158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c21ced640 1 -- 172.21.15.120:0/2512485654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c0b32b0 con 0x7f3c1c15b260 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.553+0000 7f3c22cef640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c1c15b640 0x7f3c1c158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.554+0000 7f3c21ced640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c1c15b260 0x7f3c1c159220 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c02b970 tx=0x7f3c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.554+0000 7f3c12ffd640 1 -- 172.21.15.120:0/2512485654 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c040070 con 0x7f3c1c15b260 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.554+0000 7f3c12ffd640 1 -- 172.21.15.120:0/2512485654 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0c030d20 con 0x7f3c1c15b260 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.554+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c0b2a10 con 0x7f3c1c15b260 2024-04-01T00:12:42.557 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.554+0000 7f3c12ffd640 1 -- 172.21.15.120:0/2512485654 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c035040 con 0x7f3c1c15b260 2024-04-01T00:12:42.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.554+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c0b2fd0 con 0x7f3c1c15b260 2024-04-01T00:12:42.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.557+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1c068cd0 con 0x7f3c1c15b260 2024-04-01T00:12:42.559 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.558+0000 7f3c12ffd640 1 -- 172.21.15.120:0/2512485654 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c0c038020 con 0x7f3c1c15b260 2024-04-01T00:12:42.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.559+0000 7f3c12ffd640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c0006c920 0x7f3c0006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:42.560 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.559+0000 7f3c224ee640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c0006c920 0x7f3c0006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:42.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.559+0000 7f3c12ffd640 1 -- 172.21.15.120:0/2512485654 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f3c0c0ad450 con 0x7f3c1c15b260 2024-04-01T00:12:42.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.560+0000 7f3c224ee640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c0006c920 0x7f3c0006ede0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3c18000f60 tx=0x7f3c18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:42.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:42.572+0000 7f3c12ffd640 1 -- 172.21.15.120:0/2512485654 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3c0c02d040 con 0x7f3c1c15b260 2024-04-01T00:12:43.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.113+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f3c1c156520 con 0x7f3c0006c920 2024-04-01T00:12:43.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.114+0000 7f3c12ffd640 1 -- 172.21.15.120:0/2512485654 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3c1c156520 con 0x7f3c0006c920 2024-04-01T00:12:43.117 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 0 to deep-scrub 2024-04-01T00:12:43.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.117+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c0006c920 msgr2=0x7f3c0006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.117+0000 7f3c24752640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c0006c920 0x7f3c0006ede0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3c18000f60 tx=0x7f3c18009040 comp rx=0 tx=0).stop 2024-04-01T00:12:43.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.117+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c1c15b260 msgr2=0x7f3c1c159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.117+0000 7f3c24752640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c1c15b260 0x7f3c1c159220 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c02b970 tx=0x7f3c0c0046c0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.118+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 shutdown_connections 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.118+0000 7f3c24752640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f3c0006c920 0x7f3c0006ede0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.118+0000 7f3c24752640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c1c15b640 0x7f3c1c158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.118+0000 7f3c24752640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3c1c15b260 0x7f3c1c159220 unknown :-1 s=CLOSED pgs=3252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.118+0000 7f3c24752640 1 --2- 172.21.15.120:0/2512485654 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c1c0b04e0 0x7f3c1c0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.118+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 >> 172.21.15.120:0/2512485654 conn(0x7f3c1c0b65a0 msgr2=0x7f3c1c0af240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.118+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 shutdown_connections 2024-04-01T00:12:43.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.118+0000 7f3c24752640 1 -- 172.21.15.120:0/2512485654 wait complete. 2024-04-01T00:12:43.143 INFO:tasks.ceph:Scrubbing osd.1 2024-04-01T00:12:43.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-01T00:12:43.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.428+0000 7f43c53d6640 1 Processor -- start 2024-04-01T00:12:43.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.428+0000 7f43c53d6640 1 -- start start 2024-04-01T00:12:43.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.429+0000 7f43c53d6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f43c00d1460 0x7f43c00b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.429+0000 7f43c53d6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c00d2cd0 0x7f43c006d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.429+0000 7f43c53d6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c00d18f0 con 0x7f43c015e9d0 2024-04-01T00:12:43.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.429+0000 7f43c53d6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f43c006c630 con 0x7f43c00d1460 2024-04-01T00:12:43.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.429+0000 7f43c53d6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43c006cbf0 con 0x7f43c00d2cd0 2024-04-01T00:12:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43b7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f43c00d1460 0x7f43c00b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43b7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f43c00d1460 0x7f43c00b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40694/0 (socket says 172.21.15.120:40694) 2024-04-01T00:12:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43b7fff640 1 -- 172.21.15.120:0/1761335205 learned_addr learned my addr 172.21.15.120:0/1761335205 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43bf7fe640 1 --2- 172.21.15.120:0/1761335205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c00d2cd0 0x7f43c006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43be7fc640 1 -- 172.21.15.120:0/1761335205 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495598768 0 0) 0x7f43c00d18f0 con 0x7f43c015e9d0 2024-04-01T00:12:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43be7fc640 1 -- 172.21.15.120:0/1761335205 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43ac003520 con 0x7f43c015e9d0 2024-04-01T00:12:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43bf7fe640 1 -- 172.21.15.120:0/1761335205 >> v2:172.21.15.120:3300/0 conn(0x7f43c00d1460 msgr2=0x7f43c00b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43bf7fe640 1 --2- 172.21.15.120:0/1761335205 >> v2:172.21.15.120:3300/0 conn(0x7f43c00d1460 0x7f43c00b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43bf7fe640 1 -- 172.21.15.120:0/1761335205 >> v1:172.21.15.203:6789/0 conn(0x7f43c015e9d0 legacy=0x7f43c00d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.430+0000 7f43bf7fe640 1 -- 172.21.15.120:0/1761335205 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c00d1bd0 con 0x7f43c00d2cd0 2024-04-01T00:12:43.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.432+0000 7f43bf7fe640 1 --2- 172.21.15.120:0/1761335205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c00d2cd0 0x7f43c006d080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009d90 tx=0x7f43b802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a91574acdaf5c0e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:43.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.433+0000 7f43be7fc640 1 -- 172.21.15.120:0/1761335205 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8039070 con 0x7f43c00d2cd0 2024-04-01T00:12:43.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.433+0000 7f43be7fc640 1 -- 172.21.15.120:0/1761335205 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b802cc50 con 0x7f43c00d2cd0 2024-04-01T00:12:43.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.433+0000 7f43be7fc640 1 -- 172.21.15.120:0/1761335205 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8034440 con 0x7f43c00d2cd0 2024-04-01T00:12:43.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.434+0000 7f43c53d6640 1 -- 172.21.15.120:0/1761335205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c00d2cd0 msgr2=0x7f43c006d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.434+0000 7f43c53d6640 1 --2- 172.21.15.120:0/1761335205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c00d2cd0 0x7f43c006d080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009d90 tx=0x7f43b802bea0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.434+0000 7f43c53d6640 1 -- 172.21.15.120:0/1761335205 shutdown_connections 2024-04-01T00:12:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.434+0000 7f43c53d6640 1 --2- 172.21.15.120:0/1761335205 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c00d2cd0 0x7f43c006d080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.434+0000 7f43c53d6640 1 --2- 172.21.15.120:0/1761335205 >> v2:172.21.15.120:3300/0 conn(0x7f43c00d1460 0x7f43c00b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.434+0000 7f43c53d6640 1 -- 172.21.15.120:0/1761335205 >> 172.21.15.120:0/1761335205 conn(0x7f43c008bfb0 msgr2=0x7f43c00d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.434+0000 7f43c53d6640 1 -- 172.21.15.120:0/1761335205 shutdown_connections 2024-04-01T00:12:43.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.434+0000 7f43c53d6640 1 -- 172.21.15.120:0/1761335205 wait complete. 2024-04-01T00:12:43.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.437+0000 7f43c53d6640 1 Processor -- start 2024-04-01T00:12:43.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.438+0000 7f43c53d6640 1 -- start start 2024-04-01T00:12:43.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.439+0000 7f43c53d6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43c00d2cd0 0x7f43c01f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.439+0000 7f43c53d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43c015e9d0 0x7f43c0161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.439+0000 7f43c53d6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c015c4d0 0x7f43c00b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43c53d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f43c00d4f00 con 0x7f43c015e9d0 2024-04-01T00:12:43.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43c53d6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43c015edb0 con 0x7f43c00d2cd0 2024-04-01T00:12:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43c53d6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43c00d5080 con 0x7f43c015c4d0 2024-04-01T00:12:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43c00d2cd0 0x7f43c01f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43c00d2cd0 0x7f43c01f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:35520/0 (socket says 172.21.15.120:35520) 2024-04-01T00:12:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 -- 172.21.15.120:0/1623114003 learned_addr learned my addr 172.21.15.120:0/1623114003 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43b7fff640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43c015e9d0 0x7f43c0161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43bf7fe640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c015c4d0 0x7f43c00b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 -- 172.21.15.120:0/1623114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c015c4d0 msgr2=0x7f43c00b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c015c4d0 0x7f43c00b9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 -- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43c015e9d0 msgr2=0x7f43c0161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43c015e9d0 0x7f43c0161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 -- 172.21.15.120:0/1623114003 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c01f5100 con 0x7f43c00d2cd0 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43bf7fe640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43c015c4d0 0x7f43c00b9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.440+0000 7f43beffd640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43c00d2cd0 0x7f43c01f4bc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c430 tx=0x7f43b000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.441+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0017070 con 0x7f43c00d2cd0 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.441+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b00052f0 con 0x7f43c00d2cd0 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.441+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c00b8a50 con 0x7f43c00d2cd0 2024-04-01T00:12:43.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.441+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0003830 con 0x7f43c00d2cd0 2024-04-01T00:12:43.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.441+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c00b9010 con 0x7f43c00d2cd0 2024-04-01T00:12:43.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.442+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43c0068cd0 con 0x7f43c00d2cd0 2024-04-01T00:12:43.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.443+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43b001a070 con 0x7f43c00d2cd0 2024-04-01T00:12:43.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.444+0000 7f43b77fe640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c920 0x7f43a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.444+0000 7f43b7fff640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c920 0x7f43a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.444+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f43b008ac10 con 0x7f43c00d2cd0 2024-04-01T00:12:43.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.444+0000 7f43b77fe640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f43a00727e0 0x7f43a0074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.445+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 --> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43b0015e70 con 0x7f43a00727e0 2024-04-01T00:12:43.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.445+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f43b008f2a0 con 0x7f43c00d2cd0 2024-04-01T00:12:43.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.445+0000 7f43bf7fe640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f43a00727e0 0x7f43a0074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.445+0000 7f43b7fff640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c920 0x7f43a006ede0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f43c00b5e40 tx=0x7f43a8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:43.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.446+0000 7f43bf7fe640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f43a00727e0 0x7f43a0074c00 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:43.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.447+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 <== osd.1 v2:172.21.15.120:6800/2143054953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43b0015e70 con 0x7f43a00727e0 2024-04-01T00:12:43.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.485+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 --> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f43c00b3ad0 con 0x7f43a00727e0 2024-04-01T00:12:43.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.486+0000 7f43b77fe640 1 -- 172.21.15.120:0/1623114003 <== osd.1 v2:172.21.15.120:6800/2143054953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f43c00b3ad0 con 0x7f43a00727e0 2024-04-01T00:12:43.487 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-01T00:12:43.487 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T00:12:43.487 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-01T00:12:43.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.486+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f43a00727e0 msgr2=0x7f43a0074c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.486+0000 7f43c53d6640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6800/2143054953,v1:172.21.15.120:6801/2143054953] conn(0x7f43a00727e0 0x7f43a0074c00 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.486+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c920 msgr2=0x7f43a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.486+0000 7f43c53d6640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f43a006c920 0x7f43a006ede0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f43c00b5e40 tx=0x7f43a8009240 comp rx=0 tx=0).stop 2024-04-01T00:12:43.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.486+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43c00d2cd0 msgr2=0x7f43c01f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.486+0000 7f43c53d6640 1 --2- 172.21.15.120:0/1623114003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43c00d2cd0 0x7f43c01f4bc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c430 tx=0x7f43b000c8f0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.487+0000 7f43bf7fe640 1 -- 172.21.15.120:0/1623114003 reap_dead start 2024-04-01T00:12:43.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.487+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 shutdown_connections 2024-04-01T00:12:43.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.487+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 >> 172.21.15.120:0/1623114003 conn(0x7f43c008bfb0 msgr2=0x7f43c00b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:43.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.487+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 shutdown_connections 2024-04-01T00:12:43.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.487+0000 7f43c53d6640 1 -- 172.21.15.120:0/1623114003 wait complete. 2024-04-01T00:12:43.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-01T00:12:43.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.786+0000 7f1c9ab4d640 1 Processor -- start 2024-04-01T00:12:43.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.787+0000 7f1c9ab4d640 1 -- start start 2024-04-01T00:12:43.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c9ab4d640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1c9415b260 0x7f1c940b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c9ab4d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c9ab4d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c940b45f0 0x7f1c940b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c9ab4d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f1c9415ff50 con 0x7f1c940b45f0 2024-04-01T00:12:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c9ab4d640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1c9415f340 con 0x7f1c9415b260 2024-04-01T00:12:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c9ab4d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9415f620 con 0x7f1c9415b640 2024-04-01T00:12:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c990ea640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c940b45f0 0x7f1c940b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c988e9640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1c9415b260 0x7f1c940b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c93fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c990ea640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1c940b45f0 0x7f1c940b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40716/0 (socket says 172.21.15.120:40716) 2024-04-01T00:12:43.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.789+0000 7f1c990ea640 1 -- 172.21.15.120:0/4288560428 learned_addr learned my addr 172.21.15.120:0/4288560428 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.790+0000 7f1c93fff640 1 -- 172.21.15.120:0/4288560428 >> v2:172.21.15.203:3300/0 conn(0x7f1c9415b260 msgr2=0x7f1c940b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.790+0000 7f1c93fff640 1 --2- 172.21.15.120:0/4288560428 >> v2:172.21.15.203:3300/0 conn(0x7f1c9415b260 0x7f1c940b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.790+0000 7f1c93fff640 1 -- 172.21.15.120:0/4288560428 >> v2:172.21.15.120:3300/0 conn(0x7f1c940b45f0 msgr2=0x7f1c940b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.790+0000 7f1c93fff640 1 --2- 172.21.15.120:0/4288560428 >> v2:172.21.15.120:3300/0 conn(0x7f1c940b45f0 0x7f1c940b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.790+0000 7f1c93fff640 1 -- 172.21.15.120:0/4288560428 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9415f900 con 0x7f1c9415b640 2024-04-01T00:12:43.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.790+0000 7f1c988e9640 1 --2- 172.21.15.120:0/4288560428 >> v2:172.21.15.203:3300/0 conn(0x7f1c9415b260 0x7f1c940b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.792+0000 7f1c93fff640 1 --2- 172.21.15.120:0/4288560428 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940affa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c94068190 tx=0x7f1c8402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2bf88acee5171ac server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.792+0000 7f1c937fe640 1 -- 172.21.15.120:0/4288560428 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840315a0 con 0x7f1c9415b640 2024-04-01T00:12:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.792+0000 7f1c937fe640 1 -- 172.21.15.120:0/4288560428 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c84037070 con 0x7f1c9415b640 2024-04-01T00:12:43.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.792+0000 7f1c937fe640 1 -- 172.21.15.120:0/4288560428 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84031960 con 0x7f1c9415b640 2024-04-01T00:12:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.793+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4288560428 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 msgr2=0x7f1c940affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.793+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4288560428 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940affa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c94068190 tx=0x7f1c8402b840 comp rx=0 tx=0).stop 2024-04-01T00:12:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.794+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4288560428 shutdown_connections 2024-04-01T00:12:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.794+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4288560428 >> v2:172.21.15.120:3300/0 conn(0x7f1c940b45f0 0x7f1c940b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.794+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4288560428 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940affa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.794+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4288560428 >> v2:172.21.15.203:3300/0 conn(0x7f1c9415b260 0x7f1c940b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.794+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4288560428 >> 172.21.15.120:0/4288560428 conn(0x7f1c940b65a0 msgr2=0x7f1c940b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:43.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.794+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4288560428 shutdown_connections 2024-04-01T00:12:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.794+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4288560428 wait complete. 2024-04-01T00:12:43.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.797+0000 7f1c9ab4d640 1 Processor -- start 2024-04-01T00:12:43.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.797+0000 7f1c9ab4d640 1 -- start start 2024-04-01T00:12:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c9ab4d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c940b45f0 0x7f1c9414eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c9ab4d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c9415b260 0x7f1c9414a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c9ab4d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c9ab4d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9406e770 con 0x7f1c9415b260 2024-04-01T00:12:43.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c9ab4d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9415f010 con 0x7f1c940b45f0 2024-04-01T00:12:43.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c9ab4d640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1c940d1160 con 0x7f1c9415b640 2024-04-01T00:12:43.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c93fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c9415b260 0x7f1c9414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c990ea640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c93fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c9415b260 0x7f1c9414a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40726/0 (socket says 172.21.15.120:40726) 2024-04-01T00:12:43.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c988e9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c940b45f0 0x7f1c9414eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c93fff640 1 -- 172.21.15.120:0/4143329843 learned_addr learned my addr 172.21.15.120:0/4143329843 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.799+0000 7f1c990ea640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:37624/0 (socket says 172.21.15.120:37624) 2024-04-01T00:12:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.800+0000 7f1c990ea640 1 -- 172.21.15.120:0/4143329843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c940b45f0 msgr2=0x7f1c9414eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.800+0000 7f1c990ea640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c940b45f0 0x7f1c9414eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.800+0000 7f1c990ea640 1 -- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c9415b260 msgr2=0x7f1c9414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.800+0000 7f1c990ea640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c9415b260 0x7f1c9414a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.800+0000 7f1c990ea640 1 -- 172.21.15.120:0/4143329843 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9414c6b0 con 0x7f1c9415b640 2024-04-01T00:12:43.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.800+0000 7f1c990ea640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940cd290 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00b390 tx=0x7f1c8c00b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.801+0000 7f1c917fa640 1 -- 172.21.15.120:0/4143329843 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00be60 con 0x7f1c9415b640 2024-04-01T00:12:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.801+0000 7f1c917fa640 1 -- 172.21.15.120:0/4143329843 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c003990 con 0x7f1c9415b640 2024-04-01T00:12:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.801+0000 7f1c917fa640 1 -- 172.21.15.120:0/4143329843 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c003d40 con 0x7f1c9415b640 2024-04-01T00:12:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.801+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9414c950 con 0x7f1c9415b640 2024-04-01T00:12:43.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.801+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9414cf10 con 0x7f1c9415b640 2024-04-01T00:12:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.803+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c94068cd0 con 0x7f1c9415b640 2024-04-01T00:12:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.803+0000 7f1c917fa640 1 -- 172.21.15.120:0/4143329843 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c8c004030 con 0x7f1c9415b640 2024-04-01T00:12:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.804+0000 7f1c917fa640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c7406c8f0 0x7f1c7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:43.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.805+0000 7f1c988e9640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c7406c8f0 0x7f1c7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:43.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.805+0000 7f1c917fa640 1 -- 172.21.15.120:0/4143329843 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f1c8c08f790 con 0x7f1c9415b640 2024-04-01T00:12:43.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.805+0000 7f1c988e9640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c7406c8f0 0x7f1c7406edb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009560 tx=0x7f1c7c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:43.810 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:43.809+0000 7f1c917fa640 1 -- 172.21.15.120:0/4143329843 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1c8c05d900 con 0x7f1c9415b640 2024-04-01T00:12:44.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.343+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f1c94156080 con 0x7f1c7406c8f0 2024-04-01T00:12:44.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.343+0000 7f1c917fa640 1 -- 172.21.15.120:0/4143329843 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1c94156080 con 0x7f1c7406c8f0 2024-04-01T00:12:44.345 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 1 to deep-scrub 2024-04-01T00:12:44.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.347+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c7406c8f0 msgr2=0x7f1c7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.347+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c7406c8f0 0x7f1c7406edb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009560 tx=0x7f1c7c009190 comp rx=0 tx=0).stop 2024-04-01T00:12:44.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.347+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 msgr2=0x7f1c940cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.347+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940cd290 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00b390 tx=0x7f1c8c00b850 comp rx=0 tx=0).stop 2024-04-01T00:12:44.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.347+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 shutdown_connections 2024-04-01T00:12:44.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.347+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1c7406c8f0 0x7f1c7406edb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.347+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9415b640 0x7f1c940cd290 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.347+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1c9415b260 0x7f1c9414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.348+0000 7f1c9ab4d640 1 --2- 172.21.15.120:0/4143329843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c940b45f0 0x7f1c9414eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.348+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 >> 172.21.15.120:0/4143329843 conn(0x7f1c940b65a0 msgr2=0x7f1c9415e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:44.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.348+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 shutdown_connections 2024-04-01T00:12:44.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.348+0000 7f1c9ab4d640 1 -- 172.21.15.120:0/4143329843 wait complete. 2024-04-01T00:12:44.373 INFO:tasks.ceph:Scrubbing osd.2 2024-04-01T00:12:44.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-01T00:12:44.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.655+0000 7fcc1b1e9640 1 Processor -- start 2024-04-01T00:12:44.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.655+0000 7fcc1b1e9640 1 -- start start 2024-04-01T00:12:44.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.657+0000 7fcc1b1e9640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcc1415e9b0 0x7fcc141622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:44.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.657+0000 7fcc1b1e9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc140d1070 con 0x7fcc140d0110 2024-04-01T00:12:44.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.658+0000 7fcc1b1e9640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc140d1350 con 0x7fcc1406f900 2024-04-01T00:12:44.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.658+0000 7fcc1b1e9640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcc140b7450 con 0x7fcc1415e9b0 2024-04-01T00:12:44.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.658+0000 7fcc0bfff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcc1415e9b0 0x7fcc141622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:44.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.658+0000 7fcc19786640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcc140d0110 0x7fcc140b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54262/0 (socket says 172.21.15.120:54262) 2024-04-01T00:12:44.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.658+0000 7fcc19786640 1 -- 172.21.15.120:0/732877291 learned_addr learned my addr 172.21.15.120:0/732877291 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:44.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.658+0000 7fcc0bfff640 1 -- 172.21.15.120:0/732877291 >> v1:172.21.15.203:6789/0 conn(0x7fcc1406f900 legacy=0x7fcc1406fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.658+0000 7fcc0bfff640 1 -- 172.21.15.120:0/732877291 >> v1:172.21.15.120:6789/0 conn(0x7fcc140d0110 legacy=0x7fcc140b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.658+0000 7fcc0bfff640 1 -- 172.21.15.120:0/732877291 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc140d1630 con 0x7fcc1415e9b0 2024-04-01T00:12:44.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.659+0000 7fcc0bfff640 1 --2- 172.21.15.120:0/732877291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc1415e9b0 0x7fcc141622d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcc140b75d0 tx=0x7fcc0402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcdfc6cc5b6d8faa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:44.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.660+0000 7fcc0b7fe640 1 -- 172.21.15.120:0/732877291 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04035020 con 0x7fcc1415e9b0 2024-04-01T00:12:44.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.660+0000 7fcc0b7fe640 1 -- 172.21.15.120:0/732877291 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc04031810 con 0x7fcc1415e9b0 2024-04-01T00:12:44.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.660+0000 7fcc0b7fe640 1 -- 172.21.15.120:0/732877291 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04031be0 con 0x7fcc1415e9b0 2024-04-01T00:12:44.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.661+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/732877291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc1415e9b0 msgr2=0x7fcc141622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.661+0000 7fcc1b1e9640 1 --2- 172.21.15.120:0/732877291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc1415e9b0 0x7fcc141622d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcc140b75d0 tx=0x7fcc0402b8b0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.661+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/732877291 shutdown_connections 2024-04-01T00:12:44.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.661+0000 7fcc1b1e9640 1 --2- 172.21.15.120:0/732877291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc1415e9b0 0x7fcc141622d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.661+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/732877291 >> 172.21.15.120:0/732877291 conn(0x7fcc1406bbd0 msgr2=0x7fcc140b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:44.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.661+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/732877291 shutdown_connections 2024-04-01T00:12:44.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.661+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/732877291 wait complete. 2024-04-01T00:12:44.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.664+0000 7fcc1b1e9640 1 Processor -- start 2024-04-01T00:12:44.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.664+0000 7fcc1b1e9640 1 -- start start 2024-04-01T00:12:44.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.666+0000 7fcc1b1e9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc1406f900 0x7fcc1415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:44.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.666+0000 7fcc1b1e9640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc140d0110 0x7fcc141e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.666+0000 7fcc1b1e9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc1415e9b0 0x7fcc141f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.666+0000 7fcc1b1e9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc140d0c70 con 0x7fcc1406f900 2024-04-01T00:12:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.666+0000 7fcc1b1e9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc140d1c80 con 0x7fcc1415e9b0 2024-04-01T00:12:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.666+0000 7fcc1b1e9640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc140d0df0 con 0x7fcc140d0110 2024-04-01T00:12:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc140d0110 0x7fcc141e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc18f85640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc1406f900 0x7fcc1415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:44.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc140d0110 0x7fcc141e9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:38476/0 (socket says 172.21.15.120:38476) 2024-04-01T00:12:44.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 -- 172.21.15.120:0/2280297335 learned_addr learned my addr 172.21.15.120:0/2280297335 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:44.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc19786640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc1415e9b0 0x7fcc141f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:44.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 -- 172.21.15.120:0/2280297335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc1415e9b0 msgr2=0x7fcc141f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc1415e9b0 0x7fcc141f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 -- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc1406f900 msgr2=0x7fcc1415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc1406f900 0x7fcc1415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 -- 172.21.15.120:0/2280297335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc141e8690 con 0x7fcc140d0110 2024-04-01T00:12:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.667+0000 7fcc0bfff640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc140d0110 0x7fcc141e9730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009890 tx=0x7fcc040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:44.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.668+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04040070 con 0x7fcc140d0110 2024-04-01T00:12:44.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.668+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0403e070 con 0x7fcc140d0110 2024-04-01T00:12:44.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.668+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc141e8970 con 0x7fcc140d0110 2024-04-01T00:12:44.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.668+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04035040 con 0x7fcc140d0110 2024-04-01T00:12:44.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.668+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc141e8f30 con 0x7fcc140d0110 2024-04-01T00:12:44.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.670+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc141e9310 con 0x7fcc140d0110 2024-04-01T00:12:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.671+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc04038020 con 0x7fcc140d0110 2024-04-01T00:12:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.672+0000 7fcc097fa640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc0006c8f0 0x7fcc0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.672+0000 7fcc18f85640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc0006c8f0 0x7fcc0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:44.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.672+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcc040ad4a0 con 0x7fcc140d0110 2024-04-01T00:12:44.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.672+0000 7fcc097fa640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fcc000727b0 0x7fcc00074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:44.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.672+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 --> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc0402fe50 con 0x7fcc000727b0 2024-04-01T00:12:44.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.672+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcc040b4050 con 0x7fcc140d0110 2024-04-01T00:12:44.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.673+0000 7fcc19786640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fcc000727b0 0x7fcc00074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:44.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.673+0000 7fcc18f85640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc0006c8f0 0x7fcc0006edb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fcc1415cad0 tx=0x7fcc10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:44.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.673+0000 7fcc19786640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fcc000727b0 0x7fcc00074bd0 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:44.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.675+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 <== osd.2 v2:172.21.15.120:6820/261148039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc0402fe50 con 0x7fcc000727b0 2024-04-01T00:12:44.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.713+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 --> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcc14068cd0 con 0x7fcc000727b0 2024-04-01T00:12:44.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.714+0000 7fcc097fa640 1 -- 172.21.15.120:0/2280297335 <== osd.2 v2:172.21.15.120:6820/261148039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcc14068cd0 con 0x7fcc000727b0 2024-04-01T00:12:44.715 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-01T00:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T00:12:44.716 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-01T00:12:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fcc000727b0 msgr2=0x7fcc00074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6820/261148039,v1:172.21.15.120:6822/261148039] conn(0x7fcc000727b0 0x7fcc00074bd0 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc0006c8f0 msgr2=0x7fcc0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcc0006c8f0 0x7fcc0006edb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fcc1415cad0 tx=0x7fcc10009040 comp rx=0 tx=0).stop 2024-04-01T00:12:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc140d0110 msgr2=0x7fcc141e9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:44.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 --2- 172.21.15.120:0/2280297335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc140d0110 0x7fcc141e9730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009890 tx=0x7fcc040046c0 comp rx=0 tx=0).stop 2024-04-01T00:12:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc19786640 1 -- 172.21.15.120:0/2280297335 reap_dead start 2024-04-01T00:12:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 shutdown_connections 2024-04-01T00:12:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 >> 172.21.15.120:0/2280297335 conn(0x7fcc1406bbd0 msgr2=0x7fcc140b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 shutdown_connections 2024-04-01T00:12:44.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:44.715+0000 7fcc1b1e9640 1 -- 172.21.15.120:0/2280297335 wait complete. 2024-04-01T00:12:44.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-01T00:12:45.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.016+0000 7fdce4160640 1 Processor -- start 2024-04-01T00:12:45.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.017+0000 7fdce4160640 1 -- start start 2024-04-01T00:12:45.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce4160640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc0b0670 0x7fdcdc15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce4160640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdcdc06bc80 0x7fdcdc168450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce4160640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcdc0b5b10 con 0x7fdcdc070120 2024-04-01T00:12:45.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce4160640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fdcdc0b63e0 con 0x7fdcdc06bc80 2024-04-01T00:12:45.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce4160640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdcdc06c3f0 con 0x7fdcdc0b0670 2024-04-01T00:12:45.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce16fb640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fdcdc070120 0x7fdcdc06b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54278/0 (socket says 172.21.15.120:54278) 2024-04-01T00:12:45.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce16fb640 1 -- 172.21.15.120:0/2889754118 learned_addr learned my addr 172.21.15.120:0/2889754118 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:45.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce1efc640 1 --2- 172.21.15.120:0/2889754118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc0b0670 0x7fdcdc15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.019+0000 7fdce26fd640 1 --2- 172.21.15.120:0/2889754118 >> v2:172.21.15.203:3300/0 conn(0x7fdcdc06bc80 0x7fdcdc168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.020+0000 7fdce0efa640 1 -- 172.21.15.120:0/2889754118 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840635737 0 0) 0x7fdcd0001110 con 0x7fdcdc070120 2024-04-01T00:12:45.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.020+0000 7fdce0efa640 1 -- 172.21.15.120:0/2889754118 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc8003520 con 0x7fdcdc070120 2024-04-01T00:12:45.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.020+0000 7fdce1efc640 1 -- 172.21.15.120:0/2889754118 >> v2:172.21.15.203:3300/0 conn(0x7fdcdc06bc80 msgr2=0x7fdcdc168450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:45.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.020+0000 7fdce1efc640 1 --2- 172.21.15.120:0/2889754118 >> v2:172.21.15.203:3300/0 conn(0x7fdcdc06bc80 0x7fdcdc168450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.020+0000 7fdce1efc640 1 -- 172.21.15.120:0/2889754118 >> v1:172.21.15.120:6789/0 conn(0x7fdcdc070120 legacy=0x7fdcdc06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.020+0000 7fdce1efc640 1 -- 172.21.15.120:0/2889754118 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcdc15fdf0 con 0x7fdcdc0b0670 2024-04-01T00:12:45.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.022+0000 7fdce1efc640 1 --2- 172.21.15.120:0/2889754118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc0b0670 0x7fdcdc15f8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80097a0 tx=0x7fdcd802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee8807968f3b0fa server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:45.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.022+0000 7fdce0efa640 1 -- 172.21.15.120:0/2889754118 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8035020 con 0x7fdcdc0b0670 2024-04-01T00:12:45.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.022+0000 7fdce0efa640 1 -- 172.21.15.120:0/2889754118 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd8031830 con 0x7fdcdc0b0670 2024-04-01T00:12:45.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.022+0000 7fdce0efa640 1 -- 172.21.15.120:0/2889754118 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8031c00 con 0x7fdcdc0b0670 2024-04-01T00:12:45.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.023+0000 7fdce4160640 1 -- 172.21.15.120:0/2889754118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc0b0670 msgr2=0x7fdcdc15f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.023+0000 7fdce4160640 1 --2- 172.21.15.120:0/2889754118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc0b0670 0x7fdcdc15f8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80097a0 tx=0x7fdcd802b8d0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.024+0000 7fdce4160640 1 -- 172.21.15.120:0/2889754118 shutdown_connections 2024-04-01T00:12:45.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.024+0000 7fdce4160640 1 --2- 172.21.15.120:0/2889754118 >> v2:172.21.15.203:3300/0 conn(0x7fdcdc06bc80 0x7fdcdc168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.024+0000 7fdce4160640 1 --2- 172.21.15.120:0/2889754118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc0b0670 0x7fdcdc15f8b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.024+0000 7fdce4160640 1 -- 172.21.15.120:0/2889754118 >> 172.21.15.120:0/2889754118 conn(0x7fdcdc0b65a0 msgr2=0x7fdcdc0b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:45.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.024+0000 7fdce4160640 1 -- 172.21.15.120:0/2889754118 shutdown_connections 2024-04-01T00:12:45.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.024+0000 7fdce4160640 1 -- 172.21.15.120:0/2889754118 wait complete. 2024-04-01T00:12:45.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.027+0000 7fdce4160640 1 Processor -- start 2024-04-01T00:12:45.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.027+0000 7fdce4160640 1 -- start start 2024-04-01T00:12:45.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce4160640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc06bc80 0x7fdcdc13fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce4160640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcdc070120 0x7fdcdc0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce4160640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcdc0b0670 0x7fdcdc06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce4160640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdcdc0b6070 con 0x7fdcdc0b0670 2024-04-01T00:12:45.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce4160640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdcdc0b5d90 con 0x7fdcdc070120 2024-04-01T00:12:45.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce4160640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdcdc0b0a50 con 0x7fdcdc06bc80 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce1efc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc06bc80 0x7fdcdc13fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce1efc640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc06bc80 0x7fdcdc13fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:38484/0 (socket says 172.21.15.120:38484) 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce1efc640 1 -- 172.21.15.120:0/4122368227 learned_addr learned my addr 172.21.15.120:0/4122368227 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce26fd640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcdc0b0670 0x7fdcdc06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.029+0000 7fdce16fb640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcdc070120 0x7fdcdc0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.030+0000 7fdce1efc640 1 -- 172.21.15.120:0/4122368227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcdc070120 msgr2=0x7fdcdc0cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.030+0000 7fdce1efc640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcdc070120 0x7fdcdc0cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.030+0000 7fdce1efc640 1 -- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcdc0b0670 msgr2=0x7fdcdc06ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.030+0000 7fdce1efc640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcdc0b0670 0x7fdcdc06ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.030+0000 7fdce1efc640 1 -- 172.21.15.120:0/4122368227 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcdc13ffc0 con 0x7fdcdc06bc80 2024-04-01T00:12:45.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.030+0000 7fdce1efc640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc06bc80 0x7fdcdc13fa80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8000c00 tx=0x7fdcd80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:45.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.030+0000 7fdcce7fc640 1 -- 172.21.15.120:0/4122368227 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8040070 con 0x7fdcdc06bc80 2024-04-01T00:12:45.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.030+0000 7fdcce7fc640 1 -- 172.21.15.120:0/4122368227 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd803a910 con 0x7fdcdc06bc80 2024-04-01T00:12:45.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.031+0000 7fdcce7fc640 1 -- 172.21.15.120:0/4122368227 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8035040 con 0x7fdcdc06bc80 2024-04-01T00:12:45.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.031+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcdc0cca80 con 0x7fdcdc06bc80 2024-04-01T00:12:45.034 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.031+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcdc0ce110 con 0x7fdcdc06bc80 2024-04-01T00:12:45.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.033+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcdc068cd0 con 0x7fdcdc06bc80 2024-04-01T00:12:45.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.034+0000 7fdcce7fc640 1 -- 172.21.15.120:0/4122368227 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcd804b060 con 0x7fdcdc06bc80 2024-04-01T00:12:45.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.035+0000 7fdcce7fc640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcc006c8f0 0x7fdcc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.035+0000 7fdcce7fc640 1 -- 172.21.15.120:0/4122368227 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fdcd80ace10 con 0x7fdcdc06bc80 2024-04-01T00:12:45.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.035+0000 7fdce16fb640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcc006c8f0 0x7fdcc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.036+0000 7fdce16fb640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcc006c8f0 0x7fdcc006edb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0d0bd0 tx=0x7fdcd0007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:45.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.040+0000 7fdcce7fc640 1 -- 172.21.15.120:0/4122368227 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdcdc15fdf0 con 0x7fdcdc06bc80 2024-04-01T00:12:45.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.569+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fdcdc0ae300 con 0x7fdcc006c8f0 2024-04-01T00:12:45.571 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.570+0000 7fdcce7fc640 1 -- 172.21.15.120:0/4122368227 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdcdc0ae300 con 0x7fdcc006c8f0 2024-04-01T00:12:45.572 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 2 to deep-scrub 2024-04-01T00:12:45.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcc006c8f0 msgr2=0x7fdcc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcc006c8f0 0x7fdcc006edb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0d0bd0 tx=0x7fdcd0007b50 comp rx=0 tx=0).stop 2024-04-01T00:12:45.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc06bc80 msgr2=0x7fdcdc13fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc06bc80 0x7fdcdc13fa80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8000c00 tx=0x7fdcd80046c0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 shutdown_connections 2024-04-01T00:12:45.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fdcc006c8f0 0x7fdcc006edb0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdcdc0b0670 0x7fdcdc06ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcdc070120 0x7fdcdc0cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 --2- 172.21.15.120:0/4122368227 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdcdc06bc80 0x7fdcdc13fa80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 >> 172.21.15.120:0/4122368227 conn(0x7fdcdc0b65a0 msgr2=0x7fdcdc0aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:45.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 shutdown_connections 2024-04-01T00:12:45.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.574+0000 7fdce4160640 1 -- 172.21.15.120:0/4122368227 wait complete. 2024-04-01T00:12:45.599 INFO:tasks.ceph:Scrubbing osd.3 2024-04-01T00:12:45.600 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-01T00:12:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.882+0000 7f1122d50640 1 Processor -- start 2024-04-01T00:12:45.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.882+0000 7f1122d50640 1 -- start start 2024-04-01T00:12:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.884+0000 7f1122d50640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f111c15e6b0 0x7f111c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.884+0000 7f1122d50640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae0c0 0x7f111c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.884+0000 7f1122d50640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f111c0ae520 0x7f111c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.884+0000 7f1122d50640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f111c0b2570 con 0x7f111c0ae520 2024-04-01T00:12:45.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.884+0000 7f1122d50640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f111c0b27c0 con 0x7f111c15e6b0 2024-04-01T00:12:45.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.884+0000 7f1122d50640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f111c0b2aa0 con 0x7f111c0ae0c0 2024-04-01T00:12:45.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f11212ed640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f111c0ae520 0x7f111c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f11212ed640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f111c0ae520 0x7f111c0b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43406/0 (socket says 172.21.15.120:43406) 2024-04-01T00:12:45.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f11212ed640 1 -- 172.21.15.120:0/3749291957 learned_addr learned my addr 172.21.15.120:0/3749291957 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:45.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f111bfff640 1 --2- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae0c0 0x7f111c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f1120aec640 1 --2- 172.21.15.120:0/3749291957 >> v2:172.21.15.203:3300/0 conn(0x7f111c15e6b0 0x7f111c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f1120aec640 1 -- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae0c0 msgr2=0x7f111c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:45.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f1120aec640 1 --2- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae0c0 0x7f111c0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f1120aec640 1 -- 172.21.15.120:0/3749291957 >> v2:172.21.15.120:3300/0 conn(0x7f111c0ae520 msgr2=0x7f111c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:45.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.885+0000 7f1120aec640 1 --2- 172.21.15.120:0/3749291957 >> v2:172.21.15.120:3300/0 conn(0x7f111c0ae520 0x7f111c0b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.886+0000 7f1120aec640 1 -- 172.21.15.120:0/3749291957 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c0b6040 con 0x7f111c15e6b0 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.886+0000 7f111bfff640 1 --2- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae0c0 0x7f111c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.886+0000 7f11212ed640 1 --2- 172.21.15.120:0/3749291957 >> v2:172.21.15.120:3300/0 conn(0x7f111c0ae520 0x7f111c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.887+0000 7f1120aec640 1 --2- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 0x7f111c0b40e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f111c0d2200 tx=0x7f111002b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2234634fb1f709dd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.888+0000 7f111b7fe640 1 -- 172.21.15.120:0/3749291957 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110037070 con 0x7f111c15e6b0 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.888+0000 7f111b7fe640 1 -- 172.21.15.120:0/3749291957 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1110030710 con 0x7f111c15e6b0 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.888+0000 7f111b7fe640 1 -- 172.21.15.120:0/3749291957 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110030ae0 con 0x7f111c15e6b0 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 -- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 msgr2=0x7f111c0b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 --2- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 0x7f111c0b40e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f111c0d2200 tx=0x7f111002b730 comp rx=0 tx=0).stop 2024-04-01T00:12:45.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 -- 172.21.15.120:0/3749291957 shutdown_connections 2024-04-01T00:12:45.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 --2- 172.21.15.120:0/3749291957 >> v2:172.21.15.120:3300/0 conn(0x7f111c0ae520 0x7f111c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 --2- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae0c0 0x7f111c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 --2- 172.21.15.120:0/3749291957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 0x7f111c0b40e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 -- 172.21.15.120:0/3749291957 >> 172.21.15.120:0/3749291957 conn(0x7f111c0b6600 msgr2=0x7f111c0b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:45.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 -- 172.21.15.120:0/3749291957 shutdown_connections 2024-04-01T00:12:45.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.889+0000 7f1122d50640 1 -- 172.21.15.120:0/3749291957 wait complete. 2024-04-01T00:12:45.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.892+0000 7f1122d50640 1 Processor -- start 2024-04-01T00:12:45.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.892+0000 7f1122d50640 1 -- start start 2024-04-01T00:12:45.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1122d50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f111c0ae0c0 0x7f111c09ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1122d50640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae520 0x7f111c15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1122d50640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 0x7f111c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1122d50640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f111c0b0520 con 0x7f111c0ae0c0 2024-04-01T00:12:45.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1122d50640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f111c0b03a0 con 0x7f111c15e6b0 2024-04-01T00:12:45.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1122d50640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f111c15ea90 con 0x7f111c0ae520 2024-04-01T00:12:45.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1120aec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f111c0ae0c0 0x7f111c09ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1120aec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f111c0ae0c0 0x7f111c09ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43412/0 (socket says 172.21.15.120:43412) 2024-04-01T00:12:45.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f1120aec640 1 -- 172.21.15.120:0/321715341 learned_addr learned my addr 172.21.15.120:0/321715341 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:45.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f11212ed640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 0x7f111c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f111bfff640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae520 0x7f111c15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f11212ed640 1 -- 172.21.15.120:0/321715341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae520 msgr2=0x7f111c15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f11212ed640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f111c0ae520 0x7f111c15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f11212ed640 1 -- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f111c0ae0c0 msgr2=0x7f111c09ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f11212ed640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f111c0ae0c0 0x7f111c09ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.895+0000 7f11212ed640 1 -- 172.21.15.120:0/321715341 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c15b690 con 0x7f111c15e6b0 2024-04-01T00:12:45.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.896+0000 7f11212ed640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 0x7f111c15abd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1114009e50 tx=0x7f111400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:45.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.896+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111400cb80 con 0x7f111c15e6b0 2024-04-01T00:12:45.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.896+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111400cd40 con 0x7f111c15e6b0 2024-04-01T00:12:45.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.896+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c15b970 con 0x7f111c15e6b0 2024-04-01T00:12:45.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.896+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114003bd0 con 0x7f111c15e6b0 2024-04-01T00:12:45.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.896+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c15bf30 con 0x7f111c15e6b0 2024-04-01T00:12:45.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.898+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f111c068cd0 con 0x7f111c15e6b0 2024-04-01T00:12:45.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.898+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f111401b030 con 0x7f111c15e6b0 2024-04-01T00:12:45.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.899+0000 7f11197fa640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f110006c8f0 0x7f110006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.899+0000 7f1120aec640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f110006c8f0 0x7f110006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.899+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f111408bb80 con 0x7f111c15e6b0 2024-04-01T00:12:45.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.900+0000 7f11197fa640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f11000727b0 0x7f1100074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:45.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.900+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 --> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f111401ae80 con 0x7f11000727b0 2024-04-01T00:12:45.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.900+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f11140902a0 con 0x7f111c15e6b0 2024-04-01T00:12:45.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.900+0000 7f111bfff640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f11000727b0 0x7f1100074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:45.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.900+0000 7f1120aec640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f110006c8f0 0x7f110006edb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1110009560 tx=0x7f1110008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:45.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.901+0000 7f111bfff640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f11000727b0 0x7f1100074bd0 crc :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:45.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.902+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 <== osd.3 v2:172.21.15.120:6816/404626686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f111401ae80 con 0x7f11000727b0 2024-04-01T00:12:45.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.941+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 --> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f111c15c350 con 0x7f11000727b0 2024-04-01T00:12:45.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.942+0000 7f11197fa640 1 -- 172.21.15.120:0/321715341 <== osd.3 v2:172.21.15.120:6816/404626686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f111c15c350 con 0x7f11000727b0 2024-04-01T00:12:45.943 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-01T00:12:45.944 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T00:12:45.944 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-01T00:12:45.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.942+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f11000727b0 msgr2=0x7f1100074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.942+0000 7f1122d50640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6816/404626686,v1:172.21.15.120:6817/404626686] conn(0x7f11000727b0 0x7f1100074bd0 crc :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:45.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.942+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f110006c8f0 msgr2=0x7f110006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.942+0000 7f1122d50640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f110006c8f0 0x7f110006edb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1110009560 tx=0x7f1110008030 comp rx=0 tx=0).stop 2024-04-01T00:12:45.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.942+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 msgr2=0x7f111c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:45.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.942+0000 7f1122d50640 1 --2- 172.21.15.120:0/321715341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f111c15e6b0 0x7f111c15abd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1114009e50 tx=0x7f111400c490 comp rx=0 tx=0).stop 2024-04-01T00:12:45.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.942+0000 7f11212ed640 1 -- 172.21.15.120:0/321715341 reap_dead start 2024-04-01T00:12:45.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.943+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 shutdown_connections 2024-04-01T00:12:45.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.943+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 >> 172.21.15.120:0/321715341 conn(0x7f111c0b6600 msgr2=0x7f111c06e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:45.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.943+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 shutdown_connections 2024-04-01T00:12:45.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:45.943+0000 7f1122d50640 1 -- 172.21.15.120:0/321715341 wait complete. 2024-04-01T00:12:45.968 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-01T00:12:46.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.242+0000 7fd67fc29640 1 Processor -- start 2024-04-01T00:12:46.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.243+0000 7fd67fc29640 1 -- start start 2024-04-01T00:12:46.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.244+0000 7fd67fc29640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd67806bc80 0x7fd678169460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:46.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.244+0000 7fd67fc29640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6780b5b10 con 0x7fd678070120 2024-04-01T00:12:46.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.244+0000 7fd67fc29640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6780705e0 con 0x7fd6780b0670 2024-04-01T00:12:46.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.244+0000 7fd67fc29640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fd6780b63e0 con 0x7fd67806bc80 2024-04-01T00:12:46.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.244+0000 7fd67d1c4640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd678070120 0x7fd67806b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54294/0 (socket says 172.21.15.120:54294) 2024-04-01T00:12:46.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.244+0000 7fd67d1c4640 1 -- 172.21.15.120:0/579828621 learned_addr learned my addr 172.21.15.120:0/579828621 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:46.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.244+0000 7fd67e1c6640 1 --2- 172.21.15.120:0/579828621 >> v2:172.21.15.120:3300/0 conn(0x7fd67806bc80 0x7fd678169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:46.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.245+0000 7fd67e1c6640 1 -- 172.21.15.120:0/579828621 >> v1:172.21.15.203:6789/0 conn(0x7fd6780b0670 legacy=0x7fd67815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:46.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.245+0000 7fd67e1c6640 1 -- 172.21.15.120:0/579828621 >> v1:172.21.15.120:6789/0 conn(0x7fd678070120 legacy=0x7fd67806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.245+0000 7fd67c9c3640 1 -- 172.21.15.120:0/579828621 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220985050 0 0) 0x7fd6780705e0 con 0x7fd6780b0670 2024-04-01T00:12:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.245+0000 7fd67e1c6640 1 -- 172.21.15.120:0/579828621 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6780b5d90 con 0x7fd67806bc80 2024-04-01T00:12:46.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.247+0000 7fd67e1c6640 1 --2- 172.21.15.120:0/579828621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd678169460 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7fd670009d90 tx=0x7fd67002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e22a8bad28fd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:46.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.247+0000 7fd67c9c3640 1 -- 172.21.15.120:0/579828621 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670039070 con 0x7fd67806bc80 2024-04-01T00:12:46.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.247+0000 7fd67c9c3640 1 -- 172.21.15.120:0/579828621 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67002cd00 con 0x7fd67806bc80 2024-04-01T00:12:46.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.247+0000 7fd67c9c3640 1 -- 172.21.15.120:0/579828621 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670034660 con 0x7fd67806bc80 2024-04-01T00:12:46.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.248+0000 7fd67fc29640 1 -- 172.21.15.120:0/579828621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 msgr2=0x7fd678169460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:46.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.248+0000 7fd67fc29640 1 --2- 172.21.15.120:0/579828621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd678169460 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7fd670009d90 tx=0x7fd67002bf50 comp rx=0 tx=0).stop 2024-04-01T00:12:46.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.249+0000 7fd67fc29640 1 -- 172.21.15.120:0/579828621 shutdown_connections 2024-04-01T00:12:46.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.249+0000 7fd67fc29640 1 --2- 172.21.15.120:0/579828621 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd678169460 unknown :-1 s=CLOSED pgs=3256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:46.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.249+0000 7fd67fc29640 1 -- 172.21.15.120:0/579828621 >> 172.21.15.120:0/579828621 conn(0x7fd6780b65a0 msgr2=0x7fd6780b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:46.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.249+0000 7fd67fc29640 1 -- 172.21.15.120:0/579828621 shutdown_connections 2024-04-01T00:12:46.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.249+0000 7fd67fc29640 1 -- 172.21.15.120:0/579828621 wait complete. 2024-04-01T00:12:46.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.252+0000 7fd67fc29640 1 Processor -- start 2024-04-01T00:12:46.253 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.252+0000 7fd67fc29640 1 -- start start 2024-04-01T00:12:46.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67fc29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd67813aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:46.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67fc29640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678070120 0x7fd67809b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:46.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67fc29640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6780b0670 0x7fd67809b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:46.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67fc29640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd6780b0a50 con 0x7fd67806bc80 2024-04-01T00:12:46.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67fc29640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd67806c3f0 con 0x7fd678070120 2024-04-01T00:12:46.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67fc29640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd67806e770 con 0x7fd6780b0670 2024-04-01T00:12:46.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67d9c5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd67813aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:46.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67d9c5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd67813aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43434/0 (socket says 172.21.15.120:43434) 2024-04-01T00:12:46.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67d9c5640 1 -- 172.21.15.120:0/2647850545 learned_addr learned my addr 172.21.15.120:0/2647850545 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:46.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.254+0000 7fd67d1c4640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678070120 0x7fd67809b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:46.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67e1c6640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6780b0670 0x7fd67809b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:46.258 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67e1c6640 1 -- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678070120 msgr2=0x7fd67809b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67e1c6640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678070120 0x7fd67809b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67e1c6640 1 -- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 msgr2=0x7fd67813aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67e1c6640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd67813aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67e1c6640 1 -- 172.21.15.120:0/2647850545 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd678147860 con 0x7fd6780b0670 2024-04-01T00:12:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67d9c5640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd67813aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67d1c4640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678070120 0x7fd67809b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.255+0000 7fd67e1c6640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6780b0670 0x7fd67809b6e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd67815ee70 tx=0x7fd670004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:46.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.256+0000 7fd66e7fc640 1 -- 172.21.15.120:0/2647850545 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670044020 con 0x7fd6780b0670 2024-04-01T00:12:46.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.256+0000 7fd66e7fc640 1 -- 172.21.15.120:0/2647850545 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67003a040 con 0x7fd6780b0670 2024-04-01T00:12:46.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.256+0000 7fd66e7fc640 1 -- 172.21.15.120:0/2647850545 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670039050 con 0x7fd6780b0670 2024-04-01T00:12:46.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.256+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67809deb0 con 0x7fd6780b0670 2024-04-01T00:12:46.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.256+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67809e470 con 0x7fd6780b0670 2024-04-01T00:12:46.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.258+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd678068cd0 con 0x7fd6780b0670 2024-04-01T00:12:46.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.259+0000 7fd66e7fc640 1 -- 172.21.15.120:0/2647850545 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd67002cbc0 con 0x7fd6780b0670 2024-04-01T00:12:46.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.260+0000 7fd66e7fc640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd65c06c8f0 0x7fd65c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:46.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.260+0000 7fd67d9c5640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd65c06c8f0 0x7fd65c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:46.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.260+0000 7fd66e7fc640 1 -- 172.21.15.120:0/2647850545 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fd6700adcf0 con 0x7fd6780b0670 2024-04-01T00:12:46.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.261+0000 7fd67d9c5640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd65c06c8f0 0x7fd65c06edb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd674000f60 tx=0x7fd674009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:46.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.265+0000 7fd66e7fc640 1 -- 172.21.15.120:0/2647850545 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd6700b2070 con 0x7fd6780b0670 2024-04-01T00:12:46.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.798+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd6780d00f0 con 0x7fd65c06c8f0 2024-04-01T00:12:46.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.799+0000 7fd66e7fc640 1 -- 172.21.15.120:0/2647850545 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd6780d00f0 con 0x7fd65c06c8f0 2024-04-01T00:12:46.801 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 3 to deep-scrub 2024-04-01T00:12:46.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.802+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd65c06c8f0 msgr2=0x7fd65c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:46.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.802+0000 7fd67fc29640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd65c06c8f0 0x7fd65c06edb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd674000f60 tx=0x7fd674009040 comp rx=0 tx=0).stop 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.802+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6780b0670 msgr2=0x7fd67809b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.802+0000 7fd67fc29640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6780b0670 0x7fd67809b6e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd67815ee70 tx=0x7fd670004a40 comp rx=0 tx=0).stop 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.803+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 shutdown_connections 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.803+0000 7fd67fc29640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fd65c06c8f0 0x7fd65c06edb0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.803+0000 7fd67fc29640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6780b0670 0x7fd67809b6e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.803+0000 7fd67fc29640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd678070120 0x7fd67809b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.803+0000 7fd67fc29640 1 --2- 172.21.15.120:0/2647850545 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67806bc80 0x7fd67813aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.803+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 >> 172.21.15.120:0/2647850545 conn(0x7fd6780b65a0 msgr2=0x7fd6780b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:46.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.803+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 shutdown_connections 2024-04-01T00:12:46.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:46.803+0000 7fd67fc29640 1 -- 172.21.15.120:0/2647850545 wait complete. 2024-04-01T00:12:46.829 INFO:tasks.ceph:Scrubbing osd.4 2024-04-01T00:12:46.829 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-01T00:12:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.114+0000 7f96a05f6640 1 Processor -- start 2024-04-01T00:12:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.114+0000 7f96a05f6640 1 -- start start 2024-04-01T00:12:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.117+0000 7f96a05f6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f96980d05b0 0x7f96980d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.117+0000 7f96a05f6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9698162380 con 0x7f969806ffb0 2024-04-01T00:12:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.117+0000 7f96a05f6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96980d0ed0 con 0x7f9698162e20 2024-04-01T00:12:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.117+0000 7f96a05f6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f9698070830 con 0x7f96980d05b0 2024-04-01T00:12:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.117+0000 7f969e392640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f96980d05b0 0x7f96980d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.117+0000 7f969db91640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f969806ffb0 0x7f96980cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54310/0 (socket says 172.21.15.120:54310) 2024-04-01T00:12:47.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.117+0000 7f969db91640 1 -- 172.21.15.120:0/4025174803 learned_addr learned my addr 172.21.15.120:0/4025174803 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:47.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.118+0000 7f969d390640 1 -- 172.21.15.120:0/4025174803 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51026777 0 0) 0x7f96980d0ed0 con 0x7f9698162e20 2024-04-01T00:12:47.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.118+0000 7f969d390640 1 -- 172.21.15.120:0/4025174803 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9680003520 con 0x7f9698162e20 2024-04-01T00:12:47.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.118+0000 7f969d390640 1 -- 172.21.15.120:0/4025174803 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1532424381 0 0) 0x7f9698162380 con 0x7f969806ffb0 2024-04-01T00:12:47.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.118+0000 7f969e392640 1 -- 172.21.15.120:0/4025174803 >> v1:172.21.15.203:6789/0 conn(0x7f9698162e20 legacy=0x7f96980cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.118+0000 7f969e392640 1 -- 172.21.15.120:0/4025174803 >> v1:172.21.15.120:6789/0 conn(0x7f969806ffb0 legacy=0x7f96980cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.118+0000 7f969e392640 1 -- 172.21.15.120:0/4025174803 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9698070550 con 0x7f96980d05b0 2024-04-01T00:12:47.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.121+0000 7f969e392640 1 --2- 172.21.15.120:0/4025174803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96980d05b0 0x7f96980d0990 secure :-1 s=READY pgs=3258 cs=0 l=1 rev1=1 crypto rx=0x7f9688009d90 tx=0x7f968802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b69d4851474d58 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:47.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.121+0000 7f969d390640 1 -- 172.21.15.120:0/4025174803 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688039070 con 0x7f96980d05b0 2024-04-01T00:12:47.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.121+0000 7f969d390640 1 -- 172.21.15.120:0/4025174803 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968802cc60 con 0x7f96980d05b0 2024-04-01T00:12:47.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.121+0000 7f969d390640 1 -- 172.21.15.120:0/4025174803 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688034660 con 0x7f96980d05b0 2024-04-01T00:12:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.122+0000 7f96a05f6640 1 -- 172.21.15.120:0/4025174803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96980d05b0 msgr2=0x7f96980d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.122+0000 7f96a05f6640 1 --2- 172.21.15.120:0/4025174803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96980d05b0 0x7f96980d0990 secure :-1 s=READY pgs=3258 cs=0 l=1 rev1=1 crypto rx=0x7f9688009d90 tx=0x7f968802beb0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.123+0000 7f96a05f6640 1 -- 172.21.15.120:0/4025174803 shutdown_connections 2024-04-01T00:12:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.123+0000 7f96a05f6640 1 --2- 172.21.15.120:0/4025174803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96980d05b0 0x7f96980d0990 unknown :-1 s=CLOSED pgs=3258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.123+0000 7f96a05f6640 1 -- 172.21.15.120:0/4025174803 >> 172.21.15.120:0/4025174803 conn(0x7f96980b2d40 msgr2=0x7f96980b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:47.124 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.123+0000 7f96a05f6640 1 -- 172.21.15.120:0/4025174803 shutdown_connections 2024-04-01T00:12:47.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.123+0000 7f96a05f6640 1 -- 172.21.15.120:0/4025174803 wait complete. 2024-04-01T00:12:47.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.126+0000 7f96a05f6640 1 Processor -- start 2024-04-01T00:12:47.127 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.126+0000 7f96a05f6640 1 -- start start 2024-04-01T00:12:47.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f96a05f6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969806ffb0 0x7f96980b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f96a05f6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96980d05b0 0x7f96980caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f96a05f6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9698162e20 0x7f96980cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f96a05f6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9698162900 con 0x7f9698162e20 2024-04-01T00:12:47.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f96a05f6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9698161fc0 con 0x7f96980d05b0 2024-04-01T00:12:47.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f96a05f6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f96980cd480 con 0x7f969806ffb0 2024-04-01T00:12:47.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f969eb93640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9698162e20 0x7f96980cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f969eb93640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9698162e20 0x7f96980cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43444/0 (socket says 172.21.15.120:43444) 2024-04-01T00:12:47.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f969e392640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969806ffb0 0x7f96980b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f969db91640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96980d05b0 0x7f96980caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.128+0000 7f969eb93640 1 -- 172.21.15.120:0/3507366019 learned_addr learned my addr 172.21.15.120:0/3507366019 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.129+0000 7f969db91640 1 -- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969806ffb0 msgr2=0x7f96980b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.129+0000 7f969db91640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969806ffb0 0x7f96980b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.129+0000 7f969db91640 1 -- 172.21.15.120:0/3507366019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9698162e20 msgr2=0x7f96980cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.129+0000 7f969db91640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9698162e20 0x7f96980cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.129+0000 7f969db91640 1 -- 172.21.15.120:0/3507366019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969814c1b0 con 0x7f96980d05b0 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.129+0000 7f969e392640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969806ffb0 0x7f96980b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.129+0000 7f969db91640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96980d05b0 0x7f96980caad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c3e0 tx=0x7f968c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.130+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c0074e0 con 0x7f96980d05b0 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.130+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c0047e0 con 0x7f96980d05b0 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.130+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96980b6040 con 0x7f96980d05b0 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.130+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c004bd0 con 0x7f96980d05b0 2024-04-01T00:12:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.130+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96980b6600 con 0x7f96980d05b0 2024-04-01T00:12:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.132+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9698068cd0 con 0x7f96980d05b0 2024-04-01T00:12:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.133+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f968c011070 con 0x7f96980d05b0 2024-04-01T00:12:47.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.134+0000 7f9696ffd640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f968406c8f0 0x7f968406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.134+0000 7f969e392640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f968406c8f0 0x7f968406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.134+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f968c08b320 con 0x7f96980d05b0 2024-04-01T00:12:47.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.134+0000 7f9696ffd640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f96840727b0 0x7f9684074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.134+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 --> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f968c01ce80 con 0x7f96840727b0 2024-04-01T00:12:47.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.134+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f968c092050 con 0x7f96980d05b0 2024-04-01T00:12:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.135+0000 7f969eb93640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f96840727b0 0x7f9684074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.135+0000 7f969e392640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f968406c8f0 0x7f968406edb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9688036000 tx=0x7f9688030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.135+0000 7f969eb93640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f96840727b0 0x7f9684074bd0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.136+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 <== osd.4 v2:172.21.15.203:6800/1708181719 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f968c01ce80 con 0x7f96840727b0 2024-04-01T00:12:47.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.174+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 --> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f96980cef70 con 0x7f96840727b0 2024-04-01T00:12:47.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.174+0000 7f9696ffd640 1 -- 172.21.15.120:0/3507366019 <== osd.4 v2:172.21.15.203:6800/1708181719 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f96980cef70 con 0x7f96840727b0 2024-04-01T00:12:47.176 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-01T00:12:47.176 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T00:12:47.176 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-01T00:12:47.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f96840727b0 msgr2=0x7f9684074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f96a05f6640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:6800/1708181719,v1:172.21.15.203:6801/1708181719] conn(0x7f96840727b0 0x7f9684074bd0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f968406c8f0 msgr2=0x7f968406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f96a05f6640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f968406c8f0 0x7f968406edb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9688036000 tx=0x7f9688030000 comp rx=0 tx=0).stop 2024-04-01T00:12:47.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96980d05b0 msgr2=0x7f96980caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f96a05f6640 1 --2- 172.21.15.120:0/3507366019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96980d05b0 0x7f96980caad0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f968c00c3e0 tx=0x7f968c00c8a0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f969eb93640 1 -- 172.21.15.120:0/3507366019 reap_dead start 2024-04-01T00:12:47.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 shutdown_connections 2024-04-01T00:12:47.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.175+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 >> 172.21.15.120:0/3507366019 conn(0x7f96980b2d40 msgr2=0x7f96980b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:47.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.176+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 shutdown_connections 2024-04-01T00:12:47.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.176+0000 7f96a05f6640 1 -- 172.21.15.120:0/3507366019 wait complete. 2024-04-01T00:12:47.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-01T00:12:47.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.474+0000 7faba9c86640 1 Processor -- start 2024-04-01T00:12:47.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.474+0000 7faba9c86640 1 -- start start 2024-04-01T00:12:47.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.476+0000 7faba9c86640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7faba415b260 0x7faba40b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.476+0000 7faba9c86640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba40affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.476+0000 7faba9c86640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7faba40b45f0 0x7faba40b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba9c86640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7faba415ff50 con 0x7faba415b260 2024-04-01T00:12:47.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba9c86640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7faba415f340 con 0x7faba40b45f0 2024-04-01T00:12:47.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba9c86640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faba415f620 con 0x7faba415b640 2024-04-01T00:12:47.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba37fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7faba415b260 0x7faba40b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba3fff640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7faba40b45f0 0x7faba40b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba2ffd640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba40affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba37fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7faba415b260 0x7faba40b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43454/0 (socket says 172.21.15.120:43454) 2024-04-01T00:12:47.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba37fe640 1 -- 172.21.15.120:0/2711080284 learned_addr learned my addr 172.21.15.120:0/2711080284 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:47.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba3fff640 1 -- 172.21.15.120:0/2711080284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 msgr2=0x7faba40affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:47.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba3fff640 1 --2- 172.21.15.120:0/2711080284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba40affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba3fff640 1 -- 172.21.15.120:0/2711080284 >> v2:172.21.15.120:3300/0 conn(0x7faba415b260 msgr2=0x7faba40b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:47.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba3fff640 1 --2- 172.21.15.120:0/2711080284 >> v2:172.21.15.120:3300/0 conn(0x7faba415b260 0x7faba40b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba3fff640 1 -- 172.21.15.120:0/2711080284 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba415f900 con 0x7faba40b45f0 2024-04-01T00:12:47.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.477+0000 7faba37fe640 1 --2- 172.21.15.120:0/2711080284 >> v2:172.21.15.120:3300/0 conn(0x7faba415b260 0x7faba40b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:47.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.479+0000 7faba3fff640 1 --2- 172.21.15.120:0/2711080284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba40b45f0 0x7faba40b04e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faba4070760 tx=0x7fab9c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c1700ffa42a0af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:47.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.480+0000 7faba27fc640 1 -- 172.21.15.120:0/2711080284 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c039070 con 0x7faba40b45f0 2024-04-01T00:12:47.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.480+0000 7faba27fc640 1 -- 172.21.15.120:0/2711080284 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c02cbd0 con 0x7faba40b45f0 2024-04-01T00:12:47.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.480+0000 7faba27fc640 1 -- 172.21.15.120:0/2711080284 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c034440 con 0x7faba40b45f0 2024-04-01T00:12:47.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 -- 172.21.15.120:0/2711080284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba40b45f0 msgr2=0x7faba40b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 --2- 172.21.15.120:0/2711080284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba40b45f0 0x7faba40b04e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faba4070760 tx=0x7fab9c02be20 comp rx=0 tx=0).stop 2024-04-01T00:12:47.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 -- 172.21.15.120:0/2711080284 shutdown_connections 2024-04-01T00:12:47.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 --2- 172.21.15.120:0/2711080284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba40b45f0 0x7faba40b04e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 --2- 172.21.15.120:0/2711080284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba40affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 --2- 172.21.15.120:0/2711080284 >> v2:172.21.15.120:3300/0 conn(0x7faba415b260 0x7faba40b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 -- 172.21.15.120:0/2711080284 >> 172.21.15.120:0/2711080284 conn(0x7faba40b65a0 msgr2=0x7faba40b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:47.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 -- 172.21.15.120:0/2711080284 shutdown_connections 2024-04-01T00:12:47.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.481+0000 7faba9c86640 1 -- 172.21.15.120:0/2711080284 wait complete. 2024-04-01T00:12:47.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.484+0000 7faba9c86640 1 Processor -- start 2024-04-01T00:12:47.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.485+0000 7faba9c86640 1 -- start start 2024-04-01T00:12:47.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.486+0000 7faba9c86640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faba40b45f0 0x7faba40cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.486+0000 7faba9c86640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba415b260 0x7faba415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.486+0000 7faba9c86640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba9c86640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faba406e770 con 0x7faba40b45f0 2024-04-01T00:12:47.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba9c86640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faba415f010 con 0x7faba415b260 2024-04-01T00:12:47.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba9c86640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faba40d1160 con 0x7faba415b640 2024-04-01T00:12:47.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faba40b45f0 0x7faba40cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba3fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faba40b45f0 0x7faba40cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43458/0 (socket says 172.21.15.120:43458) 2024-04-01T00:12:47.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba415b260 0x7faba415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba37fe640 1 -- 172.21.15.120:0/2623379388 learned_addr learned my addr 172.21.15.120:0/2623379388 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:47.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba3fff640 1 -- 172.21.15.120:0/2623379388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba415b260 msgr2=0x7faba415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba3fff640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba415b260 0x7faba415c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba3fff640 1 -- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faba40b45f0 msgr2=0x7faba40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:47.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba3fff640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faba40b45f0 0x7faba40cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:47.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba3fff640 1 -- 172.21.15.120:0/2623379388 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba415dcb0 con 0x7faba415b640 2024-04-01T00:12:47.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba2ffd640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba415b260 0x7faba415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:47.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.487+0000 7faba37fe640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faba40b45f0 0x7faba40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:47.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.488+0000 7faba3fff640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba414e6b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faba415f4c0 tx=0x7fab9c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:47.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.488+0000 7fab9bfff640 1 -- 172.21.15.120:0/2623379388 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c039050 con 0x7faba415b640 2024-04-01T00:12:47.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.488+0000 7fab9bfff640 1 -- 172.21.15.120:0/2623379388 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c045070 con 0x7faba415b640 2024-04-01T00:12:47.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.488+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba415cc10 con 0x7faba415b640 2024-04-01T00:12:47.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.488+0000 7fab9bfff640 1 -- 172.21.15.120:0/2623379388 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c009450 con 0x7faba415b640 2024-04-01T00:12:47.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.488+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faba415d1d0 con 0x7faba415b640 2024-04-01T00:12:47.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.491+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba4068cd0 con 0x7faba415b640 2024-04-01T00:12:47.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.491+0000 7fab9bfff640 1 -- 172.21.15.120:0/2623379388 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab9c03e850 con 0x7faba415b640 2024-04-01T00:12:47.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.492+0000 7fab9bfff640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab8406c8f0 0x7fab8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:47.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.492+0000 7faba37fe640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab8406c8f0 0x7fab8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:47.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.492+0000 7fab9bfff640 1 -- 172.21.15.120:0/2623379388 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fab9c0ae340 con 0x7faba415b640 2024-04-01T00:12:47.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.493+0000 7faba37fe640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab8406c8f0 0x7fab8406edb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fab940113d0 tx=0x7fab94009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:47.498 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:47.497+0000 7fab9bfff640 1 -- 172.21.15.120:0/2623379388 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fab9c07c5d0 con 0x7faba415b640 2024-04-01T00:12:48.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.059+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7faba4151c30 con 0x7fab8406c8f0 2024-04-01T00:12:48.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.059+0000 7fab9bfff640 1 -- 172.21.15.120:0/2623379388 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faba4151c30 con 0x7fab8406c8f0 2024-04-01T00:12:48.061 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 4 to deep-scrub 2024-04-01T00:12:48.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab8406c8f0 msgr2=0x7fab8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab8406c8f0 0x7fab8406edb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fab940113d0 tx=0x7fab94009240 comp rx=0 tx=0).stop 2024-04-01T00:12:48.065 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 msgr2=0x7faba414e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba414e6b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faba415f4c0 tx=0x7fab9c004a40 comp rx=0 tx=0).stop 2024-04-01T00:12:48.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 shutdown_connections 2024-04-01T00:12:48.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fab8406c8f0 0x7fab8406edb0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faba415b640 0x7faba414e6b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faba415b260 0x7faba415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 --2- 172.21.15.120:0/2623379388 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faba40b45f0 0x7faba40cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.063+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 >> 172.21.15.120:0/2623379388 conn(0x7faba40b65a0 msgr2=0x7faba41579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:48.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.064+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 shutdown_connections 2024-04-01T00:12:48.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.064+0000 7faba9c86640 1 -- 172.21.15.120:0/2623379388 wait complete. 2024-04-01T00:12:48.089 INFO:tasks.ceph:Scrubbing osd.5 2024-04-01T00:12:48.089 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-01T00:12:48.374 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.373+0000 7fe7195d6640 1 Processor -- start 2024-04-01T00:12:48.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.373+0000 7fe7195d6640 1 -- start start 2024-04-01T00:12:48.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.375+0000 7fe7195d6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe7140cd330 0x7fe71415ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.375+0000 7fe7195d6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7140cef70 con 0x7fe7140d05b0 2024-04-01T00:12:48.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.375+0000 7fe7195d6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71406b710 con 0x7fe7140b0360 2024-04-01T00:12:48.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.375+0000 7fe7195d6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fe71406c320 con 0x7fe7140cd330 2024-04-01T00:12:48.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.375+0000 7fe7137fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe7140cd330 0x7fe71415ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.375+0000 7fe712ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe7140d05b0 0x7fe7140d0990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54322/0 (socket says 172.21.15.120:54322) 2024-04-01T00:12:48.377 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.375+0000 7fe712ffd640 1 -- 172.21.15.120:0/3796881797 learned_addr learned my addr 172.21.15.120:0/3796881797 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:48.378 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.376+0000 7fe7137fe640 1 -- 172.21.15.120:0/3796881797 >> v1:172.21.15.203:6789/0 conn(0x7fe7140b0360 legacy=0x7fe714162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.376+0000 7fe7137fe640 1 -- 172.21.15.120:0/3796881797 >> v1:172.21.15.120:6789/0 conn(0x7fe7140d05b0 legacy=0x7fe7140d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.376+0000 7fe7137fe640 1 -- 172.21.15.120:0/3796881797 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71406b9f0 con 0x7fe7140cd330 2024-04-01T00:12:48.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.377+0000 7fe7137fe640 1 --2- 172.21.15.120:0/3796881797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140cd330 0x7fe71415ee00 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0097d0 tx=0x7fe70c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601666f43d2a4956 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:48.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.377+0000 7fe711ffb640 1 -- 172.21.15.120:0/3796881797 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c034070 con 0x7fe7140cd330 2024-04-01T00:12:48.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.377+0000 7fe711ffb640 1 -- 172.21.15.120:0/3796881797 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c030800 con 0x7fe7140cd330 2024-04-01T00:12:48.379 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.377+0000 7fe711ffb640 1 -- 172.21.15.120:0/3796881797 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c030bd0 con 0x7fe7140cd330 2024-04-01T00:12:48.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.379+0000 7fe7195d6640 1 -- 172.21.15.120:0/3796881797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140cd330 msgr2=0x7fe71415ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.379+0000 7fe7195d6640 1 --2- 172.21.15.120:0/3796881797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140cd330 0x7fe71415ee00 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0097d0 tx=0x7fe70c02b940 comp rx=0 tx=0).stop 2024-04-01T00:12:48.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.379+0000 7fe7195d6640 1 -- 172.21.15.120:0/3796881797 shutdown_connections 2024-04-01T00:12:48.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.379+0000 7fe7195d6640 1 --2- 172.21.15.120:0/3796881797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140cd330 0x7fe71415ee00 unknown :-1 s=CLOSED pgs=3260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.379+0000 7fe7195d6640 1 -- 172.21.15.120:0/3796881797 >> 172.21.15.120:0/3796881797 conn(0x7fe7140b2d40 msgr2=0x7fe7140b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:48.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.379+0000 7fe7195d6640 1 -- 172.21.15.120:0/3796881797 shutdown_connections 2024-04-01T00:12:48.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.379+0000 7fe7195d6640 1 -- 172.21.15.120:0/3796881797 wait complete. 2024-04-01T00:12:48.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.381+0000 7fe7195d6640 1 Processor -- start 2024-04-01T00:12:48.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.381+0000 7fe7195d6640 1 -- start start 2024-04-01T00:12:48.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe7195d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140b0360 0x7fe7140c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe7195d6640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7140cd330 0x7fe714150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe7195d6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7140d05b0 0x7fe71415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe7195d6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe714070670 con 0x7fe7140b0360 2024-04-01T00:12:48.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe7195d6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe71406bfb0 con 0x7fe7140d05b0 2024-04-01T00:12:48.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe7195d6640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7140707f0 con 0x7fe7140cd330 2024-04-01T00:12:48.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe712ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140b0360 0x7fe7140c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe712ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140b0360 0x7fe7140c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43478/0 (socket says 172.21.15.120:43478) 2024-04-01T00:12:48.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.382+0000 7fe712ffd640 1 -- 172.21.15.120:0/523914941 learned_addr learned my addr 172.21.15.120:0/523914941 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:48.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.383+0000 7fe7137fe640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7140d05b0 0x7fe71415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.383+0000 7fe7127fc640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7140cd330 0x7fe714150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.383+0000 7fe712ffd640 1 -- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7140cd330 msgr2=0x7fe714150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.383+0000 7fe712ffd640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7140cd330 0x7fe714150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.383+0000 7fe712ffd640 1 -- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7140d05b0 msgr2=0x7fe71415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.383+0000 7fe712ffd640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7140d05b0 0x7fe71415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.383+0000 7fe712ffd640 1 -- 172.21.15.120:0/523914941 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7140c7580 con 0x7fe7140b0360 2024-04-01T00:12:48.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.383+0000 7fe712ffd640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140b0360 0x7fe7140c4ca0 secure :-1 s=READY pgs=3261 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c480 tx=0x7fe70400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:48.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.384+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704017070 con 0x7fe7140b0360 2024-04-01T00:12:48.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.384+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe704005ce0 con 0x7fe7140b0360 2024-04-01T00:12:48.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.384+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7040072d0 con 0x7fe7140b0360 2024-04-01T00:12:48.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.384+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7140c5360 con 0x7fe7140b0360 2024-04-01T00:12:48.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.384+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7140c5920 con 0x7fe7140b0360 2024-04-01T00:12:48.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.386+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe714068cd0 con 0x7fe7140b0360 2024-04-01T00:12:48.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.388+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe70401a070 con 0x7fe7140b0360 2024-04-01T00:12:48.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.388+0000 7fe6fb7fe640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe70006c8f0 0x7fe70006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.388+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fe70408abb0 con 0x7fe7140b0360 2024-04-01T00:12:48.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.388+0000 7fe7127fc640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe70006c8f0 0x7fe70006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.388+0000 7fe6fb7fe640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fe7000727b0 0x7fe700074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.388+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 --> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe704013e50 con 0x7fe7000727b0 2024-04-01T00:12:48.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.388+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe70408f2c0 con 0x7fe7140b0360 2024-04-01T00:12:48.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.389+0000 7fe7137fe640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fe7000727b0 0x7fe700074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.389+0000 7fe7127fc640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe70006c8f0 0x7fe70006edb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe71415af00 tx=0x7fe708009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:48.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.390+0000 7fe7137fe640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fe7000727b0 0x7fe700074bd0 crc :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:48.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.390+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 <== osd.5 v2:172.21.15.203:6808/887331617 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe704013e50 con 0x7fe7000727b0 2024-04-01T00:12:48.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.428+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 --> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7140b1b00 con 0x7fe7000727b0 2024-04-01T00:12:48.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.429+0000 7fe6fb7fe640 1 -- 172.21.15.120:0/523914941 <== osd.5 v2:172.21.15.203:6808/887331617 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe7140b1b00 con 0x7fe7000727b0 2024-04-01T00:12:48.430 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-01T00:12:48.431 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T00:12:48.431 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-01T00:12:48.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.429+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fe7000727b0 msgr2=0x7fe700074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.429+0000 7fe7195d6640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.203:6808/887331617,v1:172.21.15.203:6809/887331617] conn(0x7fe7000727b0 0x7fe700074bd0 crc :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe70006c8f0 msgr2=0x7fe70006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7195d6640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fe70006c8f0 0x7fe70006edb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe71415af00 tx=0x7fe708009040 comp rx=0 tx=0).stop 2024-04-01T00:12:48.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140b0360 msgr2=0x7fe7140c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7195d6640 1 --2- 172.21.15.120:0/523914941 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe7140b0360 0x7fe7140c4ca0 secure :-1 s=READY pgs=3261 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c480 tx=0x7fe70400c940 comp rx=0 tx=0).stop 2024-04-01T00:12:48.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7137fe640 1 -- 172.21.15.120:0/523914941 reap_dead start 2024-04-01T00:12:48.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 shutdown_connections 2024-04-01T00:12:48.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 >> 172.21.15.120:0/523914941 conn(0x7fe7140b2d40 msgr2=0x7fe714162b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:48.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 shutdown_connections 2024-04-01T00:12:48.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.430+0000 7fe7195d6640 1 -- 172.21.15.120:0/523914941 wait complete. 2024-04-01T00:12:48.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-01T00:12:48.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.730+0000 7fcd5d1e2640 1 Processor -- start 2024-04-01T00:12:48.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.731+0000 7fcd5d1e2640 1 -- start start 2024-04-01T00:12:48.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.733+0000 7fcd5d1e2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fcd5815b260 0x7fcd580b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.733+0000 7fcd5d1e2640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd5815ff50 con 0x7fcd5815b640 2024-04-01T00:12:48.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.733+0000 7fcd5d1e2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd5815f340 con 0x7fcd580b06b0 2024-04-01T00:12:48.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.733+0000 7fcd5d1e2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fcd5815f620 con 0x7fcd5815b260 2024-04-01T00:12:48.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.733+0000 7fcd5659c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcd5815b640 0x7fcd580affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54324/0 (socket says 172.21.15.120:54324) 2024-04-01T00:12:48.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.733+0000 7fcd5659c640 1 -- 172.21.15.120:0/4216896736 learned_addr learned my addr 172.21.15.120:0/4216896736 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:48.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.733+0000 7fcd56d9d640 1 --2- 172.21.15.120:0/4216896736 >> v2:172.21.15.120:3300/0 conn(0x7fcd5815b260 0x7fcd580b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.734+0000 7fcd55d9b640 1 -- 172.21.15.120:0/4216896736 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102831838 0 0) 0x7fcd5815ff50 con 0x7fcd5815b640 2024-04-01T00:12:48.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.734+0000 7fcd55d9b640 1 -- 172.21.15.120:0/4216896736 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd44003520 con 0x7fcd5815b640 2024-04-01T00:12:48.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.734+0000 7fcd55d9b640 1 -- 172.21.15.120:0/4216896736 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645767463 0 0) 0x7fcd5815f340 con 0x7fcd580b06b0 2024-04-01T00:12:48.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.734+0000 7fcd55d9b640 1 -- 172.21.15.120:0/4216896736 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd5815ff50 con 0x7fcd580b06b0 2024-04-01T00:12:48.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.734+0000 7fcd56d9d640 1 -- 172.21.15.120:0/4216896736 >> v1:172.21.15.203:6789/0 conn(0x7fcd580b06b0 legacy=0x7fcd580aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.734+0000 7fcd56d9d640 1 -- 172.21.15.120:0/4216896736 >> v1:172.21.15.120:6789/0 conn(0x7fcd5815b640 legacy=0x7fcd580affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.734+0000 7fcd56d9d640 1 -- 172.21.15.120:0/4216896736 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5815f900 con 0x7fcd5815b260 2024-04-01T00:12:48.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.736+0000 7fcd56d9d640 1 --2- 172.21.15.120:0/4216896736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd5815b260 0x7fcd580b40b0 secure :-1 s=READY pgs=3263 cs=0 l=1 rev1=1 crypto rx=0x7fcd480097a0 tx=0x7fcd4802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146180e2c923c12d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:48.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.736+0000 7fcd55d9b640 1 -- 172.21.15.120:0/4216896736 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48034070 con 0x7fcd5815b260 2024-04-01T00:12:48.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.736+0000 7fcd55d9b640 1 -- 172.21.15.120:0/4216896736 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48030610 con 0x7fcd5815b260 2024-04-01T00:12:48.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.736+0000 7fcd55d9b640 1 -- 172.21.15.120:0/4216896736 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd480309e0 con 0x7fcd5815b260 2024-04-01T00:12:48.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.737+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/4216896736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd5815b260 msgr2=0x7fcd580b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.738+0000 7fcd5d1e2640 1 --2- 172.21.15.120:0/4216896736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd5815b260 0x7fcd580b40b0 secure :-1 s=READY pgs=3263 cs=0 l=1 rev1=1 crypto rx=0x7fcd480097a0 tx=0x7fcd4802b960 comp rx=0 tx=0).stop 2024-04-01T00:12:48.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.738+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/4216896736 shutdown_connections 2024-04-01T00:12:48.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.738+0000 7fcd5d1e2640 1 --2- 172.21.15.120:0/4216896736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd5815b260 0x7fcd580b40b0 unknown :-1 s=CLOSED pgs=3263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.738+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/4216896736 >> 172.21.15.120:0/4216896736 conn(0x7fcd580b65a0 msgr2=0x7fcd580b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:48.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.738+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/4216896736 shutdown_connections 2024-04-01T00:12:48.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.738+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/4216896736 wait complete. 2024-04-01T00:12:48.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.741+0000 7fcd5d1e2640 1 Processor -- start 2024-04-01T00:12:48.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.742+0000 7fcd5d1e2640 1 -- start start 2024-04-01T00:12:48.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.743+0000 7fcd5d1e2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd580b06b0 0x7fcd58148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.743+0000 7fcd5d1e2640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd5815b260 0x7fcd580cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.743+0000 7fcd5d1e2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd5815b640 0x7fcd58155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.743+0000 7fcd5d1e2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5806e770 con 0x7fcd580b06b0 2024-04-01T00:12:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.743+0000 7fcd5d1e2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5815f010 con 0x7fcd5815b640 2024-04-01T00:12:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd5d1e2640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcd580b45f0 con 0x7fcd5815b260 2024-04-01T00:12:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd56d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd580b06b0 0x7fcd58148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd56d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd580b06b0 0x7fcd58148ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43498/0 (socket says 172.21.15.120:43498) 2024-04-01T00:12:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd56d9d640 1 -- 172.21.15.120:0/1147581213 learned_addr learned my addr 172.21.15.120:0/1147581213 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd5659c640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd5815b260 0x7fcd580cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd5759e640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd5815b640 0x7fcd58155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd5659c640 1 -- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd5815b640 msgr2=0x7fcd58155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd5659c640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd5815b640 0x7fcd58155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd5659c640 1 -- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd580b06b0 msgr2=0x7fcd58148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:48.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd5659c640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd580b06b0 0x7fcd58148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:48.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd5659c640 1 -- 172.21.15.120:0/1147581213 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd58158a80 con 0x7fcd5815b260 2024-04-01T00:12:48.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.744+0000 7fcd56d9d640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd580b06b0 0x7fcd58148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:48.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.745+0000 7fcd5659c640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd5815b260 0x7fcd580cd290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c390 tx=0x7fcd4000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:48.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.745+0000 7fcd4f7fe640 1 -- 172.21.15.120:0/1147581213 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40017070 con 0x7fcd5815b260 2024-04-01T00:12:48.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.745+0000 7fcd4f7fe640 1 -- 172.21.15.120:0/1147581213 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd40005d00 con 0x7fcd5815b260 2024-04-01T00:12:48.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.745+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd58157700 con 0x7fcd5815b260 2024-04-01T00:12:48.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.745+0000 7fcd4f7fe640 1 -- 172.21.15.120:0/1147581213 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40007310 con 0x7fcd5815b260 2024-04-01T00:12:48.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.745+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd58157cc0 con 0x7fcd5815b260 2024-04-01T00:12:48.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.747+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd580b52f0 con 0x7fcd5815b260 2024-04-01T00:12:48.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.748+0000 7fcd4f7fe640 1 -- 172.21.15.120:0/1147581213 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd4001a070 con 0x7fcd5815b260 2024-04-01T00:12:48.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.749+0000 7fcd4f7fe640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcd3806c8f0 0x7fcd3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:48.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.749+0000 7fcd56d9d640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcd3806c8f0 0x7fcd3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:48.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.749+0000 7fcd4f7fe640 1 -- 172.21.15.120:0/1147581213 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcd4008aab0 con 0x7fcd5815b260 2024-04-01T00:12:48.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.750+0000 7fcd56d9d640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcd3806c8f0 0x7fcd3806edb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009560 tx=0x7fcd4803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:48.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:48.754+0000 7fcd4f7fe640 1 -- 172.21.15.120:0/1147581213 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcd580b52f0 con 0x7fcd5815b260 2024-04-01T00:12:49.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.288+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fcd5815a840 con 0x7fcd3806c8f0 2024-04-01T00:12:49.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.288+0000 7fcd4f7fe640 1 -- 172.21.15.120:0/1147581213 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcd5815a840 con 0x7fcd3806c8f0 2024-04-01T00:12:49.290 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 5 to deep-scrub 2024-04-01T00:12:49.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcd3806c8f0 msgr2=0x7fcd3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcd3806c8f0 0x7fcd3806edb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009560 tx=0x7fcd4803b040 comp rx=0 tx=0).stop 2024-04-01T00:12:49.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd5815b260 msgr2=0x7fcd580cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd5815b260 0x7fcd580cd290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c390 tx=0x7fcd4000c850 comp rx=0 tx=0).stop 2024-04-01T00:12:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 shutdown_connections 2024-04-01T00:12:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fcd3806c8f0 0x7fcd3806edb0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcd5815b640 0x7fcd58155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcd5815b260 0x7fcd580cd290 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.292+0000 7fcd5d1e2640 1 --2- 172.21.15.120:0/1147581213 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd580b06b0 0x7fcd58148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.293+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 >> 172.21.15.120:0/1147581213 conn(0x7fcd580b65a0 msgr2=0x7fcd580b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:49.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.293+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 shutdown_connections 2024-04-01T00:12:49.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.293+0000 7fcd5d1e2640 1 -- 172.21.15.120:0/1147581213 wait complete. 2024-04-01T00:12:49.318 INFO:tasks.ceph:Scrubbing osd.6 2024-04-01T00:12:49.319 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-01T00:12:49.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.604+0000 7f5fa149a640 1 Processor -- start 2024-04-01T00:12:49.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.604+0000 7f5fa149a640 1 -- start start 2024-04-01T00:12:49.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.606+0000 7f5fa149a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06bf80 0x7f5f9c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.606+0000 7f5fa149a640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5f9c06b570 0x7f5f9c0d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.606+0000 7f5fa149a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f9c0cff60 con 0x7f5f9c0d0c80 2024-04-01T00:12:49.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.606+0000 7f5fa149a640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5f9c0d02b0 con 0x7f5f9c06b570 2024-04-01T00:12:49.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.606+0000 7f5fa149a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9c0ce070 con 0x7f5f9c06bf80 2024-04-01T00:12:49.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.606+0000 7f5f9b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5f9c0d0c80 0x7f5f9c160100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54326/0 (socket says 172.21.15.120:54326) 2024-04-01T00:12:49.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.606+0000 7f5f9b7fe640 1 -- 172.21.15.120:0/2553820910 learned_addr learned my addr 172.21.15.120:0/2553820910 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:49.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.607+0000 7f5f9affd640 1 --2- 172.21.15.120:0/2553820910 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06bf80 0x7f5f9c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.607+0000 7f5f9a7fc640 1 --2- 172.21.15.120:0/2553820910 >> v2:172.21.15.203:3300/0 conn(0x7f5f9c06b570 0x7f5f9c0d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.607+0000 7f5f9a7fc640 1 -- 172.21.15.120:0/2553820910 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06bf80 msgr2=0x7f5f9c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:49.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.607+0000 7f5f9a7fc640 1 --2- 172.21.15.120:0/2553820910 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06bf80 0x7f5f9c0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.607+0000 7f5f9a7fc640 1 -- 172.21.15.120:0/2553820910 >> v1:172.21.15.120:6789/0 conn(0x7f5f9c0d0c80 legacy=0x7f5f9c160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.607+0000 7f5f9a7fc640 1 -- 172.21.15.120:0/2553820910 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c0ce340 con 0x7f5f9c06b570 2024-04-01T00:12:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.607+0000 7f5f99ffb640 1 -- 172.21.15.120:0/2553820910 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566293802 0 0) 0x7f5f9c0cff60 con 0x7f5f9c0d0c80 2024-04-01T00:12:49.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.608+0000 7f5f9a7fc640 1 --2- 172.21.15.120:0/2553820910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c06b570 0x7f5f9c0d0740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f8402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f02229a3e532bddc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:49.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.608+0000 7f5f99ffb640 1 -- 172.21.15.120:0/2553820910 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84039070 con 0x7f5f9c06b570 2024-04-01T00:12:49.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.609+0000 7f5f99ffb640 1 -- 172.21.15.120:0/2553820910 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8402cbc0 con 0x7f5f9c06b570 2024-04-01T00:12:49.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.609+0000 7f5f99ffb640 1 -- 172.21.15.120:0/2553820910 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84034440 con 0x7f5f9c06b570 2024-04-01T00:12:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.610+0000 7f5fa149a640 1 -- 172.21.15.120:0/2553820910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c06b570 msgr2=0x7f5f9c0d0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.610+0000 7f5fa149a640 1 --2- 172.21.15.120:0/2553820910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c06b570 0x7f5f9c0d0740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f8402be10 comp rx=0 tx=0).stop 2024-04-01T00:12:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.610+0000 7f5fa149a640 1 -- 172.21.15.120:0/2553820910 shutdown_connections 2024-04-01T00:12:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.610+0000 7f5fa149a640 1 --2- 172.21.15.120:0/2553820910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c06b570 0x7f5f9c0d0740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.610+0000 7f5fa149a640 1 --2- 172.21.15.120:0/2553820910 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06bf80 0x7f5f9c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.610+0000 7f5fa149a640 1 -- 172.21.15.120:0/2553820910 >> 172.21.15.120:0/2553820910 conn(0x7f5f9c0b2d40 msgr2=0x7f5f9c0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:49.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.610+0000 7f5fa149a640 1 -- 172.21.15.120:0/2553820910 shutdown_connections 2024-04-01T00:12:49.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.610+0000 7f5fa149a640 1 -- 172.21.15.120:0/2553820910 wait complete. 2024-04-01T00:12:49.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.613+0000 7f5fa149a640 1 Processor -- start 2024-04-01T00:12:49.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.613+0000 7f5fa149a640 1 -- start start 2024-04-01T00:12:49.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.615+0000 7f5fa149a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06b570 0x7f5f9c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.615+0000 7f5fa149a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f9c06bf80 0x7f5f9c1f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.615+0000 7f5fa149a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c0d0c80 0x7f5f9c0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.615+0000 7f5fa149a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c160810 con 0x7f5f9c06bf80 2024-04-01T00:12:49.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.615+0000 7f5fa149a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c0ce900 con 0x7f5f9c0d0c80 2024-04-01T00:12:49.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.615+0000 7f5fa149a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9c160990 con 0x7f5f9c06b570 2024-04-01T00:12:49.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.615+0000 7f5f9a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f9c06bf80 0x7f5f9c1f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f9c06bf80 0x7f5f9c1f73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43508/0 (socket says 172.21.15.120:43508) 2024-04-01T00:12:49.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9a7fc640 1 -- 172.21.15.120:0/2041158403 learned_addr learned my addr 172.21.15.120:0/2041158403 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:49.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9b7fe640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c0d0c80 0x7f5f9c0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9affd640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06b570 0x7f5f9c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9a7fc640 1 -- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06b570 msgr2=0x7f5f9c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9a7fc640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c06b570 0x7f5f9c15a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9a7fc640 1 -- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c0d0c80 msgr2=0x7f5f9c0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9a7fc640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c0d0c80 0x7f5f9c0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9a7fc640 1 -- 172.21.15.120:0/2041158403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c1571d0 con 0x7f5f9c06bf80 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.616+0000 7f5f9a7fc640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f9c06bf80 0x7f5f9c1f73f0 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.617+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84039050 con 0x7f5f9c06bf80 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.617+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f84045070 con 0x7f5f9c06bf80 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.617+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8403e850 con 0x7f5f9c06bf80 2024-04-01T00:12:49.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.617+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c0c5360 con 0x7f5f9c06bf80 2024-04-01T00:12:49.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.617+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c157470 con 0x7f5f9c06bf80 2024-04-01T00:12:49.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.619+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f9c068cd0 con 0x7f5f9c06bf80 2024-04-01T00:12:49.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.620+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f8403e9f0 con 0x7f5f9c06bf80 2024-04-01T00:12:49.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.621+0000 7f5f937fe640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5f7c06c920 0x7f5f7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.621+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f5f840ae4d0 con 0x7f5f9c06bf80 2024-04-01T00:12:49.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.622+0000 7f5f9affd640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5f7c06c920 0x7f5f7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.622+0000 7f5f937fe640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f5f7c0727e0 0x7f5f7c074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.622+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 --> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f840091a0 con 0x7f5f7c0727e0 2024-04-01T00:12:49.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.622+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5f840b5050 con 0x7f5f9c06bf80 2024-04-01T00:12:49.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.622+0000 7f5f9b7fe640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f5f7c0727e0 0x7f5f7c074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.622+0000 7f5f9affd640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5f7c06c920 0x7f5f7c06ede0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009b40 tx=0x7f5f94009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:49.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.623+0000 7f5f9b7fe640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f5f7c0727e0 0x7f5f7c074c00 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:49.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.624+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 <== osd.6 v2:172.21.15.203:6824/3768882466 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f840091a0 con 0x7f5f7c0727e0 2024-04-01T00:12:49.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.661+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 --> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5f9c0c7e40 con 0x7f5f7c0727e0 2024-04-01T00:12:49.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.662+0000 7f5f937fe640 1 -- 172.21.15.120:0/2041158403 <== osd.6 v2:172.21.15.203:6824/3768882466 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5f9c0c7e40 con 0x7f5f7c0727e0 2024-04-01T00:12:49.664 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-01T00:12:49.664 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T00:12:49.664 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-01T00:12:49.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f5f7c0727e0 msgr2=0x7f5f7c074c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.203:6824/3768882466,v1:172.21.15.203:6825/3768882466] conn(0x7f5f7c0727e0 0x7f5f7c074c00 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5f7c06c920 msgr2=0x7f5f7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f5f7c06c920 0x7f5f7c06ede0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009b40 tx=0x7f5f94009190 comp rx=0 tx=0).stop 2024-04-01T00:12:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f9c06bf80 msgr2=0x7f5f9c1f73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 --2- 172.21.15.120:0/2041158403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f9c06bf80 0x7f5f9c1f73f0 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009d90 tx=0x7f5f84004a40 comp rx=0 tx=0).stop 2024-04-01T00:12:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5f9b7fe640 1 -- 172.21.15.120:0/2041158403 reap_dead start 2024-04-01T00:12:49.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 shutdown_connections 2024-04-01T00:12:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 >> 172.21.15.120:0/2041158403 conn(0x7f5f9c0b2d40 msgr2=0x7f5f9c15bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 shutdown_connections 2024-04-01T00:12:49.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.663+0000 7f5fa149a640 1 -- 172.21.15.120:0/2041158403 wait complete. 2024-04-01T00:12:49.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-01T00:12:49.966 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.965+0000 7fc58c196640 1 Processor -- start 2024-04-01T00:12:49.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.965+0000 7fc58c196640 1 -- start start 2024-04-01T00:12:49.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.967+0000 7fc58c196640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc58415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.967+0000 7fc58c196640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc584070120 0x7fc58406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.967+0000 7fc58c196640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5840b5b10 con 0x7fc58406e770 2024-04-01T00:12:49.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.967+0000 7fc58c196640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7fc5840b63e0 con 0x7fc584070120 2024-04-01T00:12:49.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.967+0000 7fc58c196640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc58406c3f0 con 0x7fc5840b0670 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.968+0000 7fc589731640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc584070120 0x7fc58406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.968+0000 7fc589731640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc584070120 0x7fc58406b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43520/0 (socket says 172.21.15.120:43520) 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.968+0000 7fc58a733640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc58406e770 0x7fc5840d1170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54338/0 (socket says 172.21.15.120:54338) 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.968+0000 7fc589731640 1 -- 172.21.15.120:0/2658061588 learned_addr learned my addr 172.21.15.120:0/2658061588 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.968+0000 7fc589f32640 1 --2- 172.21.15.120:0/2658061588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc58415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.968+0000 7fc588f30640 1 -- 172.21.15.120:0/2658061588 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676333930 0 0) 0x7fc57c001490 con 0x7fc58406e770 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.968+0000 7fc588f30640 1 -- 172.21.15.120:0/2658061588 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc570003520 con 0x7fc58406e770 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.969+0000 7fc589731640 1 -- 172.21.15.120:0/2658061588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 msgr2=0x7fc58415f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:49.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.969+0000 7fc589731640 1 --2- 172.21.15.120:0/2658061588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc58415f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.969+0000 7fc589731640 1 -- 172.21.15.120:0/2658061588 >> v1:172.21.15.120:6789/0 conn(0x7fc58406e770 legacy=0x7fc5840d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.969+0000 7fc589731640 1 -- 172.21.15.120:0/2658061588 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58415fdf0 con 0x7fc584070120 2024-04-01T00:12:49.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.969+0000 7fc589f32640 1 --2- 172.21.15.120:0/2658061588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc58415f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:49.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.971+0000 7fc589731640 1 --2- 172.21.15.120:0/2658061588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 0x7fc58406b570 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098a0 tx=0x7fc57402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31bca59fe985785 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:49.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.971+0000 7fc588f30640 1 -- 172.21.15.120:0/2658061588 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574034070 con 0x7fc584070120 2024-04-01T00:12:49.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.971+0000 7fc588f30640 1 -- 172.21.15.120:0/2658061588 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc574030840 con 0x7fc584070120 2024-04-01T00:12:49.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.971+0000 7fc588f30640 1 -- 172.21.15.120:0/2658061588 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574030c10 con 0x7fc584070120 2024-04-01T00:12:49.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.972+0000 7fc58c196640 1 -- 172.21.15.120:0/2658061588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 msgr2=0x7fc58406b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.972+0000 7fc58c196640 1 --2- 172.21.15.120:0/2658061588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 0x7fc58406b570 secure :-1 s=READY pgs=3267 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098a0 tx=0x7fc57402b980 comp rx=0 tx=0).stop 2024-04-01T00:12:49.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.972+0000 7fc58c196640 1 -- 172.21.15.120:0/2658061588 shutdown_connections 2024-04-01T00:12:49.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.972+0000 7fc58c196640 1 --2- 172.21.15.120:0/2658061588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 0x7fc58406b570 unknown :-1 s=CLOSED pgs=3267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.972+0000 7fc58c196640 1 --2- 172.21.15.120:0/2658061588 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc58415f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.972+0000 7fc58c196640 1 -- 172.21.15.120:0/2658061588 >> 172.21.15.120:0/2658061588 conn(0x7fc5840b65a0 msgr2=0x7fc5840b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:49.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.973+0000 7fc58c196640 1 -- 172.21.15.120:0/2658061588 shutdown_connections 2024-04-01T00:12:49.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.973+0000 7fc58c196640 1 -- 172.21.15.120:0/2658061588 wait complete. 2024-04-01T00:12:49.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.975+0000 7fc58c196640 1 Processor -- start 2024-04-01T00:12:49.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.976+0000 7fc58c196640 1 -- start start 2024-04-01T00:12:49.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc58c196640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc58406e770 0x7fc5840d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc58c196640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 0x7fc5840b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc58c196640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc5840b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc58c196640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc5840b6070 con 0x7fc584070120 2024-04-01T00:12:49.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc58c196640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc5840b5d90 con 0x7fc58406e770 2024-04-01T00:12:49.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc58c196640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc5840b0a50 con 0x7fc5840b0670 2024-04-01T00:12:49.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589731640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 0x7fc5840b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589f32640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc58406e770 0x7fc5840d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc58a733640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc5840b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589f32640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc58406e770 0x7fc5840d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:56790/0 (socket says 172.21.15.120:56790) 2024-04-01T00:12:49.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589731640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 0x7fc5840b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43536/0 (socket says 172.21.15.120:43536) 2024-04-01T00:12:49.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589f32640 1 -- 172.21.15.120:0/747680160 learned_addr learned my addr 172.21.15.120:0/747680160 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:49.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589f32640 1 -- 172.21.15.120:0/747680160 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 msgr2=0x7fc5840b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589f32640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc5840b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589f32640 1 -- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 msgr2=0x7fc5840b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:49.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.978+0000 7fc589f32640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 0x7fc5840b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:49.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.979+0000 7fc589f32640 1 -- 172.21.15.120:0/747680160 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc584142f90 con 0x7fc58406e770 2024-04-01T00:12:49.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.979+0000 7fc58a733640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc5840b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:49.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.979+0000 7fc589f32640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc58406e770 0x7fc5840d03f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc58000e960 tx=0x7fc58000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:49.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.979+0000 7fc57a7fc640 1 -- 172.21.15.120:0/747680160 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580017070 con 0x7fc58406e770 2024-04-01T00:12:49.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.979+0000 7fc57a7fc640 1 -- 172.21.15.120:0/747680160 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58000ca00 con 0x7fc58406e770 2024-04-01T00:12:49.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.979+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5840cdd10 con 0x7fc58406e770 2024-04-01T00:12:49.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.979+0000 7fc57a7fc640 1 -- 172.21.15.120:0/747680160 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58000cdd0 con 0x7fc58406e770 2024-04-01T00:12:49.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.980+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5840d0930 con 0x7fc58406e770 2024-04-01T00:12:49.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.981+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc584068cd0 con 0x7fc58406e770 2024-04-01T00:12:49.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.982+0000 7fc57a7fc640 1 -- 172.21.15.120:0/747680160 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc58001a070 con 0x7fc58406e770 2024-04-01T00:12:49.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.983+0000 7fc57a7fc640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc56806c920 0x7fc56806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:49.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.983+0000 7fc589731640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc56806c920 0x7fc56806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:49.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.983+0000 7fc57a7fc640 1 -- 172.21.15.120:0/747680160 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fc58008b660 con 0x7fc58406e770 2024-04-01T00:12:49.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.984+0000 7fc589731640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc56806c920 0x7fc56806ede0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc574036000 tx=0x7fc574008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:49.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:49.988+0000 7fc57a7fc640 1 -- 172.21.15.120:0/747680160 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc580059730 con 0x7fc58406e770 2024-04-01T00:12:50.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.522+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc584143270 con 0x7fc56806c920 2024-04-01T00:12:50.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.523+0000 7fc57a7fc640 1 -- 172.21.15.120:0/747680160 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc584143270 con 0x7fc56806c920 2024-04-01T00:12:50.524 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 6 to deep-scrub 2024-04-01T00:12:50.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc56806c920 msgr2=0x7fc56806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc56806c920 0x7fc56806ede0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc574036000 tx=0x7fc574008030 comp rx=0 tx=0).stop 2024-04-01T00:12:50.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc58406e770 msgr2=0x7fc5840d03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc58406e770 0x7fc5840d03f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc58000e960 tx=0x7fc58000ee20 comp rx=0 tx=0).stop 2024-04-01T00:12:50.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 shutdown_connections 2024-04-01T00:12:50.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fc56806c920 0x7fc56806ede0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:50.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc5840b0670 0x7fc5840b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:50.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc584070120 0x7fc5840b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:50.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 --2- 172.21.15.120:0/747680160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc58406e770 0x7fc5840d03f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:50.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 >> 172.21.15.120:0/747680160 conn(0x7fc5840b65a0 msgr2=0x7fc58415ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:50.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 shutdown_connections 2024-04-01T00:12:50.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.527+0000 7fc58c196640 1 -- 172.21.15.120:0/747680160 wait complete. 2024-04-01T00:12:50.553 INFO:tasks.ceph:Scrubbing osd.7 2024-04-01T00:12:50.553 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-01T00:12:50.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.838+0000 7fa7ca851640 1 Processor -- start 2024-04-01T00:12:50.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.838+0000 7fa7ca851640 1 -- start start 2024-04-01T00:12:50.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.840+0000 7fa7ca851640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c415f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:50.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.840+0000 7fa7ca851640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c415e800 con 0x7fa7c406c260 2024-04-01T00:12:50.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.840+0000 7fa7ca851640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c40b2bb0 con 0x7fa7c406b570 2024-04-01T00:12:50.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.840+0000 7fa7ca851640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c415ea70 con 0x7fa7c4145e70 2024-04-01T00:12:50.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.840+0000 7fa7c8dee640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fa7c406b570 0x7fa7c40af990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:38594/0 (socket says 172.21.15.120:38594) 2024-04-01T00:12:50.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.840+0000 7fa7c3fff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c415f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:50.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.840+0000 7fa7c8dee640 1 -- 172.21.15.120:0/808322667 learned_addr learned my addr 172.21.15.120:0/808322667 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:50.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.840+0000 7fa7c37fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa7c406c260 0x7fa7c40b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54344/0 (socket says 172.21.15.120:54344) 2024-04-01T00:12:50.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.841+0000 7fa7c2ffd640 1 -- 172.21.15.120:0/808322667 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677355191 0 0) 0x7fa7c40b2bb0 con 0x7fa7c406b570 2024-04-01T00:12:50.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.841+0000 7fa7c3fff640 1 -- 172.21.15.120:0/808322667 >> v1:172.21.15.203:6789/0 conn(0x7fa7c406b570 legacy=0x7fa7c40af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.841+0000 7fa7c3fff640 1 -- 172.21.15.120:0/808322667 >> v1:172.21.15.120:6789/0 conn(0x7fa7c406c260 legacy=0x7fa7c40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.841+0000 7fa7c3fff640 1 -- 172.21.15.120:0/808322667 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c415ed50 con 0x7fa7c4145e70 2024-04-01T00:12:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.843+0000 7fa7c3fff640 1 --2- 172.21.15.120:0/808322667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c415f830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40097d0 tx=0x7fa7b402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44cccfc7b1887356 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.843+0000 7fa7c2ffd640 1 -- 172.21.15.120:0/808322667 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4035020 con 0x7fa7c4145e70 2024-04-01T00:12:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.843+0000 7fa7c2ffd640 1 -- 172.21.15.120:0/808322667 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b4031890 con 0x7fa7c4145e70 2024-04-01T00:12:50.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.843+0000 7fa7c2ffd640 1 -- 172.21.15.120:0/808322667 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4031c60 con 0x7fa7c4145e70 2024-04-01T00:12:50.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.845+0000 7fa7ca851640 1 -- 172.21.15.120:0/808322667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 msgr2=0x7fa7c415f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.845+0000 7fa7ca851640 1 --2- 172.21.15.120:0/808322667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c415f830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40097d0 tx=0x7fa7b402b930 comp rx=0 tx=0).stop 2024-04-01T00:12:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.845+0000 7fa7ca851640 1 -- 172.21.15.120:0/808322667 shutdown_connections 2024-04-01T00:12:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.845+0000 7fa7ca851640 1 --2- 172.21.15.120:0/808322667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c415f830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.845+0000 7fa7ca851640 1 -- 172.21.15.120:0/808322667 >> 172.21.15.120:0/808322667 conn(0x7fa7c40b6600 msgr2=0x7fa7c40b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.845+0000 7fa7ca851640 1 -- 172.21.15.120:0/808322667 shutdown_connections 2024-04-01T00:12:50.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.845+0000 7fa7ca851640 1 -- 172.21.15.120:0/808322667 wait complete. 2024-04-01T00:12:50.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.848+0000 7fa7ca851640 1 Processor -- start 2024-04-01T00:12:50.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.848+0000 7fa7ca851640 1 -- start start 2024-04-01T00:12:50.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.850+0000 7fa7ca851640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c406b570 0x7fa7c413e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:50.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.850+0000 7fa7ca851640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406c260 0x7fa7c41e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:50.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.850+0000 7fa7ca851640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c41e5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:50.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.850+0000 7fa7ca851640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c415fd70 con 0x7fa7c406c260 2024-04-01T00:12:50.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.850+0000 7fa7ca851640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c415f310 con 0x7fa7c406b570 2024-04-01T00:12:50.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.850+0000 7fa7ca851640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c415fef0 con 0x7fa7c4145e70 2024-04-01T00:12:50.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406c260 0x7fa7c41e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:50.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406c260 0x7fa7c41e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43540/0 (socket says 172.21.15.120:43540) 2024-04-01T00:12:50.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c37fe640 1 -- 172.21.15.120:0/1031819145 learned_addr learned my addr 172.21.15.120:0/1031819145 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:50.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c8dee640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c41e5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:50.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c3fff640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c406b570 0x7fa7c413e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:50.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c8dee640 1 -- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c406b570 msgr2=0x7fa7c413e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c8dee640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c406b570 0x7fa7c413e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:50.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c8dee640 1 -- 172.21.15.120:0/1031819145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406c260 msgr2=0x7fa7c41e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c8dee640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406c260 0x7fa7c41e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c8dee640 1 -- 172.21.15.120:0/1031819145 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c41402a0 con 0x7fa7c4145e70 2024-04-01T00:12:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c3fff640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7c406b570 0x7fa7c413e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.851+0000 7fa7c37fe640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7c406c260 0x7fa7c41e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.852+0000 7fa7c8dee640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c41e5360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00c750 tx=0x7fa7bc00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.852+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc018070 con 0x7fa7c4145e70 2024-04-01T00:12:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.852+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc004d60 con 0x7fa7c4145e70 2024-04-01T00:12:50.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.852+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c4140580 con 0x7fa7c4145e70 2024-04-01T00:12:50.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.852+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00a880 con 0x7fa7c4145e70 2024-04-01T00:12:50.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.852+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c413de70 con 0x7fa7c4145e70 2024-04-01T00:12:50.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.854+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7c4068cd0 con 0x7fa7c4145e70 2024-04-01T00:12:50.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.855+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa7bc01b070 con 0x7fa7c4145e70 2024-04-01T00:12:50.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.856+0000 7fa7c0ff9640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa7b006c8f0 0x7fa7b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:50.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.857+0000 7fa7c3fff640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa7b006c8f0 0x7fa7b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:50.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.857+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fa7bc08ac70 con 0x7fa7c4145e70 2024-04-01T00:12:50.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.857+0000 7fa7c0ff9640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7fa7b00727b0 0x7fa7b0074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:50.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.857+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 --> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7b0075280 con 0x7fa7b00727b0 2024-04-01T00:12:50.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.857+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa7bc08d370 con 0x7fa7c4145e70 2024-04-01T00:12:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.857+0000 7fa7c37fe640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7fa7b00727b0 0x7fa7b0074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.858+0000 7fa7c3fff640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa7b006c8f0 0x7fa7b006edb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4036000 tx=0x7fa7b4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.858+0000 7fa7c37fe640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7fa7b00727b0 0x7fa7b0074bd0 crc :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:50.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.859+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 <== osd.7 v2:172.21.15.203:6816/2676384654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7b0075280 con 0x7fa7b00727b0 2024-04-01T00:12:50.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.896+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 --> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa7c40af950 con 0x7fa7b00727b0 2024-04-01T00:12:50.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.897+0000 7fa7c0ff9640 1 -- 172.21.15.120:0/1031819145 <== osd.7 v2:172.21.15.203:6816/2676384654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa7c40af950 con 0x7fa7b00727b0 2024-04-01T00:12:50.899 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-01T00:12:50.899 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-01T00:12:50.899 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-01T00:12:50.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7fa7b00727b0 msgr2=0x7fa7b0074bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:6816/2676384654,v1:172.21.15.203:6817/2676384654] conn(0x7fa7b00727b0 0x7fa7b0074bd0 crc :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa7b006c8f0 msgr2=0x7fa7b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fa7b006c8f0 0x7fa7b006edb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4036000 tx=0x7fa7b4008030 comp rx=0 tx=0).stop 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 msgr2=0x7fa7c41e5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 --2- 172.21.15.120:0/1031819145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7c4145e70 0x7fa7c41e5360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00c750 tx=0x7fa7bc00cc10 comp rx=0 tx=0).stop 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7c8dee640 1 -- 172.21.15.120:0/1031819145 reap_dead start 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 shutdown_connections 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 >> 172.21.15.120:0/1031819145 conn(0x7fa7c40b6600 msgr2=0x7fa7c4074580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:50.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 shutdown_connections 2024-04-01T00:12:50.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:50.898+0000 7fa7ca851640 1 -- 172.21.15.120:0/1031819145 wait complete. 2024-04-01T00:12:50.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-01T00:12:51.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.196+0000 7ff770bd4640 1 Processor -- start 2024-04-01T00:12:51.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.197+0000 7ff770bd4640 1 -- start start 2024-04-01T00:12:51.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.199+0000 7ff770bd4640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c0c7810 0x7ff76c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:51.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.199+0000 7ff770bd4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76c0d01a0 con 0x7ff76c0d1d70 2024-04-01T00:12:51.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.199+0000 7ff770bd4640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76c0d0480 con 0x7ff76c15e7b0 2024-04-01T00:12:51.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.199+0000 7ff770bd4640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c0d1240 con 0x7ff76c0c7810 2024-04-01T00:12:51.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.199+0000 7ff76ad9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff76c0d1d70 0x7ff76c06ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:54356/0 (socket says 172.21.15.120:54356) 2024-04-01T00:12:51.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.199+0000 7ff76ad9d640 1 -- 172.21.15.120:0/3190575625 learned_addr learned my addr 172.21.15.120:0/3190575625 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:12:51.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.199+0000 7ff769d9b640 1 --2- 172.21.15.120:0/3190575625 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c0c7810 0x7ff76c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:51.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.200+0000 7ff769d9b640 1 -- 172.21.15.120:0/3190575625 >> v1:172.21.15.203:6789/0 conn(0x7ff76c15e7b0 legacy=0x7ff76c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:51.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.200+0000 7ff769d9b640 1 -- 172.21.15.120:0/3190575625 >> v1:172.21.15.120:6789/0 conn(0x7ff76c0d1d70 legacy=0x7ff76c06ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:51.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.200+0000 7ff76959a640 1 -- 172.21.15.120:0/3190575625 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656413537 0 0) 0x7ff76c0d0480 con 0x7ff76c15e7b0 2024-04-01T00:12:51.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.200+0000 7ff769d9b640 1 -- 172.21.15.120:0/3190575625 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c0d0760 con 0x7ff76c0c7810 2024-04-01T00:12:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.202+0000 7ff769d9b640 1 --2- 172.21.15.120:0/3190575625 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c0c7810 0x7ff76c0b4980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0097d0 tx=0x7ff75c02b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d3cde5dd9a02ba server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:51.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.202+0000 7ff76959a640 1 -- 172.21.15.120:0/3190575625 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c037070 con 0x7ff76c0c7810 2024-04-01T00:12:51.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.202+0000 7ff76959a640 1 -- 172.21.15.120:0/3190575625 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c030710 con 0x7ff76c0c7810 2024-04-01T00:12:51.204 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.202+0000 7ff76959a640 1 -- 172.21.15.120:0/3190575625 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c030ae0 con 0x7ff76c0c7810 2024-04-01T00:12:51.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.203+0000 7ff770bd4640 1 -- 172.21.15.120:0/3190575625 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c0c7810 msgr2=0x7ff76c0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:51.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.204+0000 7ff770bd4640 1 --2- 172.21.15.120:0/3190575625 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c0c7810 0x7ff76c0b4980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0097d0 tx=0x7ff75c02b770 comp rx=0 tx=0).stop 2024-04-01T00:12:51.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.204+0000 7ff770bd4640 1 -- 172.21.15.120:0/3190575625 shutdown_connections 2024-04-01T00:12:51.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.204+0000 7ff770bd4640 1 --2- 172.21.15.120:0/3190575625 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c0c7810 0x7ff76c0b4980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:51.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.204+0000 7ff770bd4640 1 -- 172.21.15.120:0/3190575625 >> 172.21.15.120:0/3190575625 conn(0x7ff76c0b3e90 msgr2=0x7ff76c0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:51.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.204+0000 7ff770bd4640 1 -- 172.21.15.120:0/3190575625 shutdown_connections 2024-04-01T00:12:51.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.204+0000 7ff770bd4640 1 -- 172.21.15.120:0/3190575625 wait complete. 2024-04-01T00:12:51.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.208+0000 7ff770bd4640 1 Processor -- start 2024-04-01T00:12:51.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.208+0000 7ff770bd4640 1 -- start start 2024-04-01T00:12:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.209+0000 7ff770bd4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c0c7810 0x7ff76c151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff770bd4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff76c0d1d70 0x7ff76c0b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff770bd4640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c15e7b0 0x7ff76c0b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff770bd4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c0cfe30 con 0x7ff76c0d1d70 2024-04-01T00:12:51.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff770bd4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c0d0d20 con 0x7ff76c0c7810 2024-04-01T00:12:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff770bd4640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c06d140 con 0x7ff76c15e7b0 2024-04-01T00:12:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff769d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff76c0d1d70 0x7ff76c0b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff769d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff76c0d1d70 0x7ff76c0b6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43546/0 (socket says 172.21.15.120:43546) 2024-04-01T00:12:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff769d9b640 1 -- 172.21.15.120:0/3970543821 learned_addr learned my addr 172.21.15.120:0/3970543821 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff76ad9d640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c15e7b0 0x7ff76c0b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:51.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff76a59c640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c0c7810 0x7ff76c151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:51.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff76ad9d640 1 -- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c0c7810 msgr2=0x7ff76c151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:51.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff76ad9d640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c0c7810 0x7ff76c151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.210+0000 7ff76ad9d640 1 -- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff76c0d1d70 msgr2=0x7ff76c0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff76ad9d640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff76c0d1d70 0x7ff76c0b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff76ad9d640 1 -- 172.21.15.120:0/3970543821 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c0cad90 con 0x7ff76c15e7b0 2024-04-01T00:12:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff769d9b640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff76c0d1d70 0x7ff76c0b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff76a59c640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c0c7810 0x7ff76c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff76ad9d640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c15e7b0 0x7ff76c0b6dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0d2190 tx=0x7ff76400cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff762ffd640 1 -- 172.21.15.120:0/3970543821 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764018070 con 0x7ff76c15e7b0 2024-04-01T00:12:51.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff762ffd640 1 -- 172.21.15.120:0/3970543821 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76400a640 con 0x7ff76c15e7b0 2024-04-01T00:12:51.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c0cb030 con 0x7ff76c15e7b0 2024-04-01T00:12:51.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff762ffd640 1 -- 172.21.15.120:0/3970543821 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76400a9f0 con 0x7ff76c15e7b0 2024-04-01T00:12:51.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.211+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c0cb5f0 con 0x7ff76c15e7b0 2024-04-01T00:12:51.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.213+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c068cd0 con 0x7ff76c15e7b0 2024-04-01T00:12:51.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.214+0000 7ff762ffd640 1 -- 172.21.15.120:0/3970543821 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff76401b070 con 0x7ff76c15e7b0 2024-04-01T00:12:51.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.215+0000 7ff762ffd640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff74c06c8f0 0x7ff74c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:51.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.215+0000 7ff762ffd640 1 -- 172.21.15.120:0/3970543821 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ff76408af20 con 0x7ff76c15e7b0 2024-04-01T00:12:51.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.215+0000 7ff76a59c640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff74c06c8f0 0x7ff74c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:51.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.216+0000 7ff76a59c640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff74c06c8f0 0x7ff74c06edb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff754000f60 tx=0x7ff754009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:51.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.220+0000 7ff762ffd640 1 -- 172.21.15.120:0/3970543821 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff764059090 con 0x7ff76c15e7b0 2024-04-01T00:12:51.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.738+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff76c15c3d0 con 0x7ff74c06c8f0 2024-04-01T00:12:51.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.739+0000 7ff762ffd640 1 -- 172.21.15.120:0/3970543821 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff76c15c3d0 con 0x7ff74c06c8f0 2024-04-01T00:12:51.741 INFO:teuthology.orchestra.run.smithi120.stderr:instructed osd(s) 7 to deep-scrub 2024-04-01T00:12:51.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff74c06c8f0 msgr2=0x7ff74c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:51.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff74c06c8f0 0x7ff74c06edb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff754000f60 tx=0x7ff754009040 comp rx=0 tx=0).stop 2024-04-01T00:12:51.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c15e7b0 msgr2=0x7ff76c0b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:51.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c15e7b0 0x7ff76c0b6dc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0d2190 tx=0x7ff76400cf50 comp rx=0 tx=0).stop 2024-04-01T00:12:51.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 shutdown_connections 2024-04-01T00:12:51.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7ff74c06c8f0 0x7ff74c06edb0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:51.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff76c15e7b0 0x7ff76c0b6dc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:51.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff76c0d1d70 0x7ff76c0b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:51.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 --2- 172.21.15.120:0/3970543821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c0c7810 0x7ff76c151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:51.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 >> 172.21.15.120:0/3970543821 conn(0x7ff76c0b3e90 msgr2=0x7ff76c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:51.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 shutdown_connections 2024-04-01T00:12:51.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:51.743+0000 7ff770bd4640 1 -- 172.21.15.120:0/3970543821 wait complete. 2024-04-01T00:12:51.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T00:12:52.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.043+0000 7f1b9849a640 1 Processor -- start 2024-04-01T00:12:52.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.044+0000 7f1b9849a640 1 -- start start 2024-04-01T00:12:52.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.046+0000 7f1b9849a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b900b0670 0x7f1b9015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:52.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.046+0000 7f1b9849a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b9006bc80 0x7f1b90168450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:52.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.046+0000 7f1b9849a640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b900b5b10 con 0x7f1b90070120 2024-04-01T00:12:52.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.046+0000 7f1b9849a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f1b900b63e0 con 0x7f1b900b0670 2024-04-01T00:12:52.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.046+0000 7f1b9849a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9006c3f0 con 0x7f1b9006bc80 2024-04-01T00:12:52.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.046+0000 7f1b96236640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b900b0670 0x7f1b9015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:52.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.046+0000 7f1b96236640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1b900b0670 0x7f1b9015f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43560/0 (socket says 172.21.15.120:43560) 2024-04-01T00:12:52.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.046+0000 7f1b96236640 1 -- 172.21.15.120:0/4068011021 learned_addr learned my addr 172.21.15.120:0/4068011021 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:52.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.047+0000 7f1b96a37640 1 --2- 172.21.15.120:0/4068011021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b9006bc80 0x7f1b90168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:52.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.047+0000 7f1b96236640 1 -- 172.21.15.120:0/4068011021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b9006bc80 msgr2=0x7f1b90168450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:12:52.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.047+0000 7f1b96236640 1 --2- 172.21.15.120:0/4068011021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b9006bc80 0x7f1b90168450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.047+0000 7f1b96236640 1 -- 172.21.15.120:0/4068011021 >> v1:172.21.15.203:6789/0 conn(0x7f1b90070120 legacy=0x7f1b9006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:52.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.047+0000 7f1b96236640 1 -- 172.21.15.120:0/4068011021 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9015fdf0 con 0x7f1b900b0670 2024-04-01T00:12:52.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.049+0000 7f1b96236640 1 --2- 172.21.15.120:0/4068011021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b900b0670 0x7f1b9015f8b0 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0098a0 tx=0x7f1b8c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fc94c26525f4bc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:52.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.049+0000 7f1b95234640 1 -- 172.21.15.120:0/4068011021 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c037070 con 0x7f1b900b0670 2024-04-01T00:12:52.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.049+0000 7f1b95234640 1 -- 172.21.15.120:0/4068011021 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c030710 con 0x7f1b900b0670 2024-04-01T00:12:52.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.049+0000 7f1b95234640 1 -- 172.21.15.120:0/4068011021 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c030ae0 con 0x7f1b900b0670 2024-04-01T00:12:52.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.051+0000 7f1b9849a640 1 -- 172.21.15.120:0/4068011021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b900b0670 msgr2=0x7f1b9015f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:52.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.051+0000 7f1b9849a640 1 --2- 172.21.15.120:0/4068011021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b900b0670 0x7f1b9015f8b0 secure :-1 s=READY pgs=3270 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0098a0 tx=0x7f1b8c02b7b0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.051+0000 7f1b9849a640 1 -- 172.21.15.120:0/4068011021 shutdown_connections 2024-04-01T00:12:52.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.051+0000 7f1b9849a640 1 --2- 172.21.15.120:0/4068011021 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b9006bc80 0x7f1b90168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.051+0000 7f1b9849a640 1 --2- 172.21.15.120:0/4068011021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b900b0670 0x7f1b9015f8b0 unknown :-1 s=CLOSED pgs=3270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.051+0000 7f1b9849a640 1 -- 172.21.15.120:0/4068011021 >> 172.21.15.120:0/4068011021 conn(0x7f1b900b65a0 msgr2=0x7f1b900b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:52.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.051+0000 7f1b9849a640 1 -- 172.21.15.120:0/4068011021 shutdown_connections 2024-04-01T00:12:52.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.051+0000 7f1b9849a640 1 -- 172.21.15.120:0/4068011021 wait complete. 2024-04-01T00:12:52.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.054+0000 7f1b9849a640 1 Processor -- start 2024-04-01T00:12:52.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.054+0000 7f1b9849a640 1 -- start start 2024-04-01T00:12:52.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.056+0000 7f1b9849a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b9006bc80 0x7f1b900cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:52.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.056+0000 7f1b9849a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b90070120 0x7f1b900cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:52.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.056+0000 7f1b9849a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b900b0670 0x7f1b900ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:52.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.056+0000 7f1b9849a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900b6070 con 0x7f1b9006bc80 2024-04-01T00:12:52.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.056+0000 7f1b9849a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1b900b5d90 con 0x7f1b900b0670 2024-04-01T00:12:52.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.056+0000 7f1b9849a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1b900b0a50 con 0x7f1b90070120 2024-04-01T00:12:52.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96236640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b9006bc80 0x7f1b900cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:52.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96236640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b9006bc80 0x7f1b900cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43568/0 (socket says 172.21.15.120:43568) 2024-04-01T00:12:52.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96236640 1 -- 172.21.15.120:0/1893159839 learned_addr learned my addr 172.21.15.120:0/1893159839 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:12:52.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96a37640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b900b0670 0x7f1b900ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:52.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b95a35640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b90070120 0x7f1b900cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:52.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96a37640 1 -- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b90070120 msgr2=0x7f1b900cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:52.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96a37640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b90070120 0x7f1b900cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96a37640 1 -- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b9006bc80 msgr2=0x7f1b900cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:52.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96a37640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b9006bc80 0x7f1b900cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96a37640 1 -- 172.21.15.120:0/1893159839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9013b130 con 0x7f1b900b0670 2024-04-01T00:12:52.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.057+0000 7f1b96236640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b9006bc80 0x7f1b900cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:12:52.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.058+0000 7f1b96a37640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b900b0670 0x7f1b900ce120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009d90 tx=0x7f1b8800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:52.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.058+0000 7f1b86ffd640 1 -- 172.21.15.120:0/1893159839 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88018020 con 0x7f1b900b0670 2024-04-01T00:12:52.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.058+0000 7f1b86ffd640 1 -- 172.21.15.120:0/1893159839 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b88014480 con 0x7f1b900b0670 2024-04-01T00:12:52.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.058+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b900ce710 con 0x7f1b900b0670 2024-04-01T00:12:52.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.058+0000 7f1b86ffd640 1 -- 172.21.15.120:0/1893159839 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88014870 con 0x7f1b900b0670 2024-04-01T00:12:52.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.058+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b900cbba0 con 0x7f1b900b0670 2024-04-01T00:12:52.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.060+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b90068cd0 con 0x7f1b900b0670 2024-04-01T00:12:52.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.061+0000 7f1b86ffd640 1 -- 172.21.15.120:0/1893159839 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b88005d10 con 0x7f1b900b0670 2024-04-01T00:12:52.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.062+0000 7f1b86ffd640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b7406c8f0 0x7f1b7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:12:52.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.062+0000 7f1b96236640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b7406c8f0 0x7f1b7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:12:52.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.062+0000 7f1b86ffd640 1 -- 172.21.15.120:0/1893159839 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f1b8808c610 con 0x7f1b900b0670 2024-04-01T00:12:52.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.063+0000 7f1b96236640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b7406c8f0 0x7f1b7406edb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0090b0 tx=0x7f1b8c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:12:52.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.067+0000 7f1b86ffd640 1 -- 172.21.15.120:0/1893159839 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1b88022030 con 0x7f1b900b0670 2024-04-01T00:12:52.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.278+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b900b15f0 con 0x7f1b7406c8f0 2024-04-01T00:12:52.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.280+0000 7f1b86ffd640 1 -- 172.21.15.120:0/1893159839 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13459 (secure 0 0 0) 0x7f1b900b15f0 con 0x7f1b7406c8f0 2024-04-01T00:12:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:12:52.281 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-01T00:12:52.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b7406c8f0 msgr2=0x7f1b7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:52.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b7406c8f0 0x7f1b7406edb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0090b0 tx=0x7f1b8c008030 comp rx=0 tx=0).stop 2024-04-01T00:12:52.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b900b0670 msgr2=0x7f1b900ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:12:52.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b900b0670 0x7f1b900ce120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009d90 tx=0x7f1b8800c490 comp rx=0 tx=0).stop 2024-04-01T00:12:52.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 shutdown_connections 2024-04-01T00:12:52.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f1b7406c8f0 0x7f1b7406edb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1b900b0670 0x7f1b900ce120 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1b90070120 0x7f1b900cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 --2- 172.21.15.120:0/1893159839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1b9006bc80 0x7f1b900cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:12:52.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 >> 172.21.15.120:0/1893159839 conn(0x7f1b900b65a0 msgr2=0x7f1b900ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:12:52.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 shutdown_connections 2024-04-01T00:12:52.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:12:52.283+0000 7f1b9849a640 1 -- 172.21.15.120:0/1893159839 wait complete. 2024-04-01T00:12:52.299 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":13751,"stamp":"2024-04-01T00:12:51.679296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12502324,"kb_used_data":4328,"kb_used_omap":34667,"kb_used_meta":12463252,"kb_avail":742472396,"statfs":{"total":773094113280,"available":760291733504,"internally_reserved":0,"allocated":4431872,"data_stored":2446720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35499560,"internal_metadata":12762370520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003058"},"pg_stats":[{"pgid":"1.0","version":"32'161","reported_seq":478,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-01T00:12:31.750543+0000","last_change":"2024-03-31T16:35:21.070955+0000","last_active":"2024-04-01T00:12:31.750543+0000","last_peered":"2024-04-01T00:12:31.750543+0000","last_clean":"2024-04-01T00:12:31.750543+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-04-01T00:12:31.750543+0000","last_undegraded":"2024-04-01T00:12:31.750543+0000","last_fullsized":"2024-04-01T00:12:31.750543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-31T16:35:19.988056+0000","last_clean_scrub_stamp":"2024-03-31T16:35:19.988056+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T04:29:35.568138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580336,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1731164,"kb_used_data":976,"kb_used_omap":2477,"kb_used_meta":1727698,"kb_avail":92640676,"statfs":{"total":96636764160,"available":94864052224,"internally_reserved":0,"allocated":999424,"data_stored":748616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2536788,"internal_metadata":1769163436},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1639000,"kb_used_data":396,"kb_used_omap":3627,"kb_used_meta":1634964,"kb_avail":92732840,"statfs":{"total":96636764160,"available":94958428160,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3714337,"internal_metadata":1674203871},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1455956,"kb_used_data":396,"kb_used_omap":3630,"kb_used_meta":1451921,"kb_avail":92915884,"statfs":{"total":96636764160,"available":95145865216,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3717507,"internal_metadata":1486767741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1800024,"kb_used_data":396,"kb_used_omap":5924,"kb_used_meta":1793691,"kb_avail":92571816,"statfs":{"total":96636764160,"available":94793539584,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6066593,"internal_metadata":1836740191},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580265,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1652244,"kb_used_data":396,"kb_used_omap":8985,"kb_used_meta":1642854,"kb_avail":92719596,"statfs":{"total":96636764160,"available":94944866304,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9201363,"internal_metadata":1682282797},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1420820,"kb_used_data":396,"kb_used_omap":1600,"kb_used_meta":1418815,"kb_avail":92951020,"statfs":{"total":96636764160,"available":95181844480,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1639054,"internal_metadata":1452866930},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1340628,"kb_used_data":396,"kb_used_omap":6692,"kb_used_meta":1333531,"kb_avail":93031212,"statfs":{"total":96636764160,"available":95263961088,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6852695,"internal_metadata":1365536681},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580321,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1462488,"kb_used_data":976,"kb_used_omap":1729,"kb_used_meta":1459774,"kb_avail":92909352,"statfs":{"total":96636764160,"available":95139176448,"internally_reserved":0,"allocated":999424,"data_stored":748616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1771223,"internal_metadata":1494808873},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T00:12:52.301 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-31T16:35:19.988056+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=31, tm_hour=16, tm_min=35, tm_sec=19, tm_wday=6, tm_yday=91, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=1, tm_hour=0, tm_min=12, tm_sec=40, tm_wday=0, tm_yday=92, tm_isdst=0) 2024-04-01T00:12:52.301 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-01T00:13:12.303 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T00:13:12.469 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.468+0000 7fb65ead3640 1 Processor -- start 2024-04-01T00:13:12.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.468+0000 7fb65ead3640 1 -- start start 2024-04-01T00:13:12.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.470+0000 7fb65ead3640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb65815e7b0 0x7fb6580b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.470+0000 7fb65ead3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580c7810 0x7fb65806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.470+0000 7fb65ead3640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6580d01a0 con 0x7fb6580d1d70 2024-04-01T00:13:12.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.470+0000 7fb65ead3640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb6580d1240 con 0x7fb65815e7b0 2024-04-01T00:13:12.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.470+0000 7fb65ead3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb6580d0480 con 0x7fb6580c7810 2024-04-01T00:13:12.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.470+0000 7fb65d070640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580c7810 0x7fb65806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.470+0000 7fb65c86f640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb65815e7b0 0x7fb6580b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.471+0000 7fb65d070640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580c7810 0x7fb65806ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:46362/0 (socket says 172.21.15.120:46362) 2024-04-01T00:13:12.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.471+0000 7fb65d070640 1 -- 172.21.15.120:0/2529295849 learned_addr learned my addr 172.21.15.120:0/2529295849 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:13:12.473 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.471+0000 7fb65d070640 1 -- 172.21.15.120:0/2529295849 >> v2:172.21.15.203:3300/0 conn(0x7fb65815e7b0 msgr2=0x7fb6580b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:13:12.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.471+0000 7fb65d070640 1 --2- 172.21.15.120:0/2529295849 >> v2:172.21.15.203:3300/0 conn(0x7fb65815e7b0 0x7fb6580b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.471+0000 7fb65d070640 1 -- 172.21.15.120:0/2529295849 >> v1:172.21.15.203:6789/0 conn(0x7fb6580d1d70 legacy=0x7fb6580c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.471+0000 7fb65d070640 1 -- 172.21.15.120:0/2529295849 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6580d0760 con 0x7fb6580c7810 2024-04-01T00:13:12.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.472+0000 7fb65d070640 1 --2- 172.21.15.120:0/2529295849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580c7810 0x7fb65806ca30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb650009e50 tx=0x7fb65002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=404f04bd86459fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:12.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.472+0000 7fb6577fe640 1 -- 172.21.15.120:0/2529295849 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65002cb00 con 0x7fb6580c7810 2024-04-01T00:13:12.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.472+0000 7fb6577fe640 1 -- 172.21.15.120:0/2529295849 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65002cca0 con 0x7fb6580c7810 2024-04-01T00:13:12.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.472+0000 7fb6577fe640 1 -- 172.21.15.120:0/2529295849 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650034610 con 0x7fb6580c7810 2024-04-01T00:13:12.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.473+0000 7fb65ead3640 1 -- 172.21.15.120:0/2529295849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580c7810 msgr2=0x7fb65806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.473+0000 7fb65ead3640 1 --2- 172.21.15.120:0/2529295849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580c7810 0x7fb65806ca30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb650009e50 tx=0x7fb65002bf60 comp rx=0 tx=0).stop 2024-04-01T00:13:12.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.473+0000 7fb65ead3640 1 -- 172.21.15.120:0/2529295849 shutdown_connections 2024-04-01T00:13:12.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.473+0000 7fb65ead3640 1 --2- 172.21.15.120:0/2529295849 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580c7810 0x7fb65806ca30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.473+0000 7fb65ead3640 1 --2- 172.21.15.120:0/2529295849 >> v2:172.21.15.203:3300/0 conn(0x7fb65815e7b0 0x7fb6580b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.473+0000 7fb65ead3640 1 -- 172.21.15.120:0/2529295849 >> 172.21.15.120:0/2529295849 conn(0x7fb6580b3e90 msgr2=0x7fb6580b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:13:12.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.473+0000 7fb65ead3640 1 -- 172.21.15.120:0/2529295849 shutdown_connections 2024-04-01T00:13:12.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.474+0000 7fb65ead3640 1 -- 172.21.15.120:0/2529295849 wait complete. 2024-04-01T00:13:12.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.477+0000 7fb65ead3640 1 Processor -- start 2024-04-01T00:13:12.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.477+0000 7fb65ead3640 1 -- start start 2024-04-01T00:13:12.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65ead3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6580c7810 0x7fb658155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65ead3640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580d1d70 0x7fb6581f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65ead3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb65815e7b0 0x7fb6580b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65ead3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb6580cfe30 con 0x7fb65815e7b0 2024-04-01T00:13:12.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65ead3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6580d0d20 con 0x7fb6580c7810 2024-04-01T00:13:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65ead3640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb65806cf70 con 0x7fb6580d1d70 2024-04-01T00:13:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65d070640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb65815e7b0 0x7fb6580b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65d070640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb65815e7b0 0x7fb6580b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40098/0 (socket says 172.21.15.120:40098) 2024-04-01T00:13:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65d070640 1 -- 172.21.15.120:0/3432852617 learned_addr learned my addr 172.21.15.120:0/3432852617 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:13:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb65c86f640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6580c7810 0x7fb658155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.479+0000 7fb657fff640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580d1d70 0x7fb6581f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65d070640 1 -- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580d1d70 msgr2=0x7fb6581f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65d070640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580d1d70 0x7fb6581f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65d070640 1 -- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6580c7810 msgr2=0x7fb658155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65d070640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6580c7810 0x7fb658155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65d070640 1 -- 172.21.15.120:0/3432852617 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb658071ce0 con 0x7fb65815e7b0 2024-04-01T00:13:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65c86f640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6580c7810 0x7fb658155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T00:13:12.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65d070640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb65815e7b0 0x7fb6580b52c0 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7fb650009e50 tx=0x7fb650004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb6557fa640 1 -- 172.21.15.120:0/3432852617 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650043020 con 0x7fb65815e7b0 2024-04-01T00:13:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb6557fa640 1 -- 172.21.15.120:0/3432852617 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65002ce50 con 0x7fb65815e7b0 2024-04-01T00:13:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6580b5e30 con 0x7fb65815e7b0 2024-04-01T00:13:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb6557fa640 1 -- 172.21.15.120:0/3432852617 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650009510 con 0x7fb65815e7b0 2024-04-01T00:13:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.480+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6580b6740 con 0x7fb65815e7b0 2024-04-01T00:13:12.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.483+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb658068cd0 con 0x7fb65815e7b0 2024-04-01T00:13:12.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.483+0000 7fb6557fa640 1 -- 172.21.15.120:0/3432852617 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb650005d10 con 0x7fb65815e7b0 2024-04-01T00:13:12.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.484+0000 7fb6557fa640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb63c06c8f0 0x7fb63c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.484+0000 7fb65c86f640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb63c06c8f0 0x7fb63c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.484+0000 7fb6557fa640 1 -- 172.21.15.120:0/3432852617 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fb6500ae050 con 0x7fb65815e7b0 2024-04-01T00:13:12.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.485+0000 7fb65c86f640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb63c06c8f0 0x7fb63c06edb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009af0 tx=0x7fb64c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:12.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.488+0000 7fb6557fa640 1 -- 172.21.15.120:0/3432852617 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb6500333a0 con 0x7fb65815e7b0 2024-04-01T00:13:12.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.664+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 --> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6580b6350 con 0x7fb63c06c8f0 2024-04-01T00:13:12.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.667+0000 7fb6557fa640 1 -- 172.21.15.120:0/3432852617 <== mgr.4110 v2:172.21.15.120:6832/1293298103 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13467 (secure 0 0 0) 0x7fb6580b6350 con 0x7fb63c06c8f0 2024-04-01T00:13:12.668 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:13:12.669 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-04-01T00:13:12.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb63c06c8f0 msgr2=0x7fb63c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb63c06c8f0 0x7fb63c06edb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009af0 tx=0x7fb64c008040 comp rx=0 tx=0).stop 2024-04-01T00:13:12.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb65815e7b0 msgr2=0x7fb6580b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb65815e7b0 0x7fb6580b52c0 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7fb650009e50 tx=0x7fb650004a40 comp rx=0 tx=0).stop 2024-04-01T00:13:12.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 shutdown_connections 2024-04-01T00:13:12.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7fb63c06c8f0 0x7fb63c06edb0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb65815e7b0 0x7fb6580b52c0 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6580d1d70 0x7fb6581f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 --2- 172.21.15.120:0/3432852617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6580c7810 0x7fb658155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 >> 172.21.15.120:0/3432852617 conn(0x7fb6580b3e90 msgr2=0x7fb658160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:13:12.671 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 shutdown_connections 2024-04-01T00:13:12.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.669+0000 7fb65ead3640 1 -- 172.21.15.120:0/3432852617 wait complete. 2024-04-01T00:13:12.685 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":13761,"stamp":"2024-04-01T00:13:11.684344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12502320,"kb_used_data":4328,"kb_used_omap":34667,"kb_used_meta":12463252,"kb_avail":742472400,"statfs":{"total":773094113280,"available":760291737600,"internally_reserved":0,"allocated":4431872,"data_stored":2446720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35499560,"internal_metadata":12762370520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003187"},"pg_stats":[{"pgid":"1.0","version":"35'163","reported_seq":490,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-01T00:12:52.213304+0000","last_change":"2024-04-01T00:12:52.213304+0000","last_active":"2024-04-01T00:12:52.213304+0000","last_peered":"2024-04-01T00:12:52.213304+0000","last_clean":"2024-04-01T00:12:52.213304+0000","last_became_active":"2024-03-31T16:35:21.069704+0000","last_became_peered":"2024-03-31T16:35:21.069704+0000","last_unstale":"2024-04-01T00:12:52.213304+0000","last_undegraded":"2024-04-01T00:12:52.213304+0000","last_fullsized":"2024-04-01T00:12:52.213304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'163","last_scrub_stamp":"2024-04-01T00:12:52.213142+0000","last_deep_scrub":"35'163","last_deep_scrub_stamp":"2024-04-01T00:12:52.213142+0000","last_clean_scrub_stamp":"2024-04-01T00:12:52.213142+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:08:48.047705+0000","scrub_duration":109,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580340,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1731160,"kb_used_data":976,"kb_used_omap":2477,"kb_used_meta":1727698,"kb_avail":92640680,"statfs":{"total":96636764160,"available":94864056320,"internally_reserved":0,"allocated":999424,"data_stored":748616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2536788,"internal_metadata":1769163436},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834580345,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1639000,"kb_used_data":396,"kb_used_omap":3627,"kb_used_meta":1634964,"kb_avail":92732840,"statfs":{"total":96636764160,"available":94958428160,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3714337,"internal_metadata":1674203871},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834580342,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1455956,"kb_used_data":396,"kb_used_omap":3630,"kb_used_meta":1451921,"kb_avail":92915884,"statfs":{"total":96636764160,"available":95145865216,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3717507,"internal_metadata":1486767741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834580341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1800024,"kb_used_data":396,"kb_used_omap":5924,"kb_used_meta":1793691,"kb_avail":92571816,"statfs":{"total":96636764160,"available":94793539584,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6066593,"internal_metadata":1836740191},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834580269,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1652244,"kb_used_data":396,"kb_used_omap":8985,"kb_used_meta":1642854,"kb_avail":92719596,"statfs":{"total":96636764160,"available":94944866304,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9201363,"internal_metadata":1682282797},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834580302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1420820,"kb_used_data":396,"kb_used_omap":1600,"kb_used_meta":1418815,"kb_avail":92951020,"statfs":{"total":96636764160,"available":95181844480,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1639054,"internal_metadata":1452866930},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834580285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1340628,"kb_used_data":396,"kb_used_omap":6692,"kb_used_meta":1333531,"kb_avail":93031212,"statfs":{"total":96636764160,"available":95263961088,"internally_reserved":0,"allocated":405504,"data_stored":158248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6852695,"internal_metadata":1365536681},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580325,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1462488,"kb_used_data":976,"kb_used_omap":1729,"kb_used_meta":1459774,"kb_avail":92909352,"statfs":{"total":96636764160,"available":95139176448,"internally_reserved":0,"allocated":999424,"data_stored":748616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1771223,"internal_metadata":1494808873},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T00:13:12.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-01T00:13:12.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.940+0000 7f493509a640 1 Processor -- start 2024-04-01T00:13:12.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.940+0000 7f493509a640 1 -- start start 2024-04-01T00:13:12.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.941+0000 7f493509a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4930155550 0x7f4930155930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.941+0000 7f493509a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f49300d0990 0x7f49300aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.941+0000 7f493509a640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49300b40b0 con 0x7f493015f800 2024-04-01T00:13:12.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.941+0000 7f493509a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 -- 0x7f49300b4390 con 0x7f49300d0990 2024-04-01T00:13:12.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.941+0000 7f493509a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f49300b4670 con 0x7f4930155550 2024-04-01T00:13:12.944 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492f59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f49300d0990 0x7f49300aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492ed9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4930155550 0x7f4930155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492e59c640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f493015f800 0x7f49300d0280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.120:40202/0 (socket says 172.21.15.120:40202) 2024-04-01T00:13:12.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492e59c640 1 -- 172.21.15.120:0/1037374999 learned_addr learned my addr 172.21.15.120:0/1037374999 (peer_addr_for_me v1:172.21.15.120:0/0) 2024-04-01T00:13:12.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492f59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f49300d0990 0x7f49300aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40114/0 (socket says 172.21.15.120:40114) 2024-04-01T00:13:12.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492dd9b640 1 -- 172.21.15.120:0/1037374999 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207293974 0 0) 0x7f49300b40b0 con 0x7f493015f800 2024-04-01T00:13:12.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492dd9b640 1 -- 172.21.15.120:0/1037374999 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f491c003520 con 0x7f493015f800 2024-04-01T00:13:12.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492ed9d640 1 -- 172.21.15.120:0/1037374999 >> v2:172.21.15.120:3300/0 conn(0x7f49300d0990 msgr2=0x7f49300aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:13:12.945 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492ed9d640 1 --2- 172.21.15.120:0/1037374999 >> v2:172.21.15.120:3300/0 conn(0x7f49300d0990 0x7f49300aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492ed9d640 1 -- 172.21.15.120:0/1037374999 >> v1:172.21.15.203:6789/0 conn(0x7f493015f800 legacy=0x7f49300d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.946 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.942+0000 7f492ed9d640 1 -- 172.21.15.120:0/1037374999 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49300b4950 con 0x7f4930155550 2024-04-01T00:13:12.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.944+0000 7f492ed9d640 1 --2- 172.21.15.120:0/1037374999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4930155550 0x7f4930155930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49280097a0 tx=0x7f492802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17076028ee572020 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:12.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.944+0000 7f492dd9b640 1 -- 172.21.15.120:0/1037374999 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280315a0 con 0x7f4930155550 2024-04-01T00:13:12.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f492dd9b640 1 -- 172.21.15.120:0/1037374999 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4928037070 con 0x7f4930155550 2024-04-01T00:13:12.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f492dd9b640 1 -- 172.21.15.120:0/1037374999 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928031960 con 0x7f4930155550 2024-04-01T00:13:12.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f493509a640 1 -- 172.21.15.120:0/1037374999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4930155550 msgr2=0x7f4930155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f493509a640 1 --2- 172.21.15.120:0/1037374999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4930155550 0x7f4930155930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49280097a0 tx=0x7f492802b840 comp rx=0 tx=0).stop 2024-04-01T00:13:12.947 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f493509a640 1 -- 172.21.15.120:0/1037374999 shutdown_connections 2024-04-01T00:13:12.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f493509a640 1 --2- 172.21.15.120:0/1037374999 >> v2:172.21.15.120:3300/0 conn(0x7f49300d0990 0x7f49300aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f493509a640 1 --2- 172.21.15.120:0/1037374999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4930155550 0x7f4930155930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f493509a640 1 -- 172.21.15.120:0/1037374999 >> 172.21.15.120:0/1037374999 conn(0x7f493006b750 msgr2=0x7f493006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:13:12.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f493509a640 1 -- 172.21.15.120:0/1037374999 shutdown_connections 2024-04-01T00:13:12.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.945+0000 7f493509a640 1 -- 172.21.15.120:0/1037374999 wait complete. 2024-04-01T00:13:12.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.947+0000 7f493509a640 1 Processor -- start 2024-04-01T00:13:12.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.947+0000 7f493509a640 1 -- start start 2024-04-01T00:13:12.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.947+0000 7f493509a640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49300d0990 0x7f4930099840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.947+0000 7f493509a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4930155550 0x7f493014fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.947+0000 7f493509a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f493015f800 0x7f49301501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.947+0000 7f493509a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f493015ba20 con 0x7f4930155550 2024-04-01T00:13:12.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.947+0000 7f493509a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f493015fc80 con 0x7f493015f800 2024-04-01T00:13:12.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.947+0000 7f493509a640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f493015bba0 con 0x7f49300d0990 2024-04-01T00:13:12.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4930155550 0x7f493014fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f493015f800 0x7f49301501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492ed9d640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49300d0990 0x7f4930099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f493015f800 0x7f49301501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:59154/0 (socket says 172.21.15.120:59154) 2024-04-01T00:13:12.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 -- 172.21.15.120:0/3437824869 learned_addr learned my addr 172.21.15.120:0/3437824869 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:13:12.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 -- 172.21.15.120:0/3437824869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49300d0990 msgr2=0x7f4930099840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49300d0990 0x7f4930099840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 -- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4930155550 msgr2=0x7f493014fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:12.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4930155550 0x7f493014fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:12.951 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 -- 172.21.15.120:0/3437824869 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4930073080 con 0x7f493015f800 2024-04-01T00:13:12.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.948+0000 7f492f59e640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f493015f800 0x7f49301501a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f491800e7f0 tx=0x7f491800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:12.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.949+0000 7f49277fe640 1 -- 172.21.15.120:0/3437824869 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4918017070 con 0x7f493015f800 2024-04-01T00:13:12.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.949+0000 7f49277fe640 1 -- 172.21.15.120:0/3437824869 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491800c730 con 0x7f493015f800 2024-04-01T00:13:12.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.949+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49300ae310 con 0x7f493015f800 2024-04-01T00:13:12.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.949+0000 7f49277fe640 1 -- 172.21.15.120:0/3437824869 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491800cb20 con 0x7f493015f800 2024-04-01T00:13:12.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.949+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4930099d80 con 0x7f493015f800 2024-04-01T00:13:12.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.951+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49300685c0 con 0x7f493015f800 2024-04-01T00:13:12.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.952+0000 7f49277fe640 1 -- 172.21.15.120:0/3437824869 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f491801a070 con 0x7f493015f800 2024-04-01T00:13:12.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.953+0000 7f49277fe640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f491006c8f0 0x7f491006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:12.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.953+0000 7f492ed9d640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f491006c8f0 0x7f491006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:12.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.953+0000 7f49277fe640 1 -- 172.21.15.120:0/3437824869 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f491808b840 con 0x7f493015f800 2024-04-01T00:13:12.955 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.954+0000 7f492ed9d640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f491006c8f0 0x7f491006edb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4928036000 tx=0x7f492803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:12.959 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:12.958+0000 7f49277fe640 1 -- 172.21.15.120:0/3437824869 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f49180599b0 con 0x7f493015f800 2024-04-01T00:13:13.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.501+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f4930165160 con 0x7f493015f800 2024-04-01T00:13:13.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.508+0000 7f49277fe640 1 -- 172.21.15.120:0/3437824869 <== mon.1 v2:172.21.15.203:3300/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f491805dcb0 con 0x7f493015f800 2024-04-01T00:13:13.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.509+0000 7f49277fe640 1 -- 172.21.15.120:0/3437824869 <== mon.1 v2:172.21.15.203:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f49180624e0 con 0x7f493015f800 2024-04-01T00:13:13.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.512+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f491006c8f0 msgr2=0x7f491006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:13.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.512+0000 7f493509a640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f491006c8f0 0x7f491006edb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4928036000 tx=0x7f492803d040 comp rx=0 tx=0).stop 2024-04-01T00:13:13.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f493015f800 msgr2=0x7f49301501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:13.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f493015f800 0x7f49301501a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f491800e7f0 tx=0x7f491800ecb0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 shutdown_connections 2024-04-01T00:13:13.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f491006c8f0 0x7f491006edb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f493015f800 0x7f49301501a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4930155550 0x7f493014fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 --2- 172.21.15.120:0/3437824869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49300d0990 0x7f4930099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.515 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 >> 172.21.15.120:0/3437824869 conn(0x7f493006b750 msgr2=0x7f49300b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:13:13.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 shutdown_connections 2024-04-01T00:13:13.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.513+0000 7f493509a640 1 -- 172.21.15.120:0/3437824869 wait complete. 2024-04-01T00:13:13.529 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-01T00:13:13.530 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T00:13:13.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.789+0000 7f9aa1a8f640 1 Processor -- start 2024-04-01T00:13:13.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.789+0000 7f9aa1a8f640 1 -- start start 2024-04-01T00:13:13.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.791+0000 7f9aa1a8f640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9a9c0b0670 0x7f9a9c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:13.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9aa1a8f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c06bc80 0x7f9a9c168450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:13.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9aa1a8f640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a9c0b5b10 con 0x7f9a9c070120 2024-04-01T00:13:13.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9aa1a8f640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9c0b63e0 con 0x7f9a9c0b0670 2024-04-01T00:13:13.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9aa1a8f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9c06c3f0 con 0x7f9a9c06bc80 2024-04-01T00:13:13.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c06bc80 0x7f9a9c168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:13.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9a9b7fe640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9a9c0b0670 0x7f9a9c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:13.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c06bc80 0x7f9a9c168450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.120:46394/0 (socket says 172.21.15.120:46394) 2024-04-01T00:13:13.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9a9bfff640 1 -- 172.21.15.120:0/4061953944 learned_addr learned my addr 172.21.15.120:0/4061953944 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:13:13.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9a9bfff640 1 -- 172.21.15.120:0/4061953944 >> v2:172.21.15.203:3300/0 conn(0x7f9a9c0b0670 msgr2=0x7f9a9c15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T00:13:13.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9a9bfff640 1 --2- 172.21.15.120:0/4061953944 >> v2:172.21.15.203:3300/0 conn(0x7f9a9c0b0670 0x7f9a9c15f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9a9bfff640 1 -- 172.21.15.120:0/4061953944 >> v1:172.21.15.203:6789/0 conn(0x7f9a9c070120 legacy=0x7f9a9c06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:13.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.792+0000 7f9a9bfff640 1 -- 172.21.15.120:0/4061953944 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c15fdf0 con 0x7f9a9c06bc80 2024-04-01T00:13:13.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.793+0000 7f9a9bfff640 1 --2- 172.21.15.120:0/4061953944 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c06bc80 0x7f9a9c168450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009870 tx=0x7f9a9402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a218bb7803174c26 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:13.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.794+0000 7f9a9affd640 1 -- 172.21.15.120:0/4061953944 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94034070 con 0x7f9a9c06bc80 2024-04-01T00:13:13.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.794+0000 7f9a9affd640 1 -- 172.21.15.120:0/4061953944 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9a94030840 con 0x7f9a9c06bc80 2024-04-01T00:13:13.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.794+0000 7f9a9affd640 1 -- 172.21.15.120:0/4061953944 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94030c30 con 0x7f9a9c06bc80 2024-04-01T00:13:13.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.795+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4061953944 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c06bc80 msgr2=0x7f9a9c168450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:13.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.795+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4061953944 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c06bc80 0x7f9a9c168450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009870 tx=0x7f9a9402b980 comp rx=0 tx=0).stop 2024-04-01T00:13:13.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.795+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4061953944 shutdown_connections 2024-04-01T00:13:13.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.795+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4061953944 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c06bc80 0x7f9a9c168450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.795+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4061953944 >> v2:172.21.15.203:3300/0 conn(0x7f9a9c0b0670 0x7f9a9c15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.795+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4061953944 >> 172.21.15.120:0/4061953944 conn(0x7f9a9c0b65a0 msgr2=0x7f9a9c0b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:13:13.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.795+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4061953944 shutdown_connections 2024-04-01T00:13:13.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.795+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4061953944 wait complete. 2024-04-01T00:13:13.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.798+0000 7f9aa1a8f640 1 Processor -- start 2024-04-01T00:13:13.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.799+0000 7f9aa1a8f640 1 -- start start 2024-04-01T00:13:13.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.800+0000 7f9aa1a8f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c06bc80 0x7f9a9c145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:13.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.800+0000 7f9aa1a8f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a9c070120 0x7f9a9c142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:13.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.800+0000 7f9aa1a8f640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c0b0670 0x7f9a9c0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:13.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.800+0000 7f9aa1a8f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c0b6070 con 0x7f9a9c070120 2024-04-01T00:13:13.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.800+0000 7f9aa1a8f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c0b5d90 con 0x7f9a9c06bc80 2024-04-01T00:13:13.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.800+0000 7f9aa1a8f640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9c0b0a50 con 0x7f9a9c0b0670 2024-04-01T00:13:13.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a93fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a9c070120 0x7f9a9c142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:13.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a9b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c06bc80 0x7f9a9c145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:13.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c0b0670 0x7f9a9c0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:13.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a93fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a9c070120 0x7f9a9c142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40126/0 (socket says 172.21.15.120:40126) 2024-04-01T00:13:13.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a9b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c06bc80 0x7f9a9c145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.120:59178/0 (socket says 172.21.15.120:59178) 2024-04-01T00:13:13.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a93fff640 1 -- 172.21.15.120:0/4248167662 learned_addr learned my addr 172.21.15.120:0/4248167662 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-04-01T00:13:13.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a9bfff640 1 -- 172.21.15.120:0/4248167662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c06bc80 msgr2=0x7f9a9c145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a9bfff640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c06bc80 0x7f9a9c145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a9bfff640 1 -- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a9c070120 msgr2=0x7f9a9c142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.801+0000 7f9a9bfff640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a9c070120 0x7f9a9c142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.802+0000 7f9a9bfff640 1 -- 172.21.15.120:0/4248167662 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c142ea0 con 0x7f9a9c0b0670 2024-04-01T00:13:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.802+0000 7f9a9b7fe640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c06bc80 0x7f9a9c145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T00:13:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.802+0000 7f9a9bfff640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c0b0670 0x7f9a9c0ce760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0cdaa0 tx=0x7f9a940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:13.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.802+0000 7f9a98ff9640 1 -- 172.21.15.120:0/4248167662 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94034040 con 0x7f9a9c0b0670 2024-04-01T00:13:13.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.802+0000 7f9a98ff9640 1 -- 172.21.15.120:0/4248167662 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9a94039d90 con 0x7f9a9c0b0670 2024-04-01T00:13:13.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.802+0000 7f9a98ff9640 1 -- 172.21.15.120:0/4248167662 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94043630 con 0x7f9a9c0b0670 2024-04-01T00:13:13.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.802+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9c143140 con 0x7f9a9c0b0670 2024-04-01T00:13:13.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.803+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9c0cdf60 con 0x7f9a9c0b0670 2024-04-01T00:13:13.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.804+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a9c068cd0 con 0x7f9a9c0b0670 2024-04-01T00:13:13.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.805+0000 7f9a98ff9640 1 -- 172.21.15.120:0/4248167662 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a9404a060 con 0x7f9a9c0b0670 2024-04-01T00:13:13.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.806+0000 7f9a98ff9640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a7c06c8f0 0x7f9a7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T00:13:13.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.806+0000 7f9a98ff9640 1 -- 172.21.15.120:0/4248167662 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f9a940ad760 con 0x7f9a9c0b0670 2024-04-01T00:13:13.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.806+0000 7f9a9b7fe640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a7c06c8f0 0x7f9a7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T00:13:13.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.807+0000 7f9a9b7fe640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a7c06c8f0 0x7f9a7c06edb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c143900 tx=0x7f9a8c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T00:13:13.812 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:13.811+0000 7f9a98ff9640 1 -- 172.21.15.120:0/4248167662 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9a9403e070 con 0x7f9a9c0b0670 2024-04-01T00:13:14.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.030+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a9c148350 con 0x7f9a9c0b0670 2024-04-01T00:13:14.033 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.031+0000 7f9a98ff9640 1 -- 172.21.15.120:0/4248167662 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3878 (secure 0 0 0) 0x7f9a9c15fdf0 con 0x7f9a9c0b0670 2024-04-01T00:13:14.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-01T00:13:14.033 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/642289834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":642289834},{"type":"v1","addr":"172.21.15.120:6837","nonce":642289834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5038,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6834/4016494046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":4016494046},{"type":"v1","addr":"172.21.15.203:6834","nonce":4016494046}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/1319253278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6833","nonce":1319253278},{"type":"v1","addr":"172.21.15.203:6835","nonce":1319253278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1766153586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1766153586},{"type":"v1","addr":"172.21.15.120:6836","nonce":1766153586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-04-01T00:13:14.033 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 17 2024-04-01T00:13:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.033+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a7c06c8f0 msgr2=0x7f9a7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:14.035 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a7c06c8f0 0x7f9a7c06edb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c143900 tx=0x7f9a8c00b040 comp rx=0 tx=0).stop 2024-04-01T00:13:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c0b0670 msgr2=0x7f9a9c0ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T00:13:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c0b0670 0x7f9a9c0ce760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0cdaa0 tx=0x7f9a940046c0 comp rx=0 tx=0).stop 2024-04-01T00:13:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 shutdown_connections 2024-04-01T00:13:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:6832/1293298103,v1:172.21.15.120:6833/1293298103] conn(0x7f9a7c06c8f0 0x7f9a7c06edb0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9a9c0b0670 0x7f9a9c0ce760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a9c070120 0x7f9a9c142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 --2- 172.21.15.120:0/4248167662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c06bc80 0x7f9a9c145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T00:13:14.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 >> 172.21.15.120:0/4248167662 conn(0x7f9a9c0b65a0 msgr2=0x7f9a9c0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T00:13:14.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 shutdown_connections 2024-04-01T00:13:14.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-01T00:13:14.034+0000 7f9aa1a8f640 1 -- 172.21.15.120:0/4248167662 wait complete. 2024-04-01T00:13:14.048 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-01T00:13:14.048 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-01T00:13:14.049 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-01T00:13:14.049 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:14.066 INFO:tasks.ceph.mds.a:Stopped 2024-04-01T00:13:14.066 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-01T00:13:14.066 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:14.123 INFO:tasks.ceph.mds.c:Stopped 2024-04-01T00:13:14.124 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-01T00:13:14.124 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:14.137 INFO:tasks.ceph.mds.b:Stopped 2024-04-01T00:13:14.137 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-01T00:13:14.137 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:14.190 INFO:tasks.ceph.mds.d:Stopped 2024-04-01T00:13:14.190 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-01T00:13:14.190 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-01T00:13:14.190 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:19.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-01T00:13:20.292 INFO:tasks.ceph.osd.0:Stopped 2024-04-01T00:13:20.293 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-01T00:13:20.294 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:25.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-01T00:13:25.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-01T00:13:26.396 INFO:tasks.ceph.osd.1:Stopped 2024-04-01T00:13:26.397 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-01T00:13:26.397 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:31.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-01T00:13:31.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-01T00:13:32.499 INFO:tasks.ceph.osd.2:Stopped 2024-04-01T00:13:32.499 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-01T00:13:32.499 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:37.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-01T00:13:37.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-01T00:13:38.601 INFO:tasks.ceph.osd.3:Stopped 2024-04-01T00:13:38.601 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-01T00:13:38.601 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:38.674 INFO:tasks.ceph.osd.4:Stopped 2024-04-01T00:13:38.675 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-01T00:13:38.675 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:43.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-01T00:13:43.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-01T00:13:44.777 INFO:tasks.ceph.osd.5:Stopped 2024-04-01T00:13:44.778 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-01T00:13:44.778 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:44.877 INFO:tasks.ceph.osd.6:Stopped 2024-04-01T00:13:44.878 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-01T00:13:44.878 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:49.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-01T00:13:49.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-01T00:13:50.979 INFO:tasks.ceph.osd.7:Stopped 2024-04-01T00:13:50.982 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-01T00:13:50.983 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-01T00:13:50.983 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:51.084 INFO:tasks.ceph.mgr.y:Stopped 2024-04-01T00:13:51.084 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-01T00:13:51.084 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:51.117 INFO:tasks.ceph.mgr.x:Stopped 2024-04-01T00:13:51.117 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-01T00:13:51.117 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-01T00:13:51.117 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:51.178 INFO:tasks.ceph.mon.a:Stopped 2024-04-01T00:13:51.178 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-01T00:13:51.178 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:51.202 INFO:tasks.ceph.mon.b:Stopped 2024-04-01T00:13:51.203 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-01T00:13:51.203 INFO:teuthology.orchestra.run:waiting for 300 2024-04-01T00:13:51.266 INFO:tasks.ceph.mon.c:Stopped 2024-04-01T00:13:51.266 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-01T00:13:51.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-01T00:13:51.419 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-01T00:13:51.419 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-01T00:13:51.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-01T00:13:51.687 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-01T00:13:51.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-01T00:13:51.848 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-01T00:13:52.015 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-01T00:13:52.016 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-01T00:13:52.241 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-01T00:13:52.241 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-01T00:13:52.495 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-01T00:13:52.495 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-01T00:13:52.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-01T00:13:52.623 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-01T00:13:52.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-01T00:13:52.756 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-01T00:13:52.897 INFO:tasks.ceph:Archiving mon data... 2024-04-01T00:13:52.899 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/data/mon.a.tgz 2024-04-01T00:13:52.899 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-04-01T00:13:52.931 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.vEnNZA5f7f 2024-04-01T00:13:52.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vEnNZA5f7f 2024-04-01T00:13:53.161 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.vEnNZA5f7f 2024-04-01T00:13:53.282 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.vEnNZA5f7f is 642KB 2024-04-01T00:13:53.366 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.vEnNZA5f7f 2024-04-01T00:13:53.395 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/data/mon.b.tgz 2024-04-01T00:13:53.395 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-04-01T00:13:53.411 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.YYtMvMwkK7 2024-04-01T00:13:53.412 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.YYtMvMwkK7 2024-04-01T00:13:53.591 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.YYtMvMwkK7 2024-04-01T00:13:53.698 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.YYtMvMwkK7 is 653KB 2024-04-01T00:13:53.769 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.YYtMvMwkK7 2024-04-01T00:13:53.784 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/data/mon.c.tgz 2024-04-01T00:13:53.784 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-04-01T00:13:53.837 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.3w2HzM7vBE 2024-04-01T00:13:53.838 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3w2HzM7vBE 2024-04-01T00:13:54.003 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.3w2HzM7vBE 2024-04-01T00:13:54.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-01T00:13:54.088 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.3w2HzM7vBE is 652KB 2024-04-01T00:13:54.188 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.3w2HzM7vBE 2024-04-01T00:13:54.202 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-01T00:13:54.203 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T00:13:54.206 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-01T00:13:54.306 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-01T00:13:54.324 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-01T00:13:54.324 INFO:tasks.ceph:Archiving crash dumps... 2024-04-01T00:13:54.326 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/remote/smithi120/crash 2024-04-01T00:13:54.327 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T00:13:54.398 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/remote/smithi203/crash 2024-04-01T00:13:54.399 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-01T00:13:54.426 INFO:tasks.ceph:Shutting down logrotate 2024-04-01T00:15:25.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T00:15:25.583 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-01T00:15:25.616 INFO:tasks.ceph:Compressing logs... 2024-04-01T00:15:25.617 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T00:15:25.620 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-01T00:15:25.687 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-01T00:15:25.688 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44374.log 2024-04-01T00:15:25.688 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37249.log 2024-04-01T00:15:25.688 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.3.44374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37489.log 2024-04-01T00:15:25.688 INFO:teuthology.orchestra.run.smithi203.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44374.log.gz 2024-04-01T00:15:25.688 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37369.log 2024-04-01T00:15:25.693 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37489.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T00:15:25.693 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37369.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-01T00:15:25.693 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37529.log 2024-04-01T00:15:25.693 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-01T00:15:25.693 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37409.log 2024-04-01T00:15:25.694 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-01T00:15:25.694 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37409.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-01T00:15:25.694 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37449.log 2024-04-01T00:15:25.694 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44370.log 2024-04-01T00:15:25.694 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37289.log 2024-04-01T00:15:25.694 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-01T00:15:25.694 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.3.44370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44370.log.gz 2024-04-01T00:15:25.694 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37329.log 2024-04-01T00:15:25.695 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43974.log 2024-04-01T00:15:25.695 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.37329.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T00:15:25.695 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-01T00:15:25.695 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.1.43974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43974.log.gz 2024-04-01T00:15:25.695 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43967.log 2024-04-01T00:15:25.695 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-01T00:15:25.695 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.1.43967.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-01T00:15:25.695 INFO:teuthology.orchestra.run.smithi203.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43967.log.gz 2024-04-01T00:15:25.706 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226676.log 2024-04-01T00:15:25.707 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571607.log 2024-04-01T00:15:25.707 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410787.log 2024-04-01T00:15:25.708 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593139.log 2024-04-01T00:15:25.709 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704269.log 2024-04-01T00:15:25.709 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596150.log 2024-04-01T00:15:25.710 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175706.log 2024-04-01T00:15:25.711 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730222.log 2024-04-01T00:15:25.711 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347983.log 2024-04-01T00:15:25.711 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243206.log 2024-04-01T00:15:25.712 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110753.log 2024-04-01T00:15:25.713 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2024-04-01T00:15:25.713 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173434.log 2024-04-01T00:15:25.714 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591077.log 2024-04-01T00:15:25.714 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47410.log 2024-04-01T00:15:25.715 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210090.log 2024-04-01T00:15:25.715 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176555.log 2024-04-01T00:15:25.716 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279896.log 2024-04-01T00:15:25.716 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194257.log 2024-04-01T00:15:25.717 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619549.log 2024-04-01T00:15:25.718 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2024-04-01T00:15:25.718 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44770.log 2024-04-01T00:15:25.719 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242284.log 2024-04-01T00:15:25.719 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216152.log 2024-04-01T00:15:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705984.log 2024-04-01T00:15:25.720 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194244.log 2024-04-01T00:15:25.721 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226676.log: /var/log/ceph/ceph-client.admin.571607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126870.log 2024-04-01T00:15:25.722 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620020.log 2024-04-01T00:15:25.723 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537531.log 2024-04-01T00:15:25.723 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239805.log 2024-04-01T00:15:25.724 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241294.log 2024-04-01T00:15:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210021.log 2024-04-01T00:15:25.725 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235876.log 2024-04-01T00:15:25.726 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319456.log 2024-04-01T00:15:25.726 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327335.log 2024-04-01T00:15:25.727 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709758.log 2024-04-01T00:15:25.728 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113156.log 2024-04-01T00:15:25.728 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535487.log 2024-04-01T00:15:25.729 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146004.log 2024-04-01T00:15:25.729 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560945.log 2024-04-01T00:15:25.730 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193220.log 2024-04-01T00:15:25.731 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312844.log 2024-04-01T00:15:25.731 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153971.log 2024-04-01T00:15:25.732 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605979.log 2024-04-01T00:15:25.732 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564211.log 2024-04-01T00:15:25.733 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118080.log 2024-04-01T00:15:25.734 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243137.log 2024-04-01T00:15:25.734 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112635.log 2024-04-01T00:15:25.735 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155673.log 2024-04-01T00:15:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602751.log 2024-04-01T00:15:25.736 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687654.log 2024-04-01T00:15:25.737 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616749.log 2024-04-01T00:15:25.737 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339958.log 2024-04-01T00:15:25.738 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357611.log 2024-04-01T00:15:25.738 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268261.log 2024-04-01T00:15:25.739 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307007.log 2024-04-01T00:15:25.740 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223071.log 2024-04-01T00:15:25.740 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291694.log 2024-04-01T00:15:25.741 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260311.log 2024-04-01T00:15:25.741 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572890.log 2024-04-01T00:15:25.742 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709976.log 2024-04-01T00:15:25.742 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351632.log 2024-04-01T00:15:25.743 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2024-04-01T00:15:25.744 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247032.log 2024-04-01T00:15:25.744 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339945.log 2024-04-01T00:15:25.745 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843543.log 2024-04-01T00:15:25.746 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.593139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307885.log 2024-04-01T00:15:25.746 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559590.log 2024-04-01T00:15:25.748 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597109.log 2024-04-01T00:15:25.748 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.410787.log: /var/log/ceph/ceph-client.admin.704269.log: /var/log/ceph/ceph-client.admin.596150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704269.log.gz 2024-04-01T00:15:25.748 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.730222.log: /var/log/ceph/ceph-client.admin.591077.log: /var/log/ceph/ceph-client.admin.619549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410787.log.gz 2024-04-01T00:15:25.748 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596150.log.gz -- replaced with /var/log/ceph/ceph-client.admin.226676.log.gz 2024-04-01T00:15:25.748 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:25.751 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730222.log.gz 2024-04-01T00:15:25.751 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242284.log: /var/log/ceph/ceph-client.admin.559590.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243206.log.gz -- replaced with /var/log/ceph/ceph-client.admin.571607.log.gz 2024-04-01T00:15:25.751 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:25.751 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44430.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.591077.log.gz --verbose 2024-04-01T00:15:25.751 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph.tmp-client.admin.31558.log 2024-04-01T00:15:25.751 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.173434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242284.log.gz 2024-04-01T00:15:25.751 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47410.log: /var/log/ceph/ceph-client.admin.176555.log: /var/log/ceph/ceph-client.admin.279896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559590.log.gz 2024-04-01T00:15:25.751 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176555.log.gz 2024-04-01T00:15:25.752 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.173434.log.gz 2024-04-01T00:15:25.752 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279896.log.gz 2024-04-01T00:15:25.752 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50106.log: /var/log/ceph/ceph-client.admin.44770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707581.log 2024-04-01T00:15:25.752 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-01T00:15:25.752 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548211.log 2024-04-01T00:15:25.769 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.357611.log: /var/log/ceph/ceph-client.admin.620020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228613.log 2024-04-01T00:15:25.770 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.175706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357611.log.gz 2024-04-01T00:15:25.770 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mon.a.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620020.log.gz 2024-04-01T00:15:25.770 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.194257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175706.log.gz 2024-04-01T00:15:25.770 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287929.log 2024-04-01T00:15:25.770 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194257.log.gz 2024-04-01T00:15:25.770 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.216152.log: /var/log/ceph/ceph-client.admin.347983.log: /var/log/ceph/ceph-client.admin.709758.log: /var/log/ceph/ceph-client.admin.605979.log: /var/log/ceph/ceph-client.admin.602751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210090.log.gz 2024-04-01T00:15:25.770 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216152.log.gz 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.110753.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605979.log.gz -- replaced with /var/log/ceph/ceph-client.admin.602751.log.gz 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.687654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347983.log.gz 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.616749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110753.log.gz 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709976.log: /var/log/ceph/ceph-client.admin.572890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687654.log.gz 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593139.log.gz 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709758.log.gz 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705984.log.gz 2024-04-01T00:15:25.771 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843543.log.gz 2024-04-01T00:15:25.772 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572890.log.gz 2024-04-01T00:15:25.772 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0%/var/log/ceph/ceph-client.admin.194244.log: -- replaced with /var/log/ceph/ceph-client.admin.619549.log.gz 2024-04-01T00:15:25.772 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597109.log: /var/log/ceph/ceph-client.admin.126870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194244.log.gz 2024-04-01T00:15:25.772 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158516.log 2024-04-01T00:15:25.772 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.560945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126870.log.gz 2024-04-01T00:15:25.772 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.291694.log: /var/log/ceph/ceph-client.admin.235876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291694.log.gz 2024-04-01T00:15:25.772 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597109.log.gz 2024-04-01T00:15:25.772 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560945.log.gz 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.239805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235876.log.gz 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410800.log 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239805.log.gz 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.307007.log: /var/log/ceph/ceph-client.admin.113156.log: /var/log/ceph/ceph-client.admin.537531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210021.log.gz 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307007.log.gz 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.158516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113156.log.gz 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158516.log.gz 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.287929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537531.log.gz 2024-04-01T00:15:25.773 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355628.log 2024-04-01T00:15:25.774 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.327335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287929.log.gz 2024-04-01T00:15:25.774 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.319456.log: /var/log/ceph/ceph-client.admin.241294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146004.log.gz 2024-04-01T00:15:25.774 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327335.log.gz 2024-04-01T00:15:25.774 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.193220.log: /var/log/ceph/ceph-client.admin.351632.log: 0.0%/var/log/ceph/ceph-client.admin.153971.log: -- replaced with /var/log/ceph/ceph-client.admin.319456.log.gz 2024-04-01T00:15:25.774 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0%/var/log/ceph/ceph-client.admin.312844.log: -- replaced with /var/log/ceph/ceph-client.admin.241294.log.gz 2024-04-01T00:15:25.774 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153971.log.gz 2024-04-01T00:15:25.774 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.193220.log.gz 2024-04-01T00:15:25.774 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312844.log.gz 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.535487.log: /var/log/ceph/ceph-client.admin.112635.log: 0.0%/var/log/ceph/ceph-client.admin.564211.log: -- replaced with /var/log/ceph/ceph-client.admin.112635.log.gz 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243137.log: /var/log/ceph/ceph-client.admin.247032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.535487.log.gz 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351632.log.gz 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.118080.log: /var/log/ceph/ceph-client.admin.307885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247032.log.gz 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564211.log.gz 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307885.log.gz 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.339958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569621.log 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118080.log.gz 2024-04-01T00:15:25.775 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339958.log.gz 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.268261.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243137.log.gz -- replaced with /var/log/ceph/ceph-client.admin.155673.log.gz 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268261.log.gz 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44770.log.gz 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.355628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223071.log.gz 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50232.log: /var/log/ceph/ceph-client.admin.260311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355628.log.gz 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.339945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260311.log.gz 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707581.log: /var/log/ceph/ceph.tmp-client.admin.31558.log: /var/log/ceph/ceph-client.admin.548211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575096.log 2024-04-01T00:15:25.776 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339945.log.gz 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31558.log.gz 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707581.log.gz -- replaced with /var/log/ceph/ceph-client.admin.548211.log.gz 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616749.log.gz 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0%/var/log/ceph/ceph-client.admin.410800.log: -- replaced with /var/log/ceph/ceph-client.admin.709976.log.gz 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604421.log 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.569621.log: /var/log/ceph/ceph-client.admin.228613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228613.log.gz 2024-04-01T00:15:25.777 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410800.log.gz 2024-04-01T00:15:25.778 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569621.log.gz 2024-04-01T00:15:25.778 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.575096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157556.log 2024-04-01T00:15:25.778 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575096.log.gz 2024-04-01T00:15:25.778 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714082.log 2024-04-01T00:15:25.778 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604421.log.gz 2024-04-01T00:15:25.778 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2024-04-01T00:15:25.778 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157556.log.gz 2024-04-01T00:15:25.778 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729952.log 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44431.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47410.log.gz 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.714082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236163.log 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714082.log.gz 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291201.log 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.729952.log: /var/log/ceph/ceph-client.admin.236163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236163.log.gz 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729952.log.gz 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360131.log 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.291201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163129.log 2024-04-01T00:15:25.779 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291201.log.gz 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345557.log 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.163129.log: /var/log/ceph/ceph-client.admin.360131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163129.log.gz 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360131.log.gz 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614956.log 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594013.log 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.345557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345557.log.gz 2024-04-01T00:15:25.780 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195133.log 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.614956.log: /var/log/ceph/ceph-client.admin.594013.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614956.log.gz -- replaced with /var/log/ceph/ceph-client.admin.594013.log.gz 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278687.log 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.195133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322355.log 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195133.log.gz 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195903.log 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.278687.log: /var/log/ceph/ceph-client.admin.322355.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322355.log.gz 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.278687.log.gz 2024-04-01T00:15:25.781 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669129.log 2024-04-01T00:15:25.782 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.195903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237889.log 2024-04-01T00:15:25.782 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195903.log.gz 2024-04-01T00:15:25.782 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49925.log 2024-04-01T00:15:25.782 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.669129.log: /var/log/ceph/ceph-client.admin.237889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237889.log.gz 2024-04-01T00:15:25.782 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669129.log.gz 2024-04-01T00:15:25.782 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675124.log 2024-04-01T00:15:25.801 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255666.log 2024-04-01T00:15:25.801 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146733.log 2024-04-01T00:15:25.801 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675124.log: /var/log/ceph/ceph-client.admin.255666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255666.log.gz 2024-04-01T00:15:25.802 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675124.log.gz 2024-04-01T00:15:25.802 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292627.log 2024-04-01T00:15:25.802 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708047.log 2024-04-01T00:15:25.802 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146733.log.gz 2024-04-01T00:15:25.802 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162684.log 2024-04-01T00:15:25.802 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.292627.log: /var/log/ceph/ceph-client.admin.708047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708047.log.gz 2024-04-01T00:15:25.802 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292627.log.gz 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606416.log 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.162684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162684.log.gz 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212838.log 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.606416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44003.log 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606416.log.gz 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615985.log 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.212838.log: /var/log/ceph/ceph-client.admin.44003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212838.log.gz 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299731.log 2024-04-01T00:15:25.803 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158956.log 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.615985.log: /var/log/ceph/ceph-client.admin.299731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299731.log.gz 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615985.log.gz 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338653.log 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.158956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724658.log 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158956.log.gz 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323557.log 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338653.log: /var/log/ceph/ceph-client.admin.724658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724658.log.gz 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338653.log.gz 2024-04-01T00:15:25.804 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321372.log 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.323557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714987.log 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323557.log.gz 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832953.log 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.321372.log: /var/log/ceph/ceph-client.admin.714987.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714987.log.gz 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321372.log.gz 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671977.log 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.832953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333326.log 2024-04-01T00:15:25.805 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832953.log.gz 2024-04-01T00:15:25.806 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598277.log 2024-04-01T00:15:25.806 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671977.log.gz 2024-04-01T00:15:25.806 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597096.log 2024-04-01T00:15:25.806 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.598277.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49925.log.gz 2024-04-01T00:15:25.806 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598277.log.gz 2024-04-01T00:15:25.806 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.333326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239613.log 2024-04-01T00:15:25.806 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333326.log.gz 2024-04-01T00:15:25.806 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729751.log 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597096.log.gz 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319469.log 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.239613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239613.log.gz 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537330.log 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.729751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729751.log.gz 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381775.log 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.319469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252572.log 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319469.log.gz 2024-04-01T00:15:25.807 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.381775.log: /var/log/ceph/ceph-client.admin.537330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381775.log.gz 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44003.log.gz 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325087.log 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537330.log.gz 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145802.log 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.252572.log: /var/log/ceph/ceph-client.admin.325087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325087.log.gz 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252572.log.gz 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569237.log 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691630.log 2024-04-01T00:15:25.808 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145802.log.gz 2024-04-01T00:15:25.809 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.838013.log 2024-04-01T00:15:25.809 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.569237.log: /var/log/ceph/ceph-client.admin.691630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691630.log.gz 2024-04-01T00:15:25.809 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569237.log.gz 2024-04-01T00:15:25.809 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240336.log 2024-04-01T00:15:25.809 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561355.log 2024-04-01T00:15:25.809 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.838013.log: /var/log/ceph/ceph-client.admin.240336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240336.log.gz 2024-04-01T00:15:25.809 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.838013.log.gz 2024-04-01T00:15:25.809 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255735.log 2024-04-01T00:15:25.810 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.561355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841132.log 2024-04-01T00:15:25.810 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561355.log.gz 2024-04-01T00:15:25.810 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174424.log 2024-04-01T00:15:25.810 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.255735.log: /var/log/ceph/ceph-client.admin.841132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841132.log.gz 2024-04-01T00:15:25.810 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255735.log.gz 2024-04-01T00:15:25.810 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843248.log 2024-04-01T00:15:25.810 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228324.log 2024-04-01T00:15:25.810 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.174424.log: /var/log/ceph/ceph-client.admin.843248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843248.log.gz 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174424.log.gz 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357088.log 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232612.log 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.228324.log: /var/log/ceph/ceph-client.admin.357088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357088.log.gz 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228324.log.gz 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724092.log 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141650.log 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.232612.log: /var/log/ceph/ceph-client.admin.724092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724092.log.gz 2024-04-01T00:15:25.811 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232612.log.gz 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618042.log 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604713.log 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.141650.log: /var/log/ceph/ceph-client.admin.618042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618042.log.gz 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141650.log.gz 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109692.log 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226689.log 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604713.log: /var/log/ceph/ceph-client.admin.109692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109692.log.gz 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604713.log.gz 2024-04-01T00:15:25.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327253.log 2024-04-01T00:15:25.813 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222989.log 2024-04-01T00:15:25.813 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.327253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327253.log.gz 2024-04-01T00:15:25.813 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226689.log.gz 2024-04-01T00:15:25.813 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43607.log 2024-04-01T00:15:25.813 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704462.log 2024-04-01T00:15:25.813 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222989.log.gz 2024-04-01T00:15:25.813 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569224.log 2024-04-01T00:15:25.813 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307967.log 2024-04-01T00:15:25.814 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.569224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569224.log.gz 2024-04-01T00:15:25.814 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.704462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704462.log.gz 2024-04-01T00:15:25.814 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287368.log 2024-04-01T00:15:25.814 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285211.log 2024-04-01T00:15:25.814 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.287368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287368.log.gz 2024-04-01T00:15:25.814 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.307967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307967.log.gz 2024-04-01T00:15:25.814 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243903.log 2024-04-01T00:15:25.832 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592271.log 2024-04-01T00:15:25.832 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285211.log.gz 2024-04-01T00:15:25.832 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848015.log 2024-04-01T00:15:25.832 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.592271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592271.log.gz 2024-04-01T00:15:25.832 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243903.log.gz 2024-04-01T00:15:25.832 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595309.log 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568663.log 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45137.log 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.595309.log: /var/log/ceph/ceph-client.admin.568663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568663.log.gz 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595309.log.gz 88.1% 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.848015.log.gz 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111198.log 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563261.log 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233962.log 2024-04-01T00:15:25.833 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.563261.log: 0.0%/var/log/ceph/ceph-client.admin.111198.log: -- replaced with /var/log/ceph/ceph-client.admin.563261.log.gz 2024-04-01T00:15:25.834 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111198.log.gz 2024-04-01T00:15:25.834 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2024-04-01T00:15:25.834 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.233962.log: /var/log/ceph/ceph-client.admin.408890.log 2024-04-01T00:15:25.834 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233962.log.gz 2024-04-01T00:15:25.834 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173964.log 2024-04-01T00:15:25.834 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.408890.log: /var/log/ceph/ceph-client.admin.46906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408890.log.gz 2024-04-01T00:15:25.834 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231236.log 2024-04-01T00:15:25.834 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.173964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394639.log 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173964.log.gz 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552049.log 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.231236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212907.log 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.394639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231236.log.gz 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540304.log 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.552049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552049.log.gz 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560684.log 2024-04-01T00:15:25.835 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.540304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.540304.log.gz 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.212907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476027.log 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212907.log.gz 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599958.log 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.476027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476027.log.gz 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.560684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233022.log 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560684.log.gz 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336335.log 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.233022.log: /var/log/ceph/ceph-client.admin.599958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233022.log.gz 2024-04-01T00:15:25.836 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599958.log.gz 2024-04-01T00:15:25.837 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162239.log 2024-04-01T00:15:25.837 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847300.log 2024-04-01T00:15:25.837 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540103.log 2024-04-01T00:15:25.837 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.336335.log: /var/log/ceph/ceph-client.admin.847300.log: /var/log/ceph/ceph-client.admin.162239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336335.log.gz 2024-04-01T00:15:25.837 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.847300.log.gz 2024-04-01T00:15:25.837 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162239.log.gz 2024-04-01T00:15:25.837 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383312.log 2024-04-01T00:15:25.837 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728587.log 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.383312.log: /var/log/ceph/ceph-client.admin.540103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669047.log 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341604.log 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.540103.log.gz 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45137.log.gz 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.669047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669047.log.gz 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.728587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715286.log 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728587.log.gz 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161258.log 2024-04-01T00:15:25.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.715286.log: /var/log/ceph/ceph-client.admin.341604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715286.log.gz 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341604.log.gz 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221230.log 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351258.log 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.221230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221230.log.gz 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.161258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572504.log 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161258.log.gz 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604147.log 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.572504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572504.log.gz 2024-04-01T00:15:25.839 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.351258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351258.log.gz 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143507.log 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234522.log 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143507.log.gz 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604147.log.gz 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705971.log 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49129.log: /var/log/ceph/ceph-client.admin.234522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234522.log.gz 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177240.log 2024-04-01T00:15:25.840 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394639.log.gz -- replaced with /var/log/ceph/ceph-client.admin.383312.log.gz 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594861.log 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705971.log.gz 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352183.log 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.177240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210598.log 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177240.log.gz 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.352183.log: /var/log/ceph/ceph-client.admin.594861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352183.log.gz 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594861.log.gz 2024-04-01T00:15:25.841 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688345.log 2024-04-01T00:15:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382239.log 2024-04-01T00:15:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210598.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2024-04-01T00:15:25.842 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210598.log.gz 2024-04-01T00:15:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730872.log 2024-04-01T00:15:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688345.log.gz 2024-04-01T00:15:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618522.log 2024-04-01T00:15:25.842 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.382239.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz 2024-04-01T00:15:25.842 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382239.log.gz 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161691.log 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.730872.log: /var/log/ceph/ceph-client.admin.618522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618522.log.gz 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730872.log.gz 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145073.log 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.161691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145356.log 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161691.log.gz 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302521.log 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145073.log.gz 2024-04-01T00:15:25.843 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288806.log 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302521.log.gz 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145356.log.gz 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281582.log 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308438.log 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288806.log: /var/log/ceph/ceph-client.admin.281582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281582.log.gz 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288806.log.gz 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.835669.log 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.308438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304512.log 2024-04-01T00:15:25.844 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308438.log.gz 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549947.log 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.835669.log: /var/log/ceph/ceph-client.admin.304512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214782.log 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.835669.log.gz 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304512.log.gz 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.549947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.549947.log.gz 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583866.log 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248797.log 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583866.log.gz 2024-04-01T00:15:25.845 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.214782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214782.log.gz 2024-04-01T00:15:25.846 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568752.log 2024-04-01T00:15:25.846 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.248797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213109.log 2024-04-01T00:15:25.846 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248797.log.gz 2024-04-01T00:15:25.848 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37249.log.gz 2024-04-01T00:15:25.848 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37289.log.gz 2024-04-01T00:15:25.848 INFO:teuthology.orchestra.run.smithi203.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37329.log.gz 2024-04-01T00:15:25.848 INFO:teuthology.orchestra.run.smithi203.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37369.log.gz 2024-04-01T00:15:25.848 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37409.log.gz 2024-04-01T00:15:25.848 INFO:teuthology.orchestra.run.smithi203.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T00:15:25.865 INFO:teuthology.orchestra.run.smithi203.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37449.log.gz 2024-04-01T00:15:25.866 INFO:teuthology.orchestra.run.smithi203.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37489.log.gz 2024-04-01T00:15:25.871 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620954.log 2024-04-01T00:15:25.872 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568752.log: /var/log/ceph/ceph-client.admin.213109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213109.log.gz 2024-04-01T00:15:25.872 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568752.log.gz 2024-04-01T00:15:25.872 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556475.log 2024-04-01T00:15:25.872 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-04-01T00:15:25.872 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.620954.log: gzip/var/log/ceph/ceph-client.admin.556475.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.692667.log 2024-04-01T00:15:25.872 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620954.log.gz 2024-04-01T00:15:25.872 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556475.log.gz 2024-04-01T00:15:25.872 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695400.log 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692667.log.gz 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723221.log 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728382.log 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.695400.log: /var/log/ceph/ceph-client.admin.723221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723221.log.gz 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695400.log.gz 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285690.log 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.728382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176242.log 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728382.log.gz 2024-04-01T00:15:25.873 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270501.log 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285690.log: /var/log/ceph/ceph-client.admin.176242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176242.log.gz 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285690.log.gz 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560018.log 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.270501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206077.log 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270501.log.gz 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317106.log 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.560018.log: /var/log/ceph/ceph-client.admin.206077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322286.log 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560018.log.gz 2024-04-01T00:15:25.874 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206077.log.gz 2024-04-01T00:15:25.875 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.317106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317106.log.gz 2024-04-01T00:15:25.875 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671895.log 2024-04-01T00:15:25.875 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.322286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260504.log 2024-04-01T00:15:25.875 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-04-01T00:15:25.875 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322286.log.gz 2024-04-01T00:15:25.875 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128121.log 2024-04-01T00:15:25.875 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671895.log: /var/log/ceph/ceph-client.admin.260504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260504.log.gz 2024-04-01T00:15:25.875 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671895.log.gz 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219392.log 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.128121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310838.log 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128121.log.gz 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571319.log 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.219392.log: /var/log/ceph/ceph-client.admin.310838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310838.log.gz 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219392.log.gz 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254591.log 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44255.log 2024-04-01T00:15:25.876 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.254591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254591.log.gz 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.571319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571319.log.gz 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542926.log 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688427.log 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44255.log: /var/log/ceph/ceph-client.admin.542926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.542926.log.gz 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213386.log 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118515.log 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.213386.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44255.log.gz 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213386.log.gz 2024-04-01T00:15:25.877 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688427.log.gz 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257053.log 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.118515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394216.log 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118515.log.gz 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617135.log 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.257053.log: /var/log/ceph/ceph-client.admin.394216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394216.log.gz 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257053.log.gz 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562782.log 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228393.log 2024-04-01T00:15:25.878 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.617135.log: /var/log/ceph/ceph-client.admin.562782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562782.log.gz 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617135.log.gz 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205018.log 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.admin.228393.log: --verbose -- /var/log/ceph/ceph-client.admin.336130.log 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228393.log.gz 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160401.log 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.205018.log: /var/log/ceph/ceph-client.admin.336130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336130.log.gz 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205018.log.gz 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267987.log 2024-04-01T00:15:25.879 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710250.log 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160401.log: /var/log/ceph/ceph-client.admin.267987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267987.log.gz 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160401.log.gz 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310098.log 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848814.log 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710250.log: /var/log/ceph/ceph-client.admin.310098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310098.log.gz 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710250.log.gz 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208276.log 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338842.log 2024-04-01T00:15:25.880 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.208276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208276.log.gz 2024-04-01T00:15:25.881 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726080.log 2024-04-01T00:15:25.882 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338842.log.gz 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 87.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.848814.log.gz 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.167351.log 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310769.log 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.167351.log: /var/log/ceph/ceph-client.admin.726080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167351.log.gz 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726080.log.gz 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286443.log 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162671.log 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.286443.log: /var/log/ceph/ceph-client.admin.310769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286443.log.gz 2024-04-01T00:15:25.883 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310769.log.gz 2024-04-01T00:15:25.884 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124309.log 2024-04-01T00:15:25.884 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349152.log 2024-04-01T00:15:25.884 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.162671.log: /var/log/ceph/ceph-client.admin.124309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124309.log.gz 2024-04-01T00:15:25.884 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162671.log.gz 2024-04-01T00:15:25.884 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265961.log 2024-04-01T00:15:25.884 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.834394.log 2024-04-01T00:15:25.884 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.265961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265961.log.gz 2024-04-01T00:15:25.884 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.349152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349152.log.gz 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213399.log 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313179.log 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.834394.log: /var/log/ceph/ceph-client.admin.213399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213399.log.gz 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.834394.log.gz 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408808.log 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.313179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313179.log.gz 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146261.log 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.408808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251227.log 2024-04-01T00:15:25.885 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408808.log.gz 2024-04-01T00:15:25.886 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152303.log 2024-04-01T00:15:25.886 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146261.log: /var/log/ceph/ceph-client.admin.251227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251227.log.gz 2024-04-01T00:15:25.886 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146261.log.gz 2024-04-01T00:15:25.886 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145991.log 2024-04-01T00:15:25.886 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.152303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152303.log.gz 2024-04-01T00:15:25.886 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547764.log 2024-04-01T00:15:25.886 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705025.log 2024-04-01T00:15:25.886 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145991.log.gz 2024-04-01T00:15:25.887 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339668.log 2024-04-01T00:15:25.887 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.547764.log: /var/log/ceph/ceph-client.admin.705025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705025.log.gz 2024-04-01T00:15:25.887 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.547764.log.gz 2024-04-01T00:15:25.887 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160897.log 2024-04-01T00:15:25.887 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.339668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235397.log 2024-04-01T00:15:25.887 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339668.log.gz 2024-04-01T00:15:25.887 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48163.log 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160897.log.gz 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235397.log.gz 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223541.log 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848268.log 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171966.log 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223541.log: /var/log/ceph/ceph-client.admin.848268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223541.log.gz 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.848268.log.gz 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156576.log 2024-04-01T00:15:25.888 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.171966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601870.log 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171966.log.gz 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596163.log 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.156576.log: /var/log/ceph/ceph-client.admin.601870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601870.log.gz 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156576.log.gz 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212459.log 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.596163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596163.log.gz 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273683.log 2024-04-01T00:15:25.889 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44129.log: /var/log/ceph/ceph-client.admin.212459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212459.log.gz 2024-04-01T00:15:25.890 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37529.log.gz 2024-04-01T00:15:25.917 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-04-01T00:15:25.917 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410316.log 2024-04-01T00:15:25.917 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.273683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571594.log 2024-04-01T00:15:25.917 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273683.log.gz 2024-04-01T00:15:25.917 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2024-04-01T00:15:25.917 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.410316.log: /var/log/ceph/ceph-client.admin.571594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571594.log.gz 2024-04-01T00:15:25.917 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410316.log.gz 2024-04-01T00:15:25.918 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553286.log 2024-04-01T00:15:25.918 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571306.log 2024-04-01T00:15:25.918 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411259.log 2024-04-01T00:15:25.918 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.553286.log: /var/log/ceph/ceph-client.admin.571306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571306.log.gz 2024-04-01T00:15:25.918 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553286.log.gz 2024-04-01T00:15:25.918 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223746.log 2024-04-01T00:15:25.918 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.411259.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48163.log.gz 2024-04-01T00:15:25.918 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411259.log.gz 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574636.log 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616762.log 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.574636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574636.log.gz 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320390.log 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223746.log.gz 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.616762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616762.log.gz 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144155.log 2024-04-01T00:15:25.919 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274569.log 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144155.log.gz 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320390.log.gz 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48793.log 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409092.log 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274569.log.gz 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168716.log 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409092.log.gz/var/log/ceph/ceph-client.admin.48793.log: 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330505.log 2024-04-01T00:15:25.920 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313354.log 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.330505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330505.log.gz 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.168716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168716.log.gz 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383230.log 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354233.log 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.383230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383230.log.gz 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.313354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313354.log.gz 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329076.log 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724576.log 2024-04-01T00:15:25.921 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329076.log.gz 2024-04-01T00:15:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.354233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354233.log.gz 2024-04-01T00:15:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543511.log 2024-04-01T00:15:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.724576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724576.log.gz 2024-04-01T00:15:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234249.log 2024-04-01T00:15:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342155.log 2024-04-01T00:15:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.234249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234249.log.gz 2024-04-01T00:15:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.543511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.543511.log.gz 2024-04-01T00:15:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174948.log 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195146.log 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.174948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174948.log.gz 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.342155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342155.log.gz 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847216.log 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.195146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195146.log.gz 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355641.log 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846996.log 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.355641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355641.log.gz 2024-04-01T00:15:25.923 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114931.log 2024-04-01T00:15:25.924 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.846996.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.847216.log.gz 2024-04-01T00:15:25.924 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.846996.log.gz 2024-04-01T00:15:25.924 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535405.log 2024-04-01T00:15:25.924 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693494.log 2024-04-01T00:15:25.924 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.535405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.535405.log.gz 2024-04-01T00:15:25.924 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.114931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114931.log.gz 2024-04-01T00:15:25.924 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692289.log 2024-04-01T00:15:25.924 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.693494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693494.log.gz 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281500.log 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692289.log.gz 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722763.log 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.281500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284268.log 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281500.log.gz 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338370.log 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284268.log.gz 2024-04-01T00:15:25.925 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.722763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722763.log.gz 2024-04-01T00:15:25.926 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614698.log 2024-04-01T00:15:25.926 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283140.log 2024-04-01T00:15:25.926 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338370.log: /var/log/ceph/ceph-client.admin.614698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614698.log.gz 2024-04-01T00:15:25.926 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338370.log.gz 2024-04-01T00:15:25.926 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358113.log 2024-04-01T00:15:25.926 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848950.log 2024-04-01T00:15:25.926 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283140.log.gz 2024-04-01T00:15:25.926 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706177.log 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.358113.log: /var/log/ceph/ceph-client.admin.848950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358113.log.gz 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.848950.log.gz 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49335.log 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.706177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541018.log 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706177.log.gz 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229834.log 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.541018.log: /var/log/ceph/ceph-client.admin.49335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.541018.log.gz 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321044.log 2024-04-01T00:15:25.927 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.229834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713316.log 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229834.log.gz 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847781.log 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.321044.log: /var/log/ceph/ceph-client.admin.713316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713316.log.gz 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321044.log.gz 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231223.log 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159492.log 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847781.log: /var/log/ceph/ceph-client.admin.231223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231223.log.gz 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159964.log 2024-04-01T00:15:25.928 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.847781.log.gz 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43477.log 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.159492.log: /var/log/ceph/ceph-client.admin.159964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159964.log.gz 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159492.log.gz 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176204.log 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406529.log 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.176204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.837548.log 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176204.log.gz 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242764.log 2024-04-01T00:15:25.929 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.837548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.837548.log.gz 2024-04-01T00:15:25.930 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.406529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406529.log.gz 2024-04-01T00:15:25.930 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156645.log 2024-04-01T00:15:25.930 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698969.log 2024-04-01T00:15:25.930 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242764.log: /var/log/ceph/ceph-client.admin.156645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156645.log.gz 2024-04-01T00:15:25.930 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242764.log.gz 2024-04-01T00:15:25.930 INFO:teuthology.orchestra.run.smithi120.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49335.log.gz 2024-04-01T00:15:25.930 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339204.log 2024-04-01T00:15:25.930 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.698969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49795.log 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698969.log.gz 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.339204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154870.log 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339204.log.gz 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265892.log 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.154870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154870.log.gz 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239121.log 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.265892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599153.log 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265892.log.gz 2024-04-01T00:15:25.931 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326023.log 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.599153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599153.log.gz 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.239121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239121.log.gz 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568095.log 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49795.log.gz 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43477.log.gz 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.326023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126322.log 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326023.log.gz 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148100.log 2024-04-01T00:15:25.932 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126322.log.gz 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568095.log.gz 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193302.log 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710729.log 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.193302.log: /var/log/ceph/ceph-client.admin.148100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193302.log.gz 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148100.log.gz 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715551.log 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582222.log 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710729.log.gz 2024-04-01T00:15:25.933 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333761.log 2024-04-01T00:15:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.715551.log: /var/log/ceph/ceph-client.admin.582222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582222.log.gz 2024-04-01T00:15:25.934 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715551.log.gz 2024-04-01T00:15:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151035.log 2024-04-01T00:15:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.333761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123005.log 2024-04-01T00:15:25.934 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333761.log.gz 2024-04-01T00:15:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290735.log 2024-04-01T00:15:25.934 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151035.log: /var/log/ceph/ceph-client.admin.123005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123005.log.gz 2024-04-01T00:15:25.934 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151035.log.gz 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539844.log 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.290735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112704.log 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290735.log.gz 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689393.log 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.539844.log: /var/log/ceph/ceph-client.admin.112704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539844.log.gz 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112704.log.gz 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232078.log 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.689393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257871.log 2024-04-01T00:15:25.935 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689393.log.gz 2024-04-01T00:15:25.936 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713329.log 2024-04-01T00:15:25.936 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.232078.log: /var/log/ceph/ceph-client.admin.257871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257871.log.gz 2024-04-01T00:15:25.936 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232078.log.gz 2024-04-01T00:15:25.936 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331453.log 2024-04-01T00:15:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393214.log 2024-04-01T00:15:25.964 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713329.log.gz 2024-04-01T00:15:25.964 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192397.log 2024-04-01T00:15:25.964 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331453.log: /var/log/ceph/ceph-client.admin.393214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393214.log.gz 2024-04-01T00:15:25.964 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331453.log.gz 2024-04-01T00:15:25.964 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847823.log 2024-04-01T00:15:25.964 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.192397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245158.log 2024-04-01T00:15:25.964 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192397.log.gz 2024-04-01T00:15:25.964 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557115.log 2024-04-01T00:15:25.965 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847823.log: /var/log/ceph/ceph-client.admin.245158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245158.log.gz 2024-04-01T00:15:25.965 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237958.log 2024-04-01T00:15:25.965 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.847823.log.gz 2024-04-01T00:15:25.965 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206764.log 2024-04-01T00:15:25.965 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.557115.log: /var/log/ceph/ceph-client.admin.237958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557115.log.gz 2024-04-01T00:15:25.965 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237958.log.gz 2024-04-01T00:15:25.965 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343837.log 2024-04-01T00:15:25.965 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275053.log 2024-04-01T00:15:25.966 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343837.log.gz 2024-04-01T00:15:25.966 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.206764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206764.log.gz 2024-04-01T00:15:25.966 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172999.log 2024-04-01T00:15:25.966 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710455.log 2024-04-01T00:15:25.966 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.275053.log: /var/log/ceph/ceph-client.admin.172999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172999.log.gz 2024-04-01T00:15:25.966 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275053.log.gz 2024-04-01T00:15:25.966 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147830.log 2024-04-01T00:15:25.966 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251624.log 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710455.log.gz 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258439.log 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147830.log: /var/log/ceph/ceph-client.admin.251624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251624.log.gz 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147830.log.gz 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409395.log 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.258439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258439.log.gz 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705710.log 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290174.log 2024-04-01T00:15:25.967 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409395.log.gz 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497994.log 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705710.log: /var/log/ceph/ceph-client.admin.290174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290174.log.gz 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705710.log.gz 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552251.log 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.497994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712632.log 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.497994.log.gz 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616304.log 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.552251.log: /var/log/ceph/ceph-client.admin.712632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712632.log.gz 2024-04-01T00:15:25.968 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552251.log.gz 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316603.log 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.616304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616304.log.gz 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609185.log 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451356.log 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.316603.log: /var/log/ceph/ceph-client.admin.609185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609185.log.gz 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316603.log.gz 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256605.log 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.451356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.451356.log.gz 2024-04-01T00:15:25.969 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126027.log 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.256605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383299.log 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256605.log.gz 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601433.log 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126027.log.gz 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.383299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383299.log.gz 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300155.log 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614767.log 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.601433.log: /var/log/ceph/ceph-client.admin.300155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300155.log.gz 2024-04-01T00:15:25.970 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601433.log.gz 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536201.log 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.614767.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.123074.log 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.536201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.536201.log.gz 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614767.log.gz 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543498.log 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591375.log 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.123074.log: /var/log/ceph/ceph-client.admin.543498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.543498.log.gz 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123074.log.gz 2024-04-01T00:15:25.971 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46080.log 2024-04-01T00:15:25.972 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.591375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382872.log 2024-04-01T00:15:25.972 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591375.log.gz 2024-04-01T00:15:25.972 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717468.log 2024-04-01T00:15:25.972 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.46080.log: /var/log/ceph/ceph-client.admin.382872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382872.log.gz 2024-04-01T00:15:25.972 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46080.log.gz 2024-04-01T00:15:25.972 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717481.log 2024-04-01T00:15:25.972 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252585.log 2024-04-01T00:15:25.972 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.717468.log: /var/log/ceph/ceph-client.admin.717481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717481.log.gz 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717468.log.gz 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143520.log 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566331.log 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.252585.log: /var/log/ceph/ceph-client.admin.143520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143520.log.gz 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252585.log.gz 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274856.log 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.566331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566331.log.gz 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252135.log 2024-04-01T00:15:25.973 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358650.log 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274856.log.gz 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259810.log 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.358650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358650.log.gz 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.252135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252135.log.gz 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848478.log 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343850.log 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.259810.log: /var/log/ceph/ceph-client.admin.848478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259810.log.gz 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.848478.log.gz 2024-04-01T00:15:25.974 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233483.log 2024-04-01T00:15:25.975 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714069.log 2024-04-01T00:15:25.975 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343850.log.gz 2024-04-01T00:15:25.975 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329760.log 2024-04-01T00:15:25.975 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.233483.log: /var/log/ceph/ceph-client.admin.714069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714069.log.gz 2024-04-01T00:15:25.975 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233483.log.gz 2024-04-01T00:15:25.975 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603302.log 2024-04-01T00:15:25.975 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329760.log.gz 2024-04-01T00:15:25.975 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.840262.log 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.603302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603302.log.gz 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709497.log 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.840262.log: /var/log/ceph/ceph-client.admin.43751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.840262.log.gz 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349405.log 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294164.log 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709497.log: /var/log/ceph/ceph-client.admin.349405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349405.log.gz 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709497.log.gz 2024-04-01T00:15:25.976 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619244.log 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.294164.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294164.log.gz 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567815.log 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848730.log 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.567815.log: /var/log/ceph/ceph-client.admin.619244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567815.log.gz 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619244.log.gz 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271223.log 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711605.log 2024-04-01T00:15:25.977 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.271223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271223.log.gz 2024-04-01T00:15:25.978 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173895.log 2024-04-01T00:15:25.978 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340701.log 2024-04-01T00:15:25.978 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.848730.log.gz 2024-04-01T00:15:25.978 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711605.log: /var/log/ceph/ceph-client.admin.173895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173895.log.gz 2024-04-01T00:15:25.978 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711605.log.gz 2024-04-01T00:15:25.978 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353750.log 2024-04-01T00:15:25.978 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583387.log 2024-04-01T00:15:25.978 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.353750.log: /var/log/ceph/ceph-client.admin.340701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353750.log.gz 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340701.log.gz 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218470.log 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248605.log 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.218470.log: /var/log/ceph/ceph-client.admin.583387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218470.log.gz 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583387.log.gz 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125568.log 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198812.log 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.248605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248605.log.gz 2024-04-01T00:15:25.979 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592712.log 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.125568.log: /var/log/ceph/ceph-client.admin.198812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198812.log.gz 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125568.log.gz 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229560.log 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.592712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608163.log 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592712.log.gz 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.229560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301132.log 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229560.log.gz 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354601.log 2024-04-01T00:15:25.980 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.301132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301132.log.gz 2024-04-01T00:15:25.981 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.608163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608163.log.gz 2024-04-01T00:15:25.981 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543429.log 2024-04-01T00:15:25.981 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.354601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354601.log.gz 2024-04-01T00:15:25.981 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273888.log 2024-04-01T00:15:25.981 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358568.log 2024-04-01T00:15:25.981 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.273888.log: /var/log/ceph/ceph-client.admin.543429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273888.log.gz 2024-04-01T00:15:25.981 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.543429.log.gz 2024-04-01T00:15:25.981 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172411.log 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142605.log 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.172411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172411.log.gz 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.358568.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.841201.log 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.358568.log.gz 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712166.log 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.142605.log: /var/log/ceph/ceph-client.admin.841201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841201.log.gz 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142605.log.gz 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844855.log 2024-04-01T00:15:25.982 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.712166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122157.log 2024-04-01T00:15:25.983 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712166.log.gz 2024-04-01T00:15:25.983 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344731.log 2024-04-01T00:15:25.983 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.844855.log: /var/log/ceph/ceph-client.admin.122157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122157.log.gz 2024-04-01T00:15:25.983 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844855.log.gz 2024-04-01T00:15:26.012 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618966.log 2024-04-01T00:15:26.013 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323819.log 2024-04-01T00:15:26.013 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.618966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618966.log.gz 2024-04-01T00:15:26.013 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.344731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344731.log.gz 2024-04-01T00:15:26.013 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269232.log 2024-04-01T00:15:26.013 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115626.log 2024-04-01T00:15:26.013 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.323819.log: /var/log/ceph/ceph-client.admin.269232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323819.log.gz 2024-04-01T00:15:26.013 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269232.log.gz 2024-04-01T00:15:26.013 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727880.log 2024-04-01T00:15:26.014 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193800.log 2024-04-01T00:15:26.014 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.115626.log: /var/log/ceph/ceph-client.admin.727880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727880.log.gz 2024-04-01T00:15:26.014 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115626.log.gz 2024-04-01T00:15:26.014 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709018.log 2024-04-01T00:15:26.014 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224225.log 2024-04-01T00:15:26.014 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.193800.log: /var/log/ceph/ceph-client.admin.709018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709018.log.gz 2024-04-01T00:15:26.014 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193800.log.gz 2024-04-01T00:15:26.014 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204428.log 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.224225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244177.log 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224225.log.gz 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843762.log 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.204428.log: /var/log/ceph/ceph-client.admin.244177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204428.log.gz 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244177.log.gz 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230232.log 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261270.log 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843762.log.gz 2024-04-01T00:15:26.015 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308369.log 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.230232.log: /var/log/ceph/ceph-client.admin.261270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261270.log.gz 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230232.log.gz 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382790.log 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.308369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308172.log 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308369.log.gz 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129003.log 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.382790.log: /var/log/ceph/ceph-client.admin.308172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308172.log.gz 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382790.log.gz 2024-04-01T00:15:26.016 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574893.log 2024-04-01T00:15:26.017 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537600.log 2024-04-01T00:15:26.017 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.574893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574893.log.gz 2024-04-01T00:15:26.017 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.129003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129003.log.gz 2024-04-01T00:15:26.017 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618604.log 2024-04-01T00:15:26.017 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259351.log 2024-04-01T00:15:26.017 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.618604.log: /var/log/ceph/ceph-client.admin.537600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618604.log.gz 2024-04-01T00:15:26.017 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546430.log 2024-04-01T00:15:26.017 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537600.log.gz 2024-04-01T00:15:26.018 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.259351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259351.log.gz 2024-04-01T00:15:26.018 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201247.log 2024-04-01T00:15:26.018 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.546430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50060.log 2024-04-01T00:15:26.018 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.546430.log.gz 2024-04-01T00:15:26.018 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322845.log 2024-04-01T00:15:26.018 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.201247.log: /var/log/ceph/ceph-client.admin.50060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201247.log.gz 2024-04-01T00:15:26.018 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149690.log 2024-04-01T00:15:26.018 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.322845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322845.log.gz 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50060.log.gz 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222588.log 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689677.log 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149690.log.gz 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219853.log 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222588.log: /var/log/ceph/ceph-client.admin.689677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689677.log.gz 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222588.log.gz 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156835.log 2024-04-01T00:15:26.019 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.219853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256101.log 2024-04-01T00:15:26.020 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219853.log.gz 2024-04-01T00:15:26.020 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688743.log 2024-04-01T00:15:26.020 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.156835.log: /var/log/ceph/ceph-client.admin.256101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256101.log.gz 2024-04-01T00:15:26.020 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156835.log.gz 2024-04-01T00:15:26.020 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690637.log 2024-04-01T00:15:26.020 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571111.log 2024-04-01T00:15:26.020 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688743.log: /var/log/ceph/ceph-client.admin.690637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690637.log.gz 2024-04-01T00:15:26.020 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688743.log.gz 2024-04-01T00:15:26.021 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318950.log 2024-04-01T00:15:26.021 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.571111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249837.log 2024-04-01T00:15:26.021 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571111.log.gz 2024-04-01T00:15:26.021 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44764.log 2024-04-01T00:15:26.021 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.318950.log: /var/log/ceph/ceph-client.admin.249837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249837.log.gz 2024-04-01T00:15:26.021 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318950.log.gz 2024-04-01T00:15:26.021 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287847.log 2024-04-01T00:15:26.021 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272907.log 2024-04-01T00:15:26.022 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302070.log 2024-04-01T00:15:26.022 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.287847.log: /var/log/ceph/ceph-client.admin.272907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272907.log.gz 2024-04-01T00:15:26.022 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287847.log.gz 2024-04-01T00:15:26.022 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687211.log 2024-04-01T00:15:26.022 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44764.log.gz 2024-04-01T00:15:26.022 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302070.log.gz 2024-04-01T00:15:26.022 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345192.log 2024-04-01T00:15:26.022 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393283.log 2024-04-01T00:15:26.023 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.687211.log: /var/log/ceph/ceph-client.admin.345192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345192.log.gz 2024-04-01T00:15:26.023 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687211.log.gz 2024-04-01T00:15:26.023 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292863.log 2024-04-01T00:15:26.023 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.393283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407544.log 2024-04-01T00:15:26.023 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393283.log.gz 2024-04-01T00:15:26.023 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113143.log 2024-04-01T00:15:26.023 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.292863.log: /var/log/ceph/ceph-client.admin.407544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249550.log 2024-04-01T00:15:26.023 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292863.log.gz 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.113143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407544.log.gz 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113143.log.gz 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359939.log 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172048.log 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249550.log: /var/log/ceph/ceph-client.admin.359939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359939.log.gz 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249550.log.gz 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612648.log 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675111.log 2024-04-01T00:15:26.024 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.612648.log: /var/log/ceph/ceph-client.admin.172048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612648.log.gz 2024-04-01T00:15:26.025 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172048.log.gz 2024-04-01T00:15:26.025 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-04-01T00:15:26.025 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847468.log 2024-04-01T00:15:26.025 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675111.log.gz 2024-04-01T00:15:26.025 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573185.log 2024-04-01T00:15:26.025 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847468.log: /var/log/ceph/ceph-client.admin.49500.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.847468.log.gz 2024-04-01T00:15:26.025 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222301.log 2024-04-01T00:15:26.025 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.838000.log 2024-04-01T00:15:26.026 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149407.log 2024-04-01T00:15:26.026 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.573185.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-04-01T00:15:26.026 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.838000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573185.log.gz 2024-04-01T00:15:26.026 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.838000.log.gz 2024-04-01T00:15:26.026 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848436.log 2024-04-01T00:15:26.026 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222301.log.gz 2024-04-01T00:15:26.026 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316159.log 2024-04-01T00:15:26.026 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848436.log: /var/log/ceph/ceph-client.admin.149407.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.848436.log.gz 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260983.log 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149407.log.gz 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117260.log 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.260983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260983.log.gz 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.316159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262614.log 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316159.log.gz 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.117260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117260.log.gz 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409792.log 2024-04-01T00:15:26.027 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240828.log 2024-04-01T00:15:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.262614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343567.log 2024-04-01T00:15:26.028 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262614.log.gz 2024-04-01T00:15:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.240828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240828.log.gz 2024-04-01T00:15:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593589.log 2024-04-01T00:15:26.028 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409792.log.gz 2024-04-01T00:15:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675315.log 2024-04-01T00:15:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.593589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593589.log.gz 2024-04-01T00:15:26.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343567.log.gz 2024-04-01T00:15:26.029 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618124.log 2024-04-01T00:15:26.029 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408361.log 2024-04-01T00:15:26.029 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315889.log 2024-04-01T00:15:26.029 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.618124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675315.log.gz 2024-04-01T00:15:26.029 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618124.log.gz 2024-04-01T00:15:26.029 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720484.log 2024-04-01T00:15:26.029 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315889.log.gz 2024-04-01T00:15:26.029 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.408361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288888.log 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408361.log.gz 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695132.log 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288888.log.gz/var/log/ceph/ceph-client.admin.720484.log: 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720484.log.gz 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250738.log 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273386.log 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.250738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250738.log.gz 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.695132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574008.log 2024-04-01T00:15:26.030 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695132.log.gz 2024-04-01T00:15:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671240.log 2024-04-01T00:15:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.574008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574008.log.gz 2024-04-01T00:15:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.273386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228119.log 2024-04-01T00:15:26.031 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273386.log.gz 2024-04-01T00:15:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671240.log.gz 2024-04-01T00:15:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45515.log 2024-04-01T00:15:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250259.log 2024-04-01T00:15:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.228119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219771.log 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228119.log.gz 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.250259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250259.log.gz 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668689.log 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585085.log 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.668689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668689.log.gz 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.219771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219771.log.gz 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118584.log 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232543.log 2024-04-01T00:15:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.118584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118584.log.gz 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.585085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332809.log 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585085.log.gz 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343292.log 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.332809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332809.log.gz 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.232543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568730.log 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232543.log.gz 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343292.log.gz 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148330.log 2024-04-01T00:15:26.033 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335072.log 2024-04-01T00:15:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226402.log 2024-04-01T00:15:26.034 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568730.log.gz 2024-04-01T00:15:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.335072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335072.log.gz 2024-04-01T00:15:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600477.log 2024-04-01T00:15:26.034 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148330.log.gz 2024-04-01T00:15:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192776.log 2024-04-01T00:15:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.600477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600477.log.gz 2024-04-01T00:15:26.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226402.log.gz 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848394.log 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286182.log 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848394.log: /var/log/ceph/ceph-client.admin.192776.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.848394.log.gz 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172035.log 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192776.log.gz 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671433.log 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.172035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172035.log.gz 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.286182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286182.log.gz 2024-04-01T00:15:26.035 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174632.log 2024-04-01T00:15:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408430.log 2024-04-01T00:15:26.072 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45515.log.gz 2024-04-01T00:15:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266876.log 2024-04-01T00:15:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671433.log: /var/log/ceph/ceph-client.admin.408430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408430.log.gz 2024-04-01T00:15:26.072 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671433.log.gz 2024-04-01T00:15:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.174632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194701.log 2024-04-01T00:15:26.072 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174632.log.gz 2024-04-01T00:15:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568707.log 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.194701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194701.log.gz 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.266876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553273.log 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266876.log.gz 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568707.log.gz 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551381.log 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202177.log 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.553273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216613.log 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553273.log.gz 2024-04-01T00:15:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.202177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202177.log.gz 2024-04-01T00:15:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.551381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551381.log.gz 2024-04-01T00:15:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299208.log 2024-04-01T00:15:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573555.log 2024-04-01T00:15:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717842.log 2024-04-01T00:15:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.216613.log: /var/log/ceph/ceph-client.admin.573555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573555.log.gz 2024-04-01T00:15:26.074 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216613.log.gz 2024-04-01T00:15:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.299208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299208.log.gz 2024-04-01T00:15:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584127.log 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262155.log 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584127.log.gz 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.717842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715482.log 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717842.log.gz 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694008.log 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.715482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715482.log.gz 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.262155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845958.log 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262155.log.gz 2024-04-01T00:15:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694008.log.gz 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556939.log 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606347.log 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.845958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341053.log 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845958.log.gz 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.606347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606347.log.gz 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.556939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350375.log 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556939.log.gz 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584811.log 2024-04-01T00:15:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350375.log.gz 2024-04-01T00:15:26.077 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276887.log 2024-04-01T00:15:26.077 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0%/var/log/ceph/ceph-client.admin.584811.log: -- replaced with /var/log/ceph/ceph-client.admin.341053.log.gz 2024-04-01T00:15:26.077 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584811.log.gz 2024-04-01T00:15:26.077 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162226.log 2024-04-01T00:15:26.077 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344032.log 2024-04-01T00:15:26.077 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300544.log 2024-04-01T00:15:26.077 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276887.log: /var/log/ceph/ceph-client.admin.344032.log: /var/log/ceph/ceph-client.admin.162226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344032.log.gz 2024-04-01T00:15:26.077 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276887.log.gz 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249345.log 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162226.log.gz 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47536.log 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249345.log.gz 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.300544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210611.log 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300544.log.gz 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248879.log 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210611.log.gz 2024-04-01T00:15:26.078 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560958.log 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713795.log 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.560958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560958.log.gz 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.248879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616951.log 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248879.log.gz 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713795.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47536.log.gz 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713795.log.gz 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552512.log 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279678.log 2024-04-01T00:15:26.079 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.616951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307680.log 2024-04-01T00:15:26.080 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.552512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616951.log.gz 2024-04-01T00:15:26.080 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320116.log 2024-04-01T00:15:26.080 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552512.log.gz 2024-04-01T00:15:26.080 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.307680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307680.log.gz 2024-04-01T00:15:26.080 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.279678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607790.log 2024-04-01T00:15:26.080 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279678.log.gz 2024-04-01T00:15:26.080 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358126.log 2024-04-01T00:15:26.080 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.607790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607790.log.gz 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128108.log 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320116.log.gz 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226881.log 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.128108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128108.log.gz 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.358126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348444.log 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358126.log.gz 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48751.log 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.348444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348444.log.gz 2024-04-01T00:15:26.081 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112207.log 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226881.log.gz 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246106.log 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48751.log.gz 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410492.log 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.112207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.837096.log 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112207.log.gz 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.410492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410492.log.gz 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.246106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143979.log 2024-04-01T00:15:26.082 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246106.log.gz 2024-04-01T00:15:26.083 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147109.log 2024-04-01T00:15:26.083 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143979.log.gz 2024-04-01T00:15:26.083 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.837096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.837096.log.gz 2024-04-01T00:15:26.083 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285224.log 2024-04-01T00:15:26.083 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267303.log 2024-04-01T00:15:26.083 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239600.log 2024-04-01T00:15:26.085 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147109.log.gz 2024-04-01T00:15:26.085 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285224.log.gz 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272689.log 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.267303.log: /var/log/ceph/ceph-client.admin.239600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239600.log.gz 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718861.log 0.0% 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.267303.log.gz 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707855.log 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.718861.log: 0.0%/var/log/ceph/ceph-client.admin.272689.log: -- replaced with /var/log/ceph/ceph-client.admin.718861.log.gz 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293690.log 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272689.log.gz 2024-04-01T00:15:26.086 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214769.log 2024-04-01T00:15:26.087 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293690.log.gz 2024-04-01T00:15:26.087 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607803.log 2024-04-01T00:15:26.087 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707855.log.gzgzip 2024-04-01T00:15:26.087 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45599.log 2024-04-01T00:15:26.087 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.607803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607803.log.gz 2024-04-01T00:15:26.087 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.214769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586714.log 2024-04-01T00:15:26.087 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214769.log.gz 2024-04-01T00:15:26.087 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236150.log 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312216.log 91.0% 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45599.log.gz 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.586714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586714.log.gz 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357598.log 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.236150.log: /var/log/ceph/ceph-client.admin.312216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312216.log.gz 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236150.log.gz 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147651.log 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312229.log 2024-04-01T00:15:26.088 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147651.log.gz 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.357598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357598.log.gz 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556857.log 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222314.log 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.556857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556857.log.gz 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.312229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148685.log 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312229.log.gz 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245629.log 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148685.log.gz 2024-04-01T00:15:26.089 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222314.log.gz 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536635.log 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589870.log 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.245629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354151.log 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245629.log.gz 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.536635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381693.log 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.536635.log.gz 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.354151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354151.log.gz 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.589870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240815.log 2024-04-01T00:15:26.090 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589870.log.gz 2024-04-01T00:15:26.091 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324216.log 2024-04-01T00:15:26.091 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.240815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240815.log.gz 2024-04-01T00:15:26.091 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.381693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287155.log 2024-04-01T00:15:26.091 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381693.log.gz 2024-04-01T00:15:26.091 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563343.log 2024-04-01T00:15:26.091 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.287155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287155.log.gz 2024-04-01T00:15:26.091 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.324216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214239.log 2024-04-01T00:15:26.091 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324216.log.gz 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846912.log 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.214239.log: /var/log/ceph/ceph-client.admin.563343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214239.log.gz 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563343.log.gz 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329747.log 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567898.log 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217087.log 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.846912.log: /var/log/ceph/ceph-client.admin.567898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567898.log.gz 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329747.log.gz 2024-04-01T00:15:26.092 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410234.log 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281098.log 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.846912.log.gz 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.410234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410234.log.gz 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.217087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310851.log 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217087.log.gz 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109705.log 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.310851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310851.log.gz 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.281098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281098.log.gz 2024-04-01T00:15:26.093 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674390.log 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213096.log 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.109705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706814.log 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109705.log.gz 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.674390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268726.log 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674390.log.gz 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.706814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706814.log.gz 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.213096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669572.log 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213096.log.gz 2024-04-01T00:15:26.094 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.268726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268726.log.gz 2024-04-01T00:15:26.095 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141719.log 2024-04-01T00:15:26.095 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261257.log 2024-04-01T00:15:26.095 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.669572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191893.log 2024-04-01T00:15:26.095 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669572.log.gz 2024-04-01T00:15:26.095 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.261257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261257.log.gz 2024-04-01T00:15:26.095 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.141719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155755.log 2024-04-01T00:15:26.095 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141719.log.gz 2024-04-01T00:15:26.095 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605540.log 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155755.log.gz 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.191893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317294.log 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191893.log.gz 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.605540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605540.log.gz 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612918.log 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125650.log 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.317294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204949.log 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317294.log.gz 2024-04-01T00:15:26.096 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.125650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125650.log.gz 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.612918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612918.log.gz 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551573.log 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334618.log 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.204949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353216.log 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.551573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204949.log.gz 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323268.log 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551573.log.gz 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.353216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353216.log.gz 2024-04-01T00:15:26.097 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.334618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161773.log 2024-04-01T00:15:26.098 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334618.log.gz 2024-04-01T00:15:26.098 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346125.log 2024-04-01T00:15:26.098 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.161773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161773.log.gz 2024-04-01T00:15:26.098 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.323268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249071.log 2024-04-01T00:15:26.098 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323268.log.gz 2024-04-01T00:15:26.098 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152576.log 2024-04-01T00:15:26.098 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249071.log.gz 2024-04-01T00:15:26.098 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.346125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350101.log 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346125.log.gz 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50316.log 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350101.log.gz 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.152576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707773.log 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152576.log.gz 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546815.log 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143237.log 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227170.log 2024-04-01T00:15:26.099 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707773.log.gz 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143237.log.gz 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.546815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.546815.log.gz 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672859.log 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128551.log 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570609.log 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.227170.log: /var/log/ceph/ceph-client.admin.128551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128551.log.gz 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227170.log.gz 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.672859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537072.log 2024-04-01T00:15:26.100 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672859.log.gz 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126948.log 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.537072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537072.log.gz 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.570609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250477.log 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570609.log.gz 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545559.log 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.250477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250477.log.gz 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720932.log 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126948.log.gz 2024-04-01T00:15:26.101 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280175.log 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.720932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720932.log.gz 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.545559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.545559.log.gz 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273181.log 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306720.log 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.280175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707842.log 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280175.log.gz 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.306720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306720.log.gz 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.273181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273181.log.gz 2024-04-01T00:15:26.102 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614341.log 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570165.log 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228132.log 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707842.log.gz 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.614341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726470.log 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614341.log.gz 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.228132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228132.log.gz 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.570165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334990.log 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570165.log.gz 2024-04-01T00:15:26.103 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406611.log 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.726470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231697.log 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726470.log.gz 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.406611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406611.log.gz 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.334990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230693.log 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334990.log.gz 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50316.log.gz 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253458.log 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.230693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230693.log.gz 2024-04-01T00:15:26.104 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.231697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602738.log 2024-04-01T00:15:26.105 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231697.log.gz 2024-04-01T00:15:26.105 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245145.log 2024-04-01T00:15:26.105 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253458.log: /var/log/ceph/ceph-client.admin.602738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602738.log.gz 2024-04-01T00:15:26.105 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253458.log.gz 2024-04-01T00:15:26.158 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568376.log 2024-04-01T00:15:26.158 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.245145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245145.log.gz 2024-04-01T00:15:26.158 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197412.log 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599590.log 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568376.log: /var/log/ceph/ceph-client.admin.197412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278477.log 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568376.log.gz 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.599590.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599590.log.gz 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.197412.log.gz 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294617.log 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717036.log 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.278477.log: /var/log/ceph/ceph-client.admin.294617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294617.log.gz 2024-04-01T00:15:26.159 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278477.log.gz 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176473.log 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214321.log 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.176473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176473.log.gz 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.717036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717036.log.gz 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246093.log 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335856.log 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.214321.log: /var/log/ceph/ceph-client.admin.246093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246093.log.gz 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214321.log.gz 2024-04-01T00:15:26.160 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237971.log 2024-04-01T00:15:26.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.335856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832097.log 2024-04-01T00:15:26.161 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335856.log.gz 2024-04-01T00:15:26.161 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294151.log 2024-04-01T00:15:26.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.237971.log: /var/log/ceph/ceph-client.admin.832097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832097.log.gz 2024-04-01T00:15:26.161 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237971.log.gz 2024-04-01T00:15:26.161 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146192.log 2024-04-01T00:15:26.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.294151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560031.log 2024-04-01T00:15:26.161 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294151.log.gz 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331371.log 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146192.log: /var/log/ceph/ceph-client.admin.560031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560031.log.gz 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146192.log.gz 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320582.log 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158067.log 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331371.log.gz 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225967.log 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320582.log: /var/log/ceph/ceph-client.admin.158067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158067.log.gz 2024-04-01T00:15:26.162 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320582.log.gz 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407462.log 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.225967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337746.log 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225967.log.gz 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619258.log 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.407462.log: /var/log/ceph/ceph-client.admin.337746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337746.log.gz 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407462.log.gz 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613340.log 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694196.log 2024-04-01T00:15:26.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.619258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354683.log 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619258.log.gz 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694196.log.gz 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.613340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303557.log 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613340.log.gz 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554125.log 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.303557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303557.log.gz 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.354683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844484.log 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354683.log.gz 2024-04-01T00:15:26.164 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278490.log 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.844484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844484.log.gz 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.554125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224020.log 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554125.log.gz 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708321.log 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.224020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224020.log.gz 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.278490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271920.log 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278490.log.gz 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487696.log 2024-04-01T00:15:26.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.271920.log: /var/log/ceph/ceph-client.admin.708321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271920.log.gz 2024-04-01T00:15:26.166 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575353.log 2024-04-01T00:15:26.166 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708321.log.gz 2024-04-01T00:15:26.166 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289081.log 2024-04-01T00:15:26.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.575353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575353.log.gz 2024-04-01T00:15:26.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.487696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341891.log 2024-04-01T00:15:26.166 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.487696.log.gz 2024-04-01T00:15:26.166 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257488.log 2024-04-01T00:15:26.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341891.log: 0.0%/var/log/ceph/ceph-client.admin.289081.log: -- replaced with /var/log/ceph/ceph-client.admin.341891.log.gz 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612836.log 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289081.log.gz 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719291.log 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.612836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612836.log.gz 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.257488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202164.log 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257488.log.gz 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306006.log 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.202164.log: /var/log/ceph/ceph-client.admin.719291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202164.log.gz 2024-04-01T00:15:26.167 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848352.log 2024-04-01T00:15:26.168 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719291.log.gz 2024-04-01T00:15:26.168 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44771.log 2024-04-01T00:15:26.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848352.log: /var/log/ceph/ceph-client.admin.306006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.831982.log 2024-04-01T00:15:26.168 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.848352.log.gz 2024-04-01T00:15:26.168 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306006.log.gz 2024-04-01T00:15:26.168 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200344.log 2024-04-01T00:15:26.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255231.log 2024-04-01T00:15:26.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.200344.log: 0.0%/var/log/ceph/ceph-client.admin.831982.log: -- replaced with /var/log/ceph/ceph-client.admin.200344.log.gz 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.831982.log.gz 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274638.log 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44771.log.gz 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238916.log 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.255231.log: /var/log/ceph/ceph-client.admin.274638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255231.log.gz 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274638.log.gz 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608993.log 2024-04-01T00:15:26.169 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407111.log 2024-04-01T00:15:26.170 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.238916.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.562381.log 2024-04-01T00:15:26.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.407111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238916.log.gz 2024-04-01T00:15:26.170 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2024-04-01T00:15:26.170 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407111.log.gz 2024-04-01T00:15:26.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.608993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244095.log 2024-04-01T00:15:26.170 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608993.log.gz 2024-04-01T00:15:26.170 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168647.log 2024-04-01T00:15:26.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.562381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692111.log 2024-04-01T00:15:26.171 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562381.log.gz 2024-04-01T00:15:26.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.168647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168647.log.gz 2024-04-01T00:15:26.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.244095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244095.log.gz 2024-04-01T00:15:26.171 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251419.log 2024-04-01T00:15:26.171 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240554.log 2024-04-01T00:15:26.171 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670950.log 2024-04-01T00:15:26.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692111.log: /var/log/ceph/ceph-client.admin.240554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692111.log.gz 2024-04-01T00:15:26.171 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240554.log.gz 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.251419.log: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.251419.log.gz /var/log/ceph/ceph-client.admin.228874.log 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233770.log 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.228874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228874.log.gz 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.670950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194619.log 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670950.log.gz 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172986.log 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.194619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194619.log.gz 2024-04-01T00:15:26.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.233770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723208.log 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233770.log.gz 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.172986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172986.log.gz 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844924.log 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.723208.log: /var/log/ceph/ceph-client.admin.688931.log 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723208.log.gz 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833036.log 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688931.log.gz 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.844924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844924.log.gz 2024-04-01T00:15:26.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198881.log 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610262.log 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.833036.log: /var/log/ceph/ceph-client.admin.198881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198881.log.gz 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833036.log.gz 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311291.log 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.610262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394708.log 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610262.log.gz 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282258.log 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.311291.log: /var/log/ceph/ceph-client.admin.394708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394708.log.gz 2024-04-01T00:15:26.174 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311291.log.gz 2024-04-01T00:15:26.175 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271441.log 2024-04-01T00:15:26.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.282258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161340.log 2024-04-01T00:15:26.175 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282258.log.gz 2024-04-01T00:15:26.175 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150953.log 2024-04-01T00:15:26.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.271441.log: /var/log/ceph/ceph-client.admin.161340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161340.log.gz 2024-04-01T00:15:26.175 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271441.log.gz 2024-04-01T00:15:26.175 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670881.log 2024-04-01T00:15:26.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.150953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146908.log 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150953.log.gz 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.670881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286648.log 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670881.log.gz 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146908.log.gz 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547777.log 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.286648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538965.log 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286648.log.gz 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.547777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315958.log 2024-04-01T00:15:26.176 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.547777.log.gz 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318506.log 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315958.log: /var/log/ceph/ceph-client.admin.538965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315958.log.gz 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538965.log.gz 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704531.log 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.318506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847510.log 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318506.log.gz 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847510.log: /var/log/ceph/ceph-client.admin.704531.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.847510.log.gz 2024-04-01T00:15:26.177 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704531.log.gz 2024-04-01T00:15:26.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556462.log 2024-04-01T00:15:26.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842522.log 2024-04-01T00:15:26.178 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49045.log: /var/log/ceph/ceph-client.admin.556462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556462.log.gz 2024-04-01T00:15:26.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729939.log 2024-04-01T00:15:26.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50466.log 2024-04-01T00:15:26.178 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.729939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729939.log.gz 2024-04-01T00:15:26.178 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5%/var/log/ceph/ceph-client.admin.842522.log: -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2024-04-01T00:15:26.178 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842522.log.gz 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359580.log 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537978.log 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50466.log.gz 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.359580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252066.log 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359580.log.gz 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223554.log 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.252066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252066.log.gz 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.537978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537978.log.gz 2024-04-01T00:15:26.179 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129928.log 2024-04-01T00:15:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606858.log 2024-04-01T00:15:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223554.log: /var/log/ceph/ceph-client.admin.129928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129928.log.gz 2024-04-01T00:15:26.180 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223554.log.gz 2024-04-01T00:15:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.837109.log 2024-04-01T00:15:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176217.log 2024-04-01T00:15:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.837109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.837109.log.gz 2024-04-01T00:15:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.606858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606858.log.gz 2024-04-01T00:15:26.180 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236834.log 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275122.log 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.176217.log: /var/log/ceph/ceph-client.admin.236834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236834.log.gz 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176217.log.gz 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550410.log 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48961.log 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.550410.log: 0.0%/var/log/ceph/ceph-client.admin.275122.log: -- replaced with /var/log/ceph/ceph-client.admin.550410.log.gz 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275122.log.gz 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329281.log 2024-04-01T00:15:26.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48961.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48961.log.gz 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.840743.log 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315971.log 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329281.log: /var/log/ceph/ceph-client.admin.840743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.840743.log.gz 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329281.log.gz 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307405.log 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158529.log 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.307405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307405.log.gz 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315971.log.gz 2024-04-01T00:15:26.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571042.log 2024-04-01T00:15:26.183 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236437.log 2024-04-01T00:15:26.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.571042.log: /var/log/ceph/ceph-client.admin.158529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571042.log.gz 2024-04-01T00:15:26.183 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158529.log.gz 2024-04-01T00:15:26.183 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253868.log 2024-04-01T00:15:26.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.236437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715273.log 2024-04-01T00:15:26.183 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236437.log.gz 2024-04-01T00:15:26.183 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542982.log 2024-04-01T00:15:26.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253868.log: /var/log/ceph/ceph-client.admin.715273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715273.log.gz 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253868.log.gz 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705422.log 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262168.log 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705422.log.gz 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.542982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.542982.log.gz 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213847.log 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568641.log 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.262168.log: /var/log/ceph/ceph-client.admin.213847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213847.log.gz 2024-04-01T00:15:26.184 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262168.log.gz 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675803.log 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409861.log 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675803.log.gz 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568641.log.gz 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323832.log 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587546.log 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409861.log: /var/log/ceph/ceph-client.admin.323832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323832.log.gz 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409861.log.gz 2024-04-01T00:15:26.185 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689406.log 2024-04-01T00:15:26.186 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278203.log 2024-04-01T00:15:26.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.689406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689406.log.gz 2024-04-01T00:15:26.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.587546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587546.log.gz 2024-04-01T00:15:26.186 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322071.log 2024-04-01T00:15:26.186 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220695.log 2024-04-01T00:15:26.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.278203.log: /var/log/ceph/ceph-client.admin.322071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322071.log.gz 2024-04-01T00:15:26.186 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278203.log.gz 2024-04-01T00:15:26.186 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250272.log 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709689.log 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.250272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250272.log.gz 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.220695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220695.log.gz 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620489.log 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352665.log 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709689.log: /var/log/ceph/ceph-client.admin.620489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620489.log.gz 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709689.log.gz 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207288.log 2024-04-01T00:15:26.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.admin.352665.log: --verbose -- /var/log/ceph/ceph-client.admin.306445.log 2024-04-01T00:15:26.188 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352665.log.gz 2024-04-01T00:15:26.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338640.log 2024-04-01T00:15:26.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.207288.log: /var/log/ceph/ceph-client.admin.306445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306445.log.gz 2024-04-01T00:15:26.188 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207288.log.gz 2024-04-01T00:15:26.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311209.log 2024-04-01T00:15:26.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289804.log 2024-04-01T00:15:26.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.311209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311209.log.gz 2024-04-01T00:15:26.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338640.log.gz 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336143.log 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253019.log 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.336143.log: /var/log/ceph/ceph-client.admin.289804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336143.log.gz 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289804.log.gz 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.838893.log 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725570.log 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.838893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.838893.log.gz 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253019.log.gz 2024-04-01T00:15:26.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689201.log 2024-04-01T00:15:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.725570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725570.log.gz 2024-04-01T00:15:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318048.log 2024-04-01T00:15:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173447.log 2024-04-01T00:15:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.318048.log: /var/log/ceph/ceph-client.admin.689201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318048.log.gz 2024-04-01T00:15:26.190 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689201.log.gz 2024-04-01T00:15:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48541.log 2024-04-01T00:15:26.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.173447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329555.log 2024-04-01T00:15:26.190 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173447.log.gz 2024-04-01T00:15:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351714.log 2024-04-01T00:15:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48541.log: /var/log/ceph/ceph-client.admin.329555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329555.log.gz 2024-04-01T00:15:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691814.log 2024-04-01T00:15:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582620.log 2024-04-01T00:15:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.691814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691814.log.gz 2024-04-01T00:15:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.351714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351714.log.gz 2024-04-01T00:15:26.191 INFO:teuthology.orchestra.run.smithi120.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48541.log.gz 2024-04-01T00:15:26.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596468.log 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.582620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582620.log.gz 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847342.log 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586993.log 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.596468.log: /var/log/ceph/ceph-client.admin.847342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596468.log.gz 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.847342.log.gz 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293399.log 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.586993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724023.log 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586993.log.gz 2024-04-01T00:15:26.192 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150567.log 2024-04-01T00:15:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293399.log: /var/log/ceph/ceph-client.admin.724023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724023.log.gz 2024-04-01T00:15:26.193 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293399.log.gz 2024-04-01T00:15:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713521.log 2024-04-01T00:15:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604974.log 2024-04-01T00:15:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713521.log.gz 2024-04-01T00:15:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.150567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150567.log.gz 2024-04-01T00:15:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313079.log 2024-04-01T00:15:26.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690177.log 2024-04-01T00:15:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604974.log: /var/log/ceph/ceph-client.admin.313079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313079.log.gz 2024-04-01T00:15:26.194 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604974.log.gz 2024-04-01T00:15:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688358.log 2024-04-01T00:15:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724645.log 2024-04-01T00:15:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688358.log.gz 2024-04-01T00:15:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.690177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690177.log.gz 2024-04-01T00:15:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230775.log 2024-04-01T00:15:26.194 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71916.log 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.724645.log: /var/log/ceph/ceph-client.admin.230775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230775.log.gz 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724645.log.gz 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209629.log 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308451.log 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.209629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209629.log.gz 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.71916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287450.log 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314647.log 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.308451.log: /var/log/ceph/ceph-client.admin.287450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287450.log.gz 2024-04-01T00:15:26.195 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308451.log.gz 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123854.log 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.314647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234918.log 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314647.log.gz 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612459.log 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.123854.log: /var/log/ceph/ceph-client.admin.234918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234918.log.gz 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123854.log.gz 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312857.log 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191535.log 2024-04-01T00:15:26.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.312857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312857.log.gz 2024-04-01T00:15:26.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.612459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612459.log.gz 2024-04-01T00:15:26.197 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605253.log 2024-04-01T00:15:26.197 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290653.log 2024-04-01T00:15:26.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.191535.log: /var/log/ceph/ceph-client.admin.605253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605253.log.gz 2024-04-01T00:15:26.197 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191535.log.gz 2024-04-01T00:15:26.197 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595932.log 2024-04-01T00:15:26.197 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351271.log 2024-04-01T00:15:26.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.595932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595932.log.gz 2024-04-01T00:15:26.198 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.290653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290653.log.gz 2024-04-01T00:15:26.198 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196826.log 2024-04-01T00:15:26.198 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321810.log 2024-04-01T00:15:26.198 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.351271.log: /var/log/ceph/ceph-client.admin.196826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196826.log.gz 2024-04-01T00:15:26.198 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351271.log.gz 2024-04-01T00:15:26.198 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244643.log 2024-04-01T00:15:26.278 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.321810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574623.log 2024-04-01T00:15:26.278 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321810.log.gz 2024-04-01T00:15:26.278 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383739.log 2024-04-01T00:15:26.278 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.244643.log: /var/log/ceph/ceph-client.admin.574623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574623.log.gz 2024-04-01T00:15:26.278 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244643.log.gz 2024-04-01T00:15:26.278 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.839345.log 2024-04-01T00:15:26.278 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669768.log 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.383739.log: /var/log/ceph/ceph-client.admin.839345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.839345.log.gz 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383739.log.gz 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730140.log 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.669768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143250.log 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669768.log.gz 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.730140.log: /var/log/ceph/ceph-client.admin.143250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143250.log.gz 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730140.log.gz 2024-04-01T00:15:26.279 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670520.log 2024-04-01T00:15:26.280 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282463.log 2024-04-01T00:15:26.280 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692651.log 2024-04-01T00:15:26.280 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.670520.log: /var/log/ceph/ceph-client.admin.282463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282463.log.gz 2024-04-01T00:15:26.280 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670520.log.gz 2024-04-01T00:15:26.280 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711126.log 2024-04-01T00:15:26.280 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692651.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2024-04-01T00:15:26.280 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692651.log.gz 2024-04-01T00:15:26.280 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71916.log.gz 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728874.log 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669490.log 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711126.log.gz 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294630.log 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.728874.log: /var/log/ceph/ceph-client.admin.669490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669490.log.gz 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728874.log.gz 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49003.log 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.294630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175030.log 2024-04-01T00:15:26.281 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294630.log.gz 2024-04-01T00:15:26.282 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278285.log 2024-04-01T00:15:26.282 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49003.log: /var/log/ceph/ceph-client.admin.175030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175030.log.gz 2024-04-01T00:15:26.282 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703693.log 2024-04-01T00:15:26.282 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843233.log 2024-04-01T00:15:26.282 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.703693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703693.log.gz 2024-04-01T00:15:26.282 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8%/var/log/ceph/ceph-client.admin.278285.log: -- replaced with /var/log/ceph/ceph-client.admin.49003.log.gz 2024-04-01T00:15:26.282 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278285.log.gz 2024-04-01T00:15:26.282 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272181.log 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238450.log 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.272181.log: /var/log/ceph/ceph-client.admin.843233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272181.log.gz 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843233.log.gz 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848057.log 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582907.log 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.238450.log: /var/log/ceph/ceph-client.admin.848057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238450.log.gz 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.848057.log.gz 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280819.log 2024-04-01T00:15:26.283 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.582907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217927.log 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582907.log.gz 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568862.log 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.280819.log: /var/log/ceph/ceph-client.admin.217927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217927.log.gz 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280819.log.gz 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329268.log 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847038.log 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568862.log.gz 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275557.log 2024-04-01T00:15:26.284 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329268.log: /var/log/ceph/ceph-client.admin.847038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329268.log.gz 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.847038.log.gz 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283071.log 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.275557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275557.log.gz 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412400.log 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283071.log.gz 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113974.log 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2024-04-01T00:15:26.285 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.412400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.836644.log 2024-04-01T00:15:26.286 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412400.log.gz 2024-04-01T00:15:26.286 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228406.log 2024-04-01T00:15:26.286 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.113974.log: /var/log/ceph/ceph-client.admin.836644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.836644.log.gz 2024-04-01T00:15:26.286 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113974.log.gz 2024-04-01T00:15:26.286 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315005.log 2024-04-01T00:15:26.286 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.228406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228406.log.gz 2024-04-01T00:15:26.286 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175946.log 2024-04-01T00:15:26.286 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586701.log 2024-04-01T00:15:26.287 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315005.log.gz 2024-04-01T00:15:26.287 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341066.log 2024-04-01T00:15:26.287 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.586701.log: 0.0%/var/log/ceph/ceph-client.admin.175946.log: -- replaced with /var/log/ceph/ceph-client.admin.586701.log.gz 2024-04-01T00:15:26.287 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175946.log.gz 2024-04-01T00:15:26.287 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309811.log 2024-04-01T00:15:26.289 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584345.log 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341066.log: /var/log/ceph/ceph-client.admin.309811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309811.log.gz 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341066.log.gz 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552525.log 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714287.log 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584345.log.gz 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154857.log 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.552525.log: /var/log/ceph/ceph-client.admin.714287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714287.log.gz 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552525.log.gz 2024-04-01T00:15:26.290 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670963.log 2024-04-01T00:15:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.154857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154857.log.gz 2024-04-01T00:15:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352747.log 2024-04-01T00:15:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610539.log 2024-04-01T00:15:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.670963.log: /var/log/ceph/ceph-client.admin.352747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352747.log.gz 2024-04-01T00:15:26.291 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670963.log.gz 2024-04-01T00:15:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229573.log 2024-04-01T00:15:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.610539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610539.log.gz 2024-04-01T00:15:26.291 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320308.log 2024-04-01T00:15:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.229573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106910.log 2024-04-01T00:15:26.292 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229573.log.gz 2024-04-01T00:15:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47074.log 2024-04-01T00:15:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.106910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106910.log.gz 2024-04-01T00:15:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320308.log.gz 2024-04-01T00:15:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238437.log 2024-04-01T00:15:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670507.log 2024-04-01T00:15:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47074.log: /var/log/ceph/ceph-client.admin.238437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238437.log.gz 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559150.log 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619035.log 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47074.log.gz 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.559150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559150.log.gz 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.670507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670507.log.gz 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303343.log 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552988.log 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.619035.log: /var/log/ceph/ceph-client.admin.303343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303343.log.gz 2024-04-01T00:15:26.293 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619035.log.gz 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694183.log 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.552988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552988.log.gz 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536622.log 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319898.log 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694183.log.gz 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608245.log 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.536622.log: /var/log/ceph/ceph-client.admin.319898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319898.log.gz 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.536622.log.gz 2024-04-01T00:15:26.294 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279125.log 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331950.log 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.608245.log: /var/log/ceph/ceph-client.admin.279125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279125.log.gz 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608245.log.gz 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326387.log 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331950.log.gz 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551560.log 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709005.log 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.326387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326387.log.gz 2024-04-01T00:15:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.551560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551560.log.gz 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144815.log 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845415.log 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709005.log.gz 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306994.log 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144815.log: /var/log/ceph/ceph-client.admin.845415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845415.log.gz 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144815.log.gz 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45389.log 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.306994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291214.log 2024-04-01T00:15:26.296 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306994.log.gz 2024-04-01T00:15:26.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336854.log 2024-04-01T00:15:26.297 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45389.log: /var/log/ceph/ceph-client.admin.291214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291214.log.gz 2024-04-01T00:15:26.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50018.log 2024-04-01T00:15:26.297 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.336854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276403.log 2024-04-01T00:15:26.297 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336854.log.gz 2024-04-01T00:15:26.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338383.log 2024-04-01T00:15:26.297 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50018.log: /var/log/ceph/ceph-client.admin.276403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276403.log.gz 2024-04-01T00:15:26.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355134.log 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225954.log 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338383.log.gz 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222096.log 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.355134.log: /var/log/ceph/ceph-client.admin.225954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225954.log.gz 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355134.log.gz 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253937.log 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50018.log.gz 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273373.log 2024-04-01T00:15:26.298 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222096.log.gz 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301511.log 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253937.log: /var/log/ceph/ceph-client.admin.273373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273373.log.gz 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253937.log.gz 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168169.log 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45389.log.gz 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.301511.log: /var/log/ceph/ceph-client.admin.211524.log 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301511.log.gz 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278756.log 2024-04-01T00:15:26.299 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.168169.log: /var/log/ceph/ceph-client.admin.211524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211524.log.gz 2024-04-01T00:15:26.300 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168169.log.gz 2024-04-01T00:15:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234440.log 2024-04-01T00:15:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591362.log 2024-04-01T00:15:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.278756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278756.log.gz 2024-04-01T00:15:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204497.log 2024-04-01T00:15:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.234440.log: /var/log/ceph/ceph-client.admin.591362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591362.log.gz 2024-04-01T00:15:26.300 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234440.log.gz 2024-04-01T00:15:26.300 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705902.log 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334114.log 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.204497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204497.log.gz 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.835299.log 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705902.log: /var/log/ceph/ceph-client.admin.334114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334114.log.gz 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705902.log.gz 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566248.log 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.835299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304937.log 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.835299.log.gz 2024-04-01T00:15:26.301 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200805.log 2024-04-01T00:15:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.566248.log: /var/log/ceph/ceph-client.admin.304937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304937.log.gz 2024-04-01T00:15:26.302 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566248.log.gz 2024-04-01T00:15:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232830.log 2024-04-01T00:15:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.200805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337300.log 2024-04-01T00:15:26.302 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200805.log.gz 2024-04-01T00:15:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317119.log 2024-04-01T00:15:26.302 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.232830.log: /var/log/ceph/ceph-client.admin.337300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337300.log.gz 2024-04-01T00:15:26.302 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232830.log.gz 2024-04-01T00:15:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694466.log 2024-04-01T00:15:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.317119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240746.log 2024-04-01T00:15:26.303 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317119.log.gz 2024-04-01T00:15:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200723.log 2024-04-01T00:15:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694466.log: /var/log/ceph/ceph-client.admin.240746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240746.log.gz 2024-04-01T00:15:26.303 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694466.log.gz 2024-04-01T00:15:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356814.log 2024-04-01T00:15:26.303 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.200723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48037.log 2024-04-01T00:15:26.304 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200723.log.gz 2024-04-01T00:15:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123087.log 2024-04-01T00:15:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.356814.log: /var/log/ceph/ceph-client.admin.48037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356814.log.gz 2024-04-01T00:15:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149146.log 2024-04-01T00:15:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.123087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325169.log 2024-04-01T00:15:26.304 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123087.log.gz 2024-04-01T00:15:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248592.log 2024-04-01T00:15:26.304 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149146.log: /var/log/ceph/ceph-client.admin.325169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325169.log.gz 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149146.log.gz 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596902.log 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.248592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198351.log 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248592.log.gz 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.596902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265499.log 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596902.log.gz 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.198351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310290.log 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198351.log.gz 2024-04-01T00:15:26.305 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538485.log 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.265499.log: /var/log/ceph/ceph-client.admin.310290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310290.log.gz 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265499.log.gz 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278769.log 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.538485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281787.log 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538485.log.gz 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226963.log 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.278769.log: /var/log/ceph/ceph-client.admin.281787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281787.log.gz 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278769.log.gz 2024-04-01T00:15:26.306 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208345.log 2024-04-01T00:15:26.307 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384127.log 2024-04-01T00:15:26.307 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226963.log.gz 2024-04-01T00:15:26.307 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309135.log 2024-04-01T00:15:26.307 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.208345.log: /var/log/ceph/ceph-client.admin.384127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384127.log.gz 2024-04-01T00:15:26.307 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208345.log.gz 2024-04-01T00:15:26.307 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569413.log 2024-04-01T00:15:26.307 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113595.log 2024-04-01T00:15:26.307 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309135.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48037.log.gz 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309135.log.gz 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214700.log 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.113595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113595.log.gz 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.569413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569413.log.gz 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123867.log 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210994.log 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.214700.log: /var/log/ceph/ceph-client.admin.123867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123867.log.gz 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214700.log.gz 2024-04-01T00:15:26.308 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149608.log 2024-04-01T00:15:26.309 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46822.log 2024-04-01T00:15:26.309 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210994.log.gz 2024-04-01T00:15:26.309 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303330.log 2024-04-01T00:15:26.309 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149608.log: /var/log/ceph/ceph-client.admin.46822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149608.log.gz 2024-04-01T00:15:26.309 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555497.log 2024-04-01T00:15:26.309 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46822.log.gz 2024-04-01T00:15:26.309 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.303330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232625.log 2024-04-01T00:15:26.309 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303330.log.gz 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693144.log 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.555497.log: /var/log/ceph/ceph-client.admin.232625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232625.log.gz 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555497.log.gz 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47452.log 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.693144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48583.log 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693144.log.gz 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538416.log 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47452.log: /var/log/ceph/ceph-client.admin.48583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49458.log 2024-04-01T00:15:26.310 INFO:teuthology.orchestra.run.smithi120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48583.log.gz 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708526.log 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.538416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223263.log 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538416.log.gz 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.708526.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47452.log.gz 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708526.log.gz 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221161.log 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719737.log 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270964.log 2024-04-01T00:15:26.311 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223263.log: /var/log/ceph/ceph-client.admin.719737.log: 89.7% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223263.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49458.log.gz 2024-04-01T00:15:26.312 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.312 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719737.log.gz 2024-04-01T00:15:26.312 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.221161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272620.log 2024-04-01T00:15:26.312 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221161.log.gz 2024-04-01T00:15:26.312 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712358.log 2024-04-01T00:15:26.312 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.270964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723645.log 2024-04-01T00:15:26.312 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270964.log.gz 2024-04-01T00:15:26.312 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.712358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712358.log.gz 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.272620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129462.log 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272620.log.gz 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568884.log 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.129462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129462.log.gz 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.723645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688674.log 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723645.log.gz 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294082.log 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688674.log.gz 2024-04-01T00:15:26.313 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583579.log 2024-04-01T00:15:26.314 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568884.log.gz 2024-04-01T00:15:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163744.log 2024-04-01T00:15:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583579.log.gz 2024-04-01T00:15:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.294082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348636.log 2024-04-01T00:15:26.314 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294082.log.gz 2024-04-01T00:15:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47242.log 2024-04-01T00:15:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.348636.log: /var/log/ceph/ceph-client.admin.163744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348636.log.gz 2024-04-01T00:15:26.314 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129859.log 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163744.log.gz 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157157.log 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.129859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129859.log.gz 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349897.log 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271715.log 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302603.log 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157157.log.gz 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.271715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271715.log.gz/var/log/ceph/ceph-client.admin.349897.log: 2024-04-01T00:15:26.315 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349897.log.gz 2024-04-01T00:15:26.316 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718848.log 2024-04-01T00:15:26.316 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563785.log 2024-04-01T00:15:26.316 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302603.log: /var/log/ceph/ceph-client.admin.718848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718848.log.gz 2024-04-01T00:15:26.316 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302603.log.gz 2024-04-01T00:15:26.316 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45011.log 2024-04-01T00:15:26.316 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.563785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144614.log 2024-04-01T00:15:26.316 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563785.log.gz 2024-04-01T00:15:26.316 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158080.log 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45011.log: /var/log/ceph/ceph-client.admin.144614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144614.log.gz 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312668.log 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672422.log 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.312668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312668.log.gz 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.158080.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45011.log.gz 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158080.log.gz 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254865.log 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.672422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672422.log.gz 2024-04-01T00:15:26.317 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252148.log 2024-04-01T00:15:26.318 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605458.log 2024-04-01T00:15:26.318 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.252148.log: /var/log/ceph/ceph-client.admin.254865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252148.log.gz 2024-04-01T00:15:26.318 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254865.log.gz 2024-04-01T00:15:26.318 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714561.log 2024-04-01T00:15:26.318 INFO:teuthology.orchestra.run.smithi120.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47242.log.gz 2024-04-01T00:15:26.318 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.605458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833023.log 2024-04-01T00:15:26.318 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605458.log.gz 2024-04-01T00:15:26.318 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725143.log 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.714561.log: /var/log/ceph/ceph-client.admin.833023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833023.log.gz 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714561.log.gz 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348938.log 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709279.log 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.725143.log: /var/log/ceph/ceph-client.admin.348938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348938.log.gz 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725143.log.gz 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620571.log 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725998.log 2024-04-01T00:15:26.319 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709279.log: /var/log/ceph/ceph-client.admin.620571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620571.log.gz 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709279.log.gz 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546003.log 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.725998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730885.log 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725998.log.gz 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.admin.546003.log: --verbose -- /var/log/ceph/ceph-client.admin.331013.log 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.546003.log.gz 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.730885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730885.log.gz 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274372.log 2024-04-01T00:15:26.320 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261188.log 2024-04-01T00:15:26.321 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331013.log.gz 2024-04-01T00:15:26.321 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384599.log 2024-04-01T00:15:26.321 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274372.log: /var/log/ceph/ceph-client.admin.261188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261188.log.gz 2024-04-01T00:15:26.321 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274372.log.gz 2024-04-01T00:15:26.321 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117893.log 2024-04-01T00:15:26.321 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.384599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692846.log 2024-04-01T00:15:26.321 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384599.log.gz 2024-04-01T00:15:26.321 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.117893.log: /var/log/ceph/ceph-client.admin.692846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692846.log.gz 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117893.log.gz 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597839.log 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47596.log 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688157.log 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597839.log: /var/log/ceph/ceph-client.admin.47596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597839.log.gz 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318493.log 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266863.log 2024-04-01T00:15:26.322 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688157.log.gz 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157088.log 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.318493.log: /var/log/ceph/ceph-client.admin.266863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266863.log.gz 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318493.log.gz 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412196.log 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394134.log 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157088.log.gz 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408877.log 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.412196.log: /var/log/ceph/ceph-client.admin.394134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394134.log.gz 2024-04-01T00:15:26.323 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412196.log.gz 2024-04-01T00:15:26.324 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302848.log 2024-04-01T00:15:26.324 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691617.log 2024-04-01T00:15:26.324 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302848.log.gz 2024-04-01T00:15:26.324 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.408877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408877.log.gz 2024-04-01T00:15:26.324 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226156.log 2024-04-01T00:15:26.324 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337218.log 2024-04-01T00:15:26.324 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.691617.log: /var/log/ceph/ceph-client.admin.226156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226156.log.gz 2024-04-01T00:15:26.324 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691617.log.gz 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409600.log 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.337218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343055.log 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337218.log.gz 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226173.log 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409600.log.gz 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715980.log 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226173.log.gz 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227925.log 2024-04-01T00:15:26.325 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343055.log.gz 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561642.log 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.715980.log: /var/log/ceph/ceph-client.admin.227925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227925.log.gz 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715980.log.gz 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194688.log 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.561642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161760.log 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561642.log.gz 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125215.log 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.161760.log: 0.0%/var/log/ceph/ceph-client.admin.194688.log: -- replaced with /var/log/ceph/ceph-client.admin.161760.log.gz 2024-04-01T00:15:26.326 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194688.log.gz 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346112.log 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.125215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832561.log 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125215.log.gz 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353011.log 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.346112.log: /var/log/ceph/ceph-client.admin.832561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832561.log.gz 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346112.log.gz 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47596.log.gz 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571983.log 2024-04-01T00:15:26.327 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273601.log 2024-04-01T00:15:26.328 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.353011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353011.log.gz 2024-04-01T00:15:26.328 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673309.log 2024-04-01T00:15:26.328 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.571983.log: /var/log/ceph/ceph-client.admin.273601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273601.log.gz 2024-04-01T00:15:26.328 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571983.log.gz 2024-04-01T00:15:26.328 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270775.log 2024-04-01T00:15:26.328 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556010.log 2024-04-01T00:15:26.328 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.673309.log: /var/log/ceph/ceph-client.admin.270775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270775.log.gz 2024-04-01T00:15:26.328 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673309.log.gz 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127598.log 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690706.log 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.556010.log: /var/log/ceph/ceph-client.admin.127598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127598.log.gz 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556010.log.gz 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603015.log 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.690706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560876.log 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690706.log.gz 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265042.log 2024-04-01T00:15:26.329 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.603015.log: /var/log/ceph/ceph-client.admin.560876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560876.log.gz 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603015.log.gz 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590874.log 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.265042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149420.log 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265042.log.gz 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.590874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669996.log 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590874.log.gz 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149420.log.gz 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151848.log 2024-04-01T00:15:26.330 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201234.log 2024-04-01T00:15:26.331 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151848.log: /var/log/ceph/ceph-client.admin.669996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151848.log.gz 2024-04-01T00:15:26.331 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669996.log.gz 2024-04-01T00:15:26.331 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843556.log 2024-04-01T00:15:26.338 INFO:teuthology.orchestra.run.smithi203.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-01T00:15:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281290.log 2024-04-01T00:15:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.201234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201234.log.gz 2024-04-01T00:15:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605966.log 2024-04-01T00:15:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843556.log: /var/log/ceph/ceph-client.admin.281290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281290.log.gz 2024-04-01T00:15:26.407 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843556.log.gz 2024-04-01T00:15:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608979.log 2024-04-01T00:15:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590791.log 2024-04-01T00:15:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.608979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608979.log.gz/var/log/ceph/ceph-client.admin.605966.log: 2024-04-01T00:15:26.407 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605966.log.gz 2024-04-01T00:15:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335508.log 2024-04-01T00:15:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692029.log 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.590791.log: /var/log/ceph/ceph-client.admin.335508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335508.log.gz 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590791.log.gz 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145343.log 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598290.log 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692029.log.gz 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305572.log 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145343.log: /var/log/ceph/ceph-client.admin.598290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598290.log.gz 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145343.log.gz 2024-04-01T00:15:26.408 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588292.log 2024-04-01T00:15:26.409 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672872.log 2024-04-01T00:15:26.409 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.305572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238929.log 2024-04-01T00:15:26.409 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305572.log.gz 2024-04-01T00:15:26.409 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.672872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672872.log.gz 2024-04-01T00:15:26.409 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.588292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613775.log 2024-04-01T00:15:26.409 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588292.log.gz 2024-04-01T00:15:26.409 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.238929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238929.log.gz 2024-04-01T00:15:26.409 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328119.log 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275988.log 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.328119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328119.log.gz 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.613775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613775.log.gz 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311653.log 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167364.log 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607342.log 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.275988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275988.log.gz 2024-04-01T00:15:26.410 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.311653.log: /var/log/ceph/ceph-client.admin.167364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330035.log 2024-04-01T00:15:26.411 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167364.log.gz 2024-04-01T00:15:26.411 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311653.log.gz 2024-04-01T00:15:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.607342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607342.log.gz 2024-04-01T00:15:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161327.log 2024-04-01T00:15:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.330035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279609.log 2024-04-01T00:15:26.411 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330035.log.gz 2024-04-01T00:15:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257040.log 2024-04-01T00:15:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.161327.log: /var/log/ceph/ceph-client.admin.279609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279609.log.gz 2024-04-01T00:15:26.412 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161327.log.gz 2024-04-01T00:15:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231684.log 2024-04-01T00:15:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.257040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124752.log 2024-04-01T00:15:26.412 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257040.log.gz 2024-04-01T00:15:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728395.log 2024-04-01T00:15:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.231684.log: /var/log/ceph/ceph-client.admin.124752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231684.log.gz 2024-04-01T00:15:26.412 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124752.log.gz 2024-04-01T00:15:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331636.log 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.728395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292078.log 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728395.log.gz 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585543.log 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331636.log: /var/log/ceph/ceph-client.admin.292078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331636.log.gz 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292078.log.gz 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217548.log 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.585543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553204.log 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585543.log.gz 2024-04-01T00:15:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723658.log 2024-04-01T00:15:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.217548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217548.log.gz 2024-04-01T00:15:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.553204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553204.log.gz 2024-04-01T00:15:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621023.log 2024-04-01T00:15:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.723658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726981.log 2024-04-01T00:15:26.414 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723658.log.gz 2024-04-01T00:15:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235945.log 2024-04-01T00:15:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.621023.log: /var/log/ceph/ceph-client.admin.726981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726981.log.gz 2024-04-01T00:15:26.414 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621023.log.gz 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328634.log 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848856.log 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235945.log.gz 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.328634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326889.log 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328634.log.gz 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848856.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.848856.log.gz 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713042.log 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594656.log 2024-04-01T00:15:26.415 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713042.log.gz 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.326889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326889.log.gz 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292160.log 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701254.log 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.594656.log: /var/log/ceph/ceph-client.admin.292160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292160.log.gz 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594656.log.gz 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43961.log 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.701254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45305.log 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701254.log.gz 2024-04-01T00:15:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571795.log 2024-04-01T00:15:26.417 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43961.log: /var/log/ceph/ceph-client.admin.45305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141277.log 2024-04-01T00:15:26.417 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.571795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323339.log 2024-04-01T00:15:26.417 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571795.log.gz 2024-04-01T00:15:26.417 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328201.log 2024-04-01T00:15:26.417 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.141277.log: /var/log/ceph/ceph-client.admin.323339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323339.log.gz 2024-04-01T00:15:26.417 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141277.log.gz 2024-04-01T00:15:26.417 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2024-04-01T00:15:26.417 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585972.log 2024-04-01T00:15:26.418 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43961.log.gz 2024-04-01T00:15:26.418 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44969.log: /var/log/ceph/ceph-client.admin.328201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328201.log.gz 2024-04-01T00:15:26.418 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611255.log 2024-04-01T00:15:26.418 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2024-04-01T00:15:26.418 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.585972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730683.log 2024-04-01T00:15:26.418 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585972.log.gz 2024-04-01T00:15:26.418 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309332.log 2024-04-01T00:15:26.418 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.730683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730683.log.gz 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.611255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611255.log.gz 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307213.log 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616190.log 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309332.log: /var/log/ceph/ceph-client.admin.307213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307213.log.gz 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309332.log.gz 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411458.log 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.616190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568840.log 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616190.log.gz 2024-04-01T00:15:26.419 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306733.log 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.411458.log: /var/log/ceph/ceph-client.admin.568840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568840.log.gz 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411458.log.gz 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322560.log 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.306733.log: /var/log/ceph/ceph-client.admin.270762.log 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306733.log.gz 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143966.log 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.322560.log: /var/log/ceph/ceph-client.admin.270762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270762.log.gz 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322560.log.gz 2024-04-01T00:15:26.420 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721406.log 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360652.log 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45305.log.gz 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143966.log.gz 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309414.log 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.721406.log: /var/log/ceph/ceph-client.admin.360652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360652.log.gz 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721406.log.gz 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341809.log 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2024-04-01T00:15:26.421 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309414.log.gz 2024-04-01T00:15:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127154.log 2024-04-01T00:15:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341809.log: /var/log/ceph/ceph-client.admin.46696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341809.log.gz 2024-04-01T00:15:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199273.log 2024-04-01T00:15:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832491.log 2024-04-01T00:15:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.127154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127154.log.gz 2024-04-01T00:15:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117880.log 2024-04-01T00:15:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.199273.log: /var/log/ceph/ceph-client.admin.832491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832491.log.gz 2024-04-01T00:15:26.422 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199273.log.gz 2024-04-01T00:15:26.423 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545477.log 2024-04-01T00:15:26.423 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.117880.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2024-04-01T00:15:26.423 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.616938.log 2024-04-01T00:15:26.423 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117880.log.gz 2024-04-01T00:15:26.423 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613788.log 2024-04-01T00:15:26.423 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.545477.log: /var/log/ceph/ceph-client.admin.616938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616938.log.gz 2024-04-01T00:15:26.423 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.545477.log.gz 2024-04-01T00:15:26.423 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235958.log 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.613788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725061.log 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613788.log.gz 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213860.log 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235958.log: /var/log/ceph/ceph-client.admin.725061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725061.log.gz 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235958.log.gz 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287642.log 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.213860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536119.log 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213860.log.gz 2024-04-01T00:15:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609549.log 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.287642.log: /var/log/ceph/ceph-client.admin.536119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.536119.log.gz 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287642.log.gz 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312586.log 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.609549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199883.log 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609549.log.gz 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203973.log 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.312586.log: /var/log/ceph/ceph-client.admin.199883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199883.log.gz 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312586.log.gz 2024-04-01T00:15:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44045.log 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.203973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537141.log 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203973.log.gz 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617845.log 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44045.log: /var/log/ceph/ceph-client.admin.537141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537141.log.gz 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155232.log 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711400.log 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155232.log: /var/log/ceph/ceph-client.admin.617845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155232.log.gz 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44045.log.gz 2024-04-01T00:15:26.426 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617845.log.gz 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302590.log 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711400.log.gz 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320856.log 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342859.log 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320856.log: /var/log/ceph/ceph-client.admin.302590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320856.log.gz 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302590.log.gz 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693563.log 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333748.log 2024-04-01T00:15:26.427 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.693563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693563.log.gz 2024-04-01T00:15:26.428 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.342859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342859.log.gz 2024-04-01T00:15:26.428 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281984.log 2024-04-01T00:15:26.428 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293373.log 2024-04-01T00:15:26.428 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.333748.log: /var/log/ceph/ceph-client.admin.281984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281984.log.gz 2024-04-01T00:15:26.428 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333748.log.gz 2024-04-01T00:15:26.428 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229367.log 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286922.log 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293373.log.gz 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230301.log 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.229367.log: /var/log/ceph/ceph-client.admin.286922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286922.log.gz 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229367.log.gz 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611754.log 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.230301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553763.log 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230301.log.gz 2024-04-01T00:15:26.429 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43393.log 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.611754.log: /var/log/ceph/ceph-client.admin.553763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611754.log.gz 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553763.log.gz 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546443.log 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610802.log 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605527.log 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.546443.log: /var/log/ceph/ceph-client.admin.610802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610802.log.gz 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.546443.log.gz 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591293.log 88.3% 2024-04-01T00:15:26.430 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43393.log.gz 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.605527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605527.log.gz 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227431.log 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202872.log 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.591293.log: /var/log/ceph/ceph-client.admin.227431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227431.log.gz 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591293.log.gz 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568950.log 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.202872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209642.log 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202872.log.gz 2024-04-01T00:15:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.568950.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.571782.log 2024-04-01T00:15:26.432 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568950.log.gz 2024-04-01T00:15:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.209642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209642.log.gz 2024-04-01T00:15:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319911.log 2024-04-01T00:15:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.571782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127667.log 2024-04-01T00:15:26.432 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571782.log.gz 2024-04-01T00:15:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584332.log 2024-04-01T00:15:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.319911.log: /var/log/ceph/ceph-client.admin.127667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319911.log.gz 2024-04-01T00:15:26.432 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127667.log.gz 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112220.log 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671964.log 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584332.log.gz 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44433.log 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.112220.log: /var/log/ceph/ceph-client.admin.671964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671964.log.gz 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112220.log.gz 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126665.log 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239326.log 2024-04-01T00:15:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115831.log 2024-04-01T00:15:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126665.log: /var/log/ceph/ceph-client.admin.239326.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239326.log.gz 2024-04-01T00:15:26.434 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.126665.log.gz 2024-04-01T00:15:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355121.log 2024-04-01T00:15:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156130.log 2024-04-01T00:15:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.115831.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44433.log.gz 2024-04-01T00:15:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327768.log 2024-04-01T00:15:26.434 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115831.log.gz 2024-04-01T00:15:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.156130.log: /var/log/ceph/ceph-client.admin.355121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156130.log.gz 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355121.log.gz 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692581.log 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.327768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206392.log 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327768.log.gz 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689690.log 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692581.log: /var/log/ceph/ceph-client.admin.206392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206392.log.gz 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692581.log.gz 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719750.log 2024-04-01T00:15:26.435 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.689690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48379.log 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689690.log.gz 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348869.log 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.719750.log: /var/log/ceph/ceph-client.admin.48379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719750.log.gz 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237350.log 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48379.log.gz 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.348869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241499.log 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348869.log.gz 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291132.log 2024-04-01T00:15:26.436 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.237350.log: /var/log/ceph/ceph-client.admin.241499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241499.log.gz 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237350.log.gz 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251432.log 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843474.log 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.291132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718347.log 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291132.log.gz 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843474.log.gz 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.251432.log: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.251432.log.gz /var/log/ceph/ceph-client.admin.308848.log 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.437 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159895.log 2024-04-01T00:15:26.438 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.308848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308848.log.gz 2024-04-01T00:15:26.438 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.718347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668676.log 2024-04-01T00:15:26.438 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718347.log.gz 2024-04-01T00:15:26.438 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339599.log 2024-04-01T00:15:26.438 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.668676.log: /var/log/ceph/ceph-client.admin.159895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668676.log.gz 2024-04-01T00:15:26.438 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216626.log 2024-04-01T00:15:26.438 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159895.log.gz 2024-04-01T00:15:26.438 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345639.log 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.216626.log: /var/log/ceph/ceph-client.admin.339599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216626.log.gz 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334183.log 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339599.log.gz 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848604.log 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.334183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334183.log.gz 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.345639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342429.log 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345639.log.gz 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572422.log 2024-04-01T00:15:26.439 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.342429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342429.log.gz 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47917.log 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261619.log 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47917.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.848604.log.gz 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.572422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575284.log 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572422.log.gz 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.261619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261619.log.gz 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222575.log 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47917.log.gz 2024-04-01T00:15:26.440 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299649.log 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222575.log.gz 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.575284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712563.log 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575284.log.gz 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611173.log 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.712563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712563.log.gz 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.299649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253663.log 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299649.log.gz 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234509.log 2024-04-01T00:15:26.441 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253663.log: 0.0%/var/log/ceph/ceph-client.admin.611173.log: -- replaced with /var/log/ceph/ceph-client.admin.253663.log.gz 2024-04-01T00:15:26.442 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277767.log 2024-04-01T00:15:26.442 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611173.log.gz 2024-04-01T00:15:26.442 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562368.log 2024-04-01T00:15:26.442 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.277767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277767.log.gz 2024-04-01T00:15:26.442 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.234509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287118.log 2024-04-01T00:15:26.442 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234509.log.gz 2024-04-01T00:15:26.442 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561437.log 2024-04-01T00:15:26.442 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.287118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287118.log.gz 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.562368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562573.log 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562368.log.gz 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246950.log 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.562573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562573.log.gz 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.561437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706382.log 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561437.log.gz 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150134.log 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.706382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706382.log.gz 2024-04-01T00:15:26.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.246950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382032.log 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246950.log.gz 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342872.log 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.382032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382032.log.gz 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.150134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609741.log 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150134.log.gz 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338928.log 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.609741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609741.log.gz/var/log/ceph/ceph-client.admin.342872.log: 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.838441.log 2024-04-01T00:15:26.444 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342872.log.gz 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162157.log 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.838441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.838441.log.gz 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727435.log 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338928.log.gz 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407984.log 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.727435.log: /var/log/ceph/ceph-client.admin.162157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727435.log.gz 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848688.log 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162157.log.gz 2024-04-01T00:15:26.445 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550016.log 2024-04-01T00:15:26.446 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848688.log: /var/log/ceph/ceph-client.admin.407984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224996.log 2024-04-01T00:15:26.446 INFO:teuthology.orchestra.run.smithi120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.848688.log.gz 2024-04-01T00:15:26.446 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407984.log.gz 2024-04-01T00:15:26.446 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847426.log 2024-04-01T00:15:26.446 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.550016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.550016.log.gz 2024-04-01T00:15:26.446 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245642.log 2024-04-01T00:15:26.446 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847426.log: /var/log/ceph/ceph-client.admin.224996.log: gzip 0.0% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.224996.log.gz /var/log/ceph/ceph-client.admin.114056.log 2024-04-01T00:15:26.446 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.847426.log.gz 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708731.log 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.245642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586435.log 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245642.log.gz 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.708731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708731.log.gz 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.114056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848141.log 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114056.log.gz 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592699.log 2024-04-01T00:15:26.447 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848141.log: /var/log/ceph/ceph-client.admin.586435.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.848141.log.gz 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359158.log 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586435.log.gz 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48877.log 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.592699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592699.log.gz 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600932.log 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48877.log: /var/log/ceph/ceph-client.admin.359158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347914.log 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359158.log.gz 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315445.log 2024-04-01T00:15:26.448 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48877.log.gz 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.600932.log: /var/log/ceph/ceph-client.admin.347914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347914.log.gz 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600932.log.gz 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589953.log 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289368.log 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315445.log.gz 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146274.log 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.589953.log: /var/log/ceph/ceph-client.admin.289368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289368.log.gz 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589953.log.gz 2024-04-01T00:15:26.449 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47995.log 2024-04-01T00:15:26.450 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347461.log 2024-04-01T00:15:26.450 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146274.log.gz 2024-04-01T00:15:26.450 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721393.log 2024-04-01T00:15:26.450 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47995.log: /var/log/ceph/ceph-client.admin.347461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347461.log.gz 2024-04-01T00:15:26.450 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249563.log 2024-04-01T00:15:26.450 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704750.log 2024-04-01T00:15:26.450 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47995.log.gz 2024-04-01T00:15:26.450 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249563.log.gz 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.721393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721393.log.gz 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616496.log 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710168.log 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.704750.log: /var/log/ceph/ceph-client.admin.616496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616496.log.gz 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704750.log.gz 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226193.log 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608700.log 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710168.log.gz 2024-04-01T00:15:26.451 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253389.log 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226193.log.gz 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.608700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608700.log.gz 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258644.log 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334196.log 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253389.log.gz 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411246.log 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.258644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258644.log.gz 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.334196.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.334196.log.gz 2024-04-01T00:15:26.452 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.554648.log 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.411246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545099.log 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411246.log.gz 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.554648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246556.log 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554648.log.gz 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.545099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.545099.log.gz 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264973.log 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.246556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727811.log 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246556.log.gz 2024-04-01T00:15:26.453 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193501.log 2024-04-01T00:15:26.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.264973.log: /var/log/ceph/ceph-client.admin.727811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727811.log.gz 2024-04-01T00:15:26.454 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264973.log.gz 2024-04-01T00:15:26.454 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613353.log 2024-04-01T00:15:26.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.193501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705230.log 2024-04-01T00:15:26.454 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193501.log.gz 2024-04-01T00:15:26.454 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213317.log 2024-04-01T00:15:26.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.613353.log: /var/log/ceph/ceph-client.admin.705230.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705230.log.gz 2024-04-01T00:15:26.454 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.613353.log.gz 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568307.log 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553465.log 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.213317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213317.log.gz 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673667.log 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568307.log.gz 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.553465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553465.log.gz 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355998.log 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322832.log 2024-04-01T00:15:26.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.673667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303626.log 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673667.log.gz 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.322832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322832.log.gz 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.355998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110311.log 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355998.log.gz 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573276.log 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.110311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110311.log.gz 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.303626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145532.log 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303626.log.gz 2024-04-01T00:15:26.456 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249824.log 2024-04-01T00:15:26.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145532.log.gz 2024-04-01T00:15:26.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.573276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168238.log 2024-04-01T00:15:26.457 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573276.log.gz 2024-04-01T00:15:26.457 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128482.log 2024-04-01T00:15:26.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.168238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168238.log.gz 2024-04-01T00:15:26.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356801.log 2024-04-01T00:15:26.457 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249824.log.gz 2024-04-01T00:15:26.457 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354670.log 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.356801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356801.log.gz 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.128482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330227.log 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128482.log.gz 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111715.log 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.330227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330227.log.gz 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.354670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848562.log 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354670.log.gz 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.837931.log 2024-04-01T00:15:26.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848562.log: /var/log/ceph/ceph-client.admin.111715.log: gzip -5 --verbose 89.2% -- -- replaced with /var/log/ceph/ceph-client.admin.848562.log.gz /var/log/ceph/ceph-client.admin.673227.log 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111715.log.gz 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.837931.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.585016.log 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.837931.log.gz 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357075.log 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.673227.log: /var/log/ceph/ceph-client.admin.585016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673227.log.gz 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585016.log.gz 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266591.log 2024-04-01T00:15:26.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.357075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233757.log 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357075.log.gz 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.266591.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266591.log.gz 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111646.log 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309880.log 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.233757.log: /var/log/ceph/ceph-client.admin.111646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111646.log.gz 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233757.log.gz 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551844.log 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601788.log 2024-04-01T00:15:26.460 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309880.log.gz 2024-04-01T00:15:26.461 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349884.log 2024-04-01T00:15:26.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.551844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551844.log.gz 2024-04-01T00:15:26.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.601788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601788.log.gz 2024-04-01T00:15:26.461 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224033.log 2024-04-01T00:15:26.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.349884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260517.log 2024-04-01T00:15:26.461 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349884.log.gz 2024-04-01T00:15:26.461 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597126.log 2024-04-01T00:15:26.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.224033.log: /var/log/ceph/ceph-client.admin.260517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260517.log.gz 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224033.log.gz 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.838372.log 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333679.log 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597126.log.gz 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707294.log 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.838372.log: /var/log/ceph/ceph-client.admin.333679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333679.log.gz 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.838372.log.gz 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126109.log 2024-04-01T00:15:26.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2024-04-01T00:15:26.463 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707294.log.gz 2024-04-01T00:15:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585461.log 2024-04-01T00:15:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126109.log: /var/log/ceph/ceph-client.admin.44435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126109.log.gz 2024-04-01T00:15:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283792.log 2024-04-01T00:15:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.585461.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2024-04-01T00:15:26.463 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.222793.log 2024-04-01T00:15:26.463 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585461.log.gz 2024-04-01T00:15:26.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272894.log 2024-04-01T00:15:26.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283792.log: /var/log/ceph/ceph-client.admin.222793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222793.log.gz 2024-04-01T00:15:26.464 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283792.log.gz 2024-04-01T00:15:26.464 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709963.log 2024-04-01T00:15:26.566 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.272894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215243.log 2024-04-01T00:15:26.567 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272894.log.gz 2024-04-01T00:15:26.567 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714274.log 2024-04-01T00:15:26.567 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709963.log: /var/log/ceph/ceph-client.admin.215243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215243.log.gz 2024-04-01T00:15:26.567 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709963.log.gz 2024-04-01T00:15:26.567 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256536.log 2024-04-01T00:15:26.567 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.714274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848772.log 2024-04-01T00:15:26.567 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714274.log.gz 2024-04-01T00:15:26.568 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285977.log 2024-04-01T00:15:26.568 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.256536.log: /var/log/ceph/ceph-client.admin.848772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256536.log.gz 2024-04-01T00:15:26.568 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.848772.log.gz 2024-04-01T00:15:26.568 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127223.log 2024-04-01T00:15:26.568 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574366.log 2024-04-01T00:15:26.568 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285977.log.gz 2024-04-01T00:15:26.568 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257940.log 2024-04-01T00:15:26.568 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.127223.log: /var/log/ceph/ceph-client.admin.574366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574366.log.gz 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127223.log.gz 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695863.log 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.257940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322547.log 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257940.log.gz 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323037.log 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.695863.log: /var/log/ceph/ceph-client.admin.322547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322547.log.gz 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695863.log.gz 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326820.log 2024-04-01T00:15:26.569 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.323037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356455.log 2024-04-01T00:15:26.570 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323037.log.gz 2024-04-01T00:15:26.570 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207745.log 2024-04-01T00:15:26.570 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.326820.log: /var/log/ceph/ceph-client.admin.356455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356455.log.gz 2024-04-01T00:15:26.570 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326820.log.gz 2024-04-01T00:15:26.570 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345110.log 2024-04-01T00:15:26.570 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407902.log 2024-04-01T00:15:26.570 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.207745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207745.log.gz 2024-04-01T00:15:26.570 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47200.log 2024-04-01T00:15:26.571 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.345110.log: /var/log/ceph/ceph-client.admin.407902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407902.log.gz 2024-04-01T00:15:26.571 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345110.log.gz 2024-04-01T00:15:26.571 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607355.log 2024-04-01T00:15:26.571 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143061.log 2024-04-01T00:15:26.571 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314565.log 2024-04-01T00:15:26.571 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.607355.log: /var/log/ceph/ceph-client.admin.143061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143061.log.gz 2024-04-01T00:15:26.571 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607355.log.gz 2024-04-01T00:15:26.571 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353285.log 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.314565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552796.log 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314565.log.gz 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437950.log 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.353285.log: /var/log/ceph/ceph-client.admin.552796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552796.log.gz 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353285.log.gz 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259728.log 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552036.log 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.437950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.437950.log.gz 2024-04-01T00:15:26.572 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846404.log 2024-04-01T00:15:26.573 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.259728.log: /var/log/ceph/ceph-client.admin.552036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552036.log.gz 2024-04-01T00:15:26.573 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259728.log.gz 2024-04-01T00:15:26.573 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614780.log 2024-04-01T00:15:26.573 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.846404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240541.log 2024-04-01T00:15:26.573 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846404.log.gz 2024-04-01T00:15:26.573 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302806.log 2024-04-01T00:15:26.573 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.614780.log: /var/log/ceph/ceph-client.admin.240541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240541.log.gz 2024-04-01T00:15:26.573 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614780.log.gz 2024-04-01T00:15:26.574 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717022.log 2024-04-01T00:15:26.574 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603594.log 2024-04-01T00:15:26.574 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302806.log.gz 2024-04-01T00:15:26.574 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.840249.log 2024-04-01T00:15:26.574 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.717022.log: /var/log/ceph/ceph-client.admin.603594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603594.log.gz 2024-04-01T00:15:26.574 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717022.log.gz 2024-04-01T00:15:26.574 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279883.log 2024-04-01T00:15:26.574 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.840249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.840249.log.gz 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47200.log.gz 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705491.log 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.279883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674185.log 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279883.log.gz 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151930.log 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705491.log.gz 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.674185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266414.log 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674185.log.gz 2024-04-01T00:15:26.575 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275570.log 2024-04-01T00:15:26.576 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151930.log.gz 2024-04-01T00:15:26.576 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410975.log 2024-04-01T00:15:26.576 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.275570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275570.log.gz 2024-04-01T00:15:26.576 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.266414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266414.log.gz 2024-04-01T00:15:26.576 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342360.log 2024-04-01T00:15:26.576 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568796.log 2024-04-01T00:15:26.576 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.342360.log: /var/log/ceph/ceph-client.admin.410975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342360.log.gz 2024-04-01T00:15:26.576 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410975.log.gz 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260778.log 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247397.log 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568796.log.gz 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848520.log 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.260778.log: /var/log/ceph/ceph-client.admin.247397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260778.log.gz 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247397.log.gz 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106923.log 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341327.log 2024-04-01T00:15:26.577 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596386.log 2024-04-01T00:15:26.578 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.106923.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.848520.log.gz 2024-04-01T00:15:26.578 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106923.log.gz 2024-04-01T00:15:26.578 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341327.log.gz 2024-04-01T00:15:26.578 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409313.log 2024-04-01T00:15:26.578 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277324.log 2024-04-01T00:15:26.578 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.596386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596386.log.gz 2024-04-01T00:15:26.578 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409313.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409313.log.gz 2024-04-01T00:15:26.578 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.254604.log 2024-04-01T00:15:26.579 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.277324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718779.log 2024-04-01T00:15:26.579 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277324.log.gz 2024-04-01T00:15:26.579 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.837027.log 2024-04-01T00:15:26.579 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.254604.log: /var/log/ceph/ceph-client.admin.718779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718779.log.gz 2024-04-01T00:15:26.579 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254604.log.gz 2024-04-01T00:15:26.579 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317602.log 2024-04-01T00:15:26.579 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.837027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148767.log 2024-04-01T00:15:26.579 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.837027.log.gz 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46521.log 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.317602.log: /var/log/ceph/ceph-client.admin.148767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148767.log.gz 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317602.log.gz 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313166.log 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.2.46521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225693.log 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46521.log.gz 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147191.log 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.313166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313166.log.gz 2024-04-01T00:15:26.580 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.225693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225693.log.gz 2024-04-01T00:15:26.581 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160332.log 2024-04-01T00:15:26.581 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258918.log 2024-04-01T00:15:26.581 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147191.log.gz 2024-04-01T00:15:26.581 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697611.log 2024-04-01T00:15:26.581 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160332.log: /var/log/ceph/ceph-client.admin.258918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258918.log.gz 2024-04-01T00:15:26.581 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160332.log.gz 2024-04-01T00:15:26.581 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210529.log 2024-04-01T00:15:26.581 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705012.log 2024-04-01T00:15:26.582 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210529.log: /var/log/ceph/ceph-client.admin.697611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210529.log.gz 2024-04-01T00:15:26.582 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697611.log.gz 2024-04-01T00:15:26.582 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593152.log 2024-04-01T00:15:26.582 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197399.log 2024-04-01T00:15:26.582 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705012.log: /var/log/ceph/ceph-client.admin.593152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593152.log.gz 2024-04-01T00:15:26.582 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705012.log.gz 2024-04-01T00:15:26.582 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538498.log 2024-04-01T00:15:26.582 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.197399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113582.log 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197399.log.gz 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44213.log 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.538498.log: /var/log/ceph/ceph-client.admin.113582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113582.log.gz 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538498.log.gz 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49585.log 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842141.log 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842591.log 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49585.log: /var/log/ceph/ceph-client.admin.842141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842141.log.gz 2024-04-01T00:15:26.583 INFO:teuthology.orchestra.run.smithi120.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44213.log.gz 2024-04-01T00:15:26.584 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703980.log 2024-04-01T00:15:26.584 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37933.log 2024-04-01T00:15:26.584 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.703980.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49585.log.gz 2024-04-01T00:15:26.584 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703980.log.gz 2024-04-01T00:15:26.584 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.842591.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.842591.log.gz 2024-04-01T00:15:26.584 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.242502.log 2024-04-01T00:15:26.584 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-04-01T00:15:26.584 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242502.log.gz 2024-04-01T00:15:26.585 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.37933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288395.log 2024-04-01T00:15:26.585 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211063.log 2024-04-01T00:15:26.585 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288395.log.gz 2024-04-01T00:15:26.585 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144897.log 2024-04-01T00:15:26.585 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341340.log 2024-04-01T00:15:26.585 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.211063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340150.log 2024-04-01T00:15:26.585 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211063.log.gz 2024-04-01T00:15:26.585 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341340.log: /var/log/ceph/ceph-client.admin.144897.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341340.log.gz 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144897.log.gz 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236916.log 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841214.log 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.340150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832575.log 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340150.log.gz 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.236916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324298.log 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236916.log.gz 2024-04-01T00:15:26.586 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.832575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832575.log.gz 2024-04-01T00:15:26.587 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.841214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221243.log 2024-04-01T00:15:26.587 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841214.log.gz 2024-04-01T00:15:26.587 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126583.log 2024-04-01T00:15:26.587 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.221243.log: /var/log/ceph/ceph-client.admin.324298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221243.log.gz 2024-04-01T00:15:26.587 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116713.log 2024-04-01T00:15:26.587 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324298.log.gz 2024-04-01T00:15:26.587 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569703.log 2024-04-01T00:15:26.587 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.116713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116713.log.gz 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602312.log 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126583.log.gz 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585903.log 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.602312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602312.log.gz 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.569703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284066.log 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569703.log.gz 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538896.log 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284066.log: /var/log/ceph/ceph-client.admin.585903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284066.log.gz 2024-04-01T00:15:26.588 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199342.log 2024-04-01T00:15:26.589 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585903.log.gz 2024-04-01T00:15:26.589 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675790.log 2024-04-01T00:15:26.589 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.199342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199342.log.gz/var/log/ceph/ceph-client.admin.538896.log: 2024-04-01T00:15:26.589 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546884.log 2024-04-01T00:15:26.589 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538896.log.gz 2024-04-01T00:15:26.589 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346597.log 2024-04-01T00:15:26.589 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.546884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.546884.log.gz 2024-04-01T00:15:26.589 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693131.log 2024-04-01T00:15:26.590 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675790.log.gz 2024-04-01T00:15:26.590 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720863.log 2024-04-01T00:15:26.590 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.693131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693131.log.gz 2024-04-01T00:15:26.590 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.346597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724853.log 2024-04-01T00:15:26.590 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346597.log.gz 2024-04-01T00:15:26.590 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265512.log 2024-04-01T00:15:26.590 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.724853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724853.log.gz 2024-04-01T00:15:26.590 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.720863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44772.log 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720863.log.gz 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603028.log 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44772.log: /var/log/ceph/ceph-client.admin.265512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598712.log 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265512.log.gz 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300168.log 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44772.log.gz 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.598712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598712.log.gz 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.603028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603028.log.gz 2024-04-01T00:15:26.591 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842604.log 2024-04-01T00:15:26.592 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-01T00:15:26.592 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.300168.log: /var/log/ceph/ceph-client.admin.842604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842604.log.gz 2024-04-01T00:15:26.592 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300168.log.gz 2024-04-01T00:15:26.592 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202673.log 2024-04-01T00:15:26.592 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241512.log 2024-04-01T00:15:26.592 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674116.log 2024-04-01T00:15:26.592 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.202673.log: /var/log/ceph/ceph-client.admin.241512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241512.log.gz 2024-04-01T00:15:26.592 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202673.log.gz 2024-04-01T00:15:26.593 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71958.log 2024-04-01T00:15:26.593 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.674116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286374.log 2024-04-01T00:15:26.593 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674116.log.gz 2024-04-01T00:15:26.593 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691190.log 2024-04-01T00:15:26.593 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.71958.log: /var/log/ceph/ceph-client.admin.286374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286374.log.gz 2024-04-01T00:15:26.593 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115900.log 2024-04-01T00:15:26.593 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167791.log 2024-04-01T00:15:26.593 INFO:teuthology.orchestra.run.smithi120.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71958.log.gz 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.115900.log: /var/log/ceph/ceph-client.admin.691190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115900.log.gz 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691190.log.gz 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45263.log 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543223.log 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37933.log.gz 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.167791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167791.log.gz 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248318.log 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205782.log 2024-04-01T00:15:26.594 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.248318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248318.log.gz 2024-04-01T00:15:26.595 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.543223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.543223.log.gz 2024-04-01T00:15:26.595 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593070.log 2024-04-01T00:15:26.595 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.205782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258357.log 2024-04-01T00:15:26.595 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205782.log.gz 2024-04-01T00:15:26.595 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.593070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716062.log 2024-04-01T00:15:26.595 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593070.log.gz 2024-04-01T00:15:26.595 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243616.log 2024-04-01T00:15:26.595 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.716062.log: /var/log/ceph/ceph-client.admin.258357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716062.log.gz 2024-04-01T00:15:26.596 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258357.log.gz 2024-04-01T00:15:26.596 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268274.log 2024-04-01T00:15:26.596 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711879.log 2024-04-01T00:15:26.596 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243616.log.gz 2024-04-01T00:15:26.596 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322763.log 2024-04-01T00:15:26.596 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711879.log: /var/log/ceph/ceph-client.admin.268274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711879.log.gz 2024-04-01T00:15:26.596 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268274.log.gz 2024-04-01T00:15:26.596 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359076.log 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145086.log 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.322763.log: /var/log/ceph/ceph-client.admin.359076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548224.log 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322763.log.gz 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145086.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145086.log.gz 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.359076.log.gz 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210103.log 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275135.log 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210103.log.gz 2024-04-01T00:15:26.597 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.548224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.548224.log.gz 2024-04-01T00:15:26.598 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318868.log 2024-04-01T00:15:26.598 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710934.log 2024-04-01T00:15:26.598 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.318868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318868.log.gz 2024-04-01T00:15:26.598 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.275135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255748.log 2024-04-01T00:15:26.598 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275135.log.gz 2024-04-01T00:15:26.598 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48337.log 2024-04-01T00:15:26.598 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710934.log: /var/log/ceph/ceph-client.admin.255748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255748.log.gz 2024-04-01T00:15:26.598 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710934.log.gz 2024-04-01T00:15:26.599 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715056.log 2024-04-01T00:15:26.599 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.839276.log 2024-04-01T00:15:26.599 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.715056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715056.log.gz 2024-04-01T00:15:26.599 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287437.log 2024-04-01T00:15:26.599 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304868.log 2024-04-01T00:15:26.599 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.839276.log: /var/log/ceph/ceph-client.admin.287437.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48337.log.gz 2024-04-01T00:15:26.599 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287437.log.gz -- replaced with /var/log/ceph/ceph-client.admin.839276.log.gz 2024-04-01T00:15:26.599 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.600 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44765.log 2024-04-01T00:15:26.600 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258836.log 2024-04-01T00:15:26.600 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.304868.log: /var/log/ceph/ceph-client.admin.44765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304868.log.gz 2024-04-01T00:15:26.600 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693926.log 2024-04-01T00:15:26.600 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.258836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591824.log 2024-04-01T00:15:26.600 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258836.log.gz 2024-04-01T00:15:26.600 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462780.log 2024-04-01T00:15:26.600 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.693926.log: /var/log/ceph/ceph-client.admin.591824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591824.log.gz 2024-04-01T00:15:26.601 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693926.log.gz 2024-04-01T00:15:26.601 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44765.log.gz 2024-04-01T00:15:26.601 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328552.log 2024-04-01T00:15:26.601 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347547.log 2024-04-01T00:15:26.601 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.462780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338829.log 2024-04-01T00:15:26.601 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.328552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.462780.log.gz 2024-04-01T00:15:26.601 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584537.log 2024-04-01T00:15:26.601 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328552.log.gz 2024-04-01T00:15:26.602 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338829.log.gz 2024-04-01T00:15:26.602 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.347547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241307.log 2024-04-01T00:15:26.602 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347547.log.gz 2024-04-01T00:15:26.602 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276485.log 2024-04-01T00:15:26.602 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.241307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241307.log.gz 2024-04-01T00:15:26.602 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713124.log 2024-04-01T00:15:26.602 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584537.log.gz 2024-04-01T00:15:26.602 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276485.log.gz 2024-04-01T00:15:26.603 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130137.log 2024-04-01T00:15:26.603 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302057.log 2024-04-01T00:15:26.603 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568928.log 2024-04-01T00:15:26.603 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713124.log.gz 2024-04-01T00:15:26.603 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302057.log.gz 2024-04-01T00:15:26.603 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.130137.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.115013.log 2024-04-01T00:15:26.603 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130137.log.gz 2024-04-01T00:15:26.603 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359145.log 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568928.log.gz 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274085.log 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.115013.log: /var/log/ceph/ceph-client.admin.359145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359145.log.gz 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115013.log.gz 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721324.log 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45263.log.gz 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126351.log 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274085.log.gz 2024-04-01T00:15:26.604 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.721324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128564.log 2024-04-01T00:15:26.605 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721324.log.gz 2024-04-01T00:15:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154344.log 2024-04-01T00:15:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.128564.log: /var/log/ceph/ceph-client.admin.126351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128564.log.gz 2024-04-01T00:15:26.605 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126351.log.gz 2024-04-01T00:15:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169113.log 2024-04-01T00:15:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220777.log 2024-04-01T00:15:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.169113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169113.log.gz 2024-04-01T00:15:26.605 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.154344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154344.log.gz 2024-04-01T00:15:26.606 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722328.log 2024-04-01T00:15:26.606 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252503.log 2024-04-01T00:15:26.606 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.722328.log: /var/log/ceph/ceph-client.admin.220777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722328.log.gz 2024-04-01T00:15:26.606 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220777.log.gz 2024-04-01T00:15:26.606 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720402.log 2024-04-01T00:15:26.606 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.252503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252503.log.gz 2024-04-01T00:15:26.606 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310372.log 2024-04-01T00:15:26.606 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340496.log 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.310372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310372.log.gz 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.720402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720402.log.gz 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315514.log 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719209.log 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315514.log.gz 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.340496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340496.log.gz 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317307.log 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675042.log 2024-04-01T00:15:26.607 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.317307.log: /var/log/ceph/ceph-client.admin.719209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317307.log.gz 2024-04-01T00:15:26.608 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719209.log.gz 2024-04-01T00:15:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202686.log 2024-04-01T00:15:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728313.log 2024-04-01T00:15:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.202686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202686.log.gz 2024-04-01T00:15:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675042.log.gz 2024-04-01T00:15:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705217.log 2024-04-01T00:15:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.728313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728313.log.gz 2024-04-01T00:15:26.608 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552727.log 2024-04-01T00:15:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279691.log 2024-04-01T00:15:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.552727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552727.log.gz 2024-04-01T00:15:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705217.log.gz 2024-04-01T00:15:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112138.log 2024-04-01T00:15:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248866.log 2024-04-01T00:15:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.112138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112138.log.gz 2024-04-01T00:15:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.279691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279691.log.gz 2024-04-01T00:15:26.609 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586422.log 2024-04-01T00:15:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721854.log 2024-04-01T00:15:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.586422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586422.log.gz 2024-04-01T00:15:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.248866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248866.log.gz 2024-04-01T00:15:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202604.log 2024-04-01T00:15:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.721854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225406.log 2024-04-01T00:15:26.610 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721854.log.gz 2024-04-01T00:15:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728861.log 2024-04-01T00:15:26.610 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.202604.log: /var/log/ceph/ceph-client.admin.225406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225406.log.gz 2024-04-01T00:15:26.611 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202604.log.gz 2024-04-01T00:15:26.611 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845687.log 2024-04-01T00:15:26.611 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.728861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204510.log 2024-04-01T00:15:26.611 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728861.log.gz 2024-04-01T00:15:26.611 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197987.log 2024-04-01T00:15:26.611 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.845687.log: /var/log/ceph/ceph-client.admin.204510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204510.log.gz 2024-04-01T00:15:26.611 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845687.log.gz 2024-04-01T00:15:26.611 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406795.log 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554635.log 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.197987.log: /var/log/ceph/ceph-client.admin.406795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406795.log.gz 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197987.log.gz 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206846.log 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.554635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554635.log.gz 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672165.log 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.206846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302279.log 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206846.log.gz 2024-04-01T00:15:26.612 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247929.log 2024-04-01T00:15:26.613 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.672165.log: /var/log/ceph/ceph-client.admin.302279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302279.log.gz 2024-04-01T00:15:26.613 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672165.log.gz 2024-04-01T00:15:26.613 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176015.log 2024-04-01T00:15:26.613 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129475.log 2024-04-01T00:15:26.613 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.176015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176015.log.gz 2024-04-01T00:15:26.613 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.247929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247929.log.gz 2024-04-01T00:15:26.613 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718430.log 2024-04-01T00:15:26.613 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411177.log 2024-04-01T00:15:26.614 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.129475.log: /var/log/ceph/ceph-client.admin.718430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718430.log.gz 2024-04-01T00:15:26.614 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129475.log.gz 2024-04-01T00:15:26.614 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599603.log 2024-04-01T00:15:26.614 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.411177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195326.log 2024-04-01T00:15:26.614 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411177.log.gz 2024-04-01T00:15:26.614 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.599603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617587.log 2024-04-01T00:15:26.614 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599603.log.gz 2024-04-01T00:15:26.614 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.195326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195326.log.gz 2024-04-01T00:15:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597852.log 2024-04-01T00:15:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384668.log 2024-04-01T00:15:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597852.log.gz 2024-04-01T00:15:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.617587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617587.log.gz 2024-04-01T00:15:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356537.log 2024-04-01T00:15:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229285.log 2024-04-01T00:15:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.356537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356537.log.gz 2024-04-01T00:15:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.384668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384668.log.gz 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242489.log 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110324.log 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242489.log.gz 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.229285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229285.log.gz 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708813.log 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276956.log 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.708813.log: /var/log/ceph/ceph-client.admin.110324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708813.log.gz 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110324.log.gz 2024-04-01T00:15:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555013.log 2024-04-01T00:15:26.617 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331440.log 2024-04-01T00:15:26.617 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276956.log: /var/log/ceph/ceph-client.admin.555013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555013.log.gz 2024-04-01T00:15:26.617 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276956.log.gz 2024-04-01T00:15:26.617 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590396.log 2024-04-01T00:15:26.617 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232160.log 2024-04-01T00:15:26.617 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331440.log: /var/log/ceph/ceph-client.admin.590396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590396.log.gz 2024-04-01T00:15:26.617 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331440.log.gz 2024-04-01T00:15:26.617 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339217.log 2024-04-01T00:15:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.836575.log 2024-04-01T00:15:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.339217.log: /var/log/ceph/ceph-client.admin.232160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339217.log.gz 2024-04-01T00:15:26.618 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232160.log.gz 2024-04-01T00:15:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574435.log 2024-04-01T00:15:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538047.log 2024-04-01T00:15:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.836575.log: /var/log/ceph/ceph-client.admin.574435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574435.log.gz 2024-04-01T00:15:26.618 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.836575.log.gz 2024-04-01T00:15:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841687.log 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174342.log/var/log/ceph/ceph-client.admin.538047.log: 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538047.log.gz 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.841687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255300.log 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841687.log.gz 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385120.log 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.174342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174342.log.gz 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114466.log 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.255300.log: /var/log/ceph/ceph-client.admin.385120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255300.log.gz 2024-04-01T00:15:26.619 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385120.log.gz 2024-04-01T00:15:26.620 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265974.log 2024-04-01T00:15:26.620 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.114466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704943.log 2024-04-01T00:15:26.620 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114466.log.gz 2024-04-01T00:15:26.620 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847080.log 2024-04-01T00:15:26.620 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.265974.log: /var/log/ceph/ceph-client.admin.704943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704943.log.gz 2024-04-01T00:15:26.620 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265974.log.gz 2024-04-01T00:15:26.620 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.840661.log 2024-04-01T00:15:26.620 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285019.log 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.840661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538978.log 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.840661.log.gz 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.847080.log.gz 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47638.log 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285019.log: /var/log/ceph/ceph-client.admin.538978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538978.log.gz 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285019.log.gz 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847739.log 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704256.log 2024-04-01T00:15:26.621 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540373.log 2024-04-01T00:15:26.622 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339681.log 2024-04-01T00:15:26.622 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.704256.log: /var/log/ceph/ceph-client.admin.540373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.540373.log.gz 2024-04-01T00:15:26.622 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704256.log.gz 2024-04-01T00:15:26.622 INFO:teuthology.orchestra.run.smithi120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.847739.log.gz 2024-04-01T00:15:26.622 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726539.log 2024-04-01T00:15:26.622 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.339681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339681.log.gz 2024-04-01T00:15:26.622 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619231.log 2024-04-01T00:15:26.622 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356524.log 2024-04-01T00:15:26.623 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.619231.log: /var/log/ceph/ceph-client.admin.726539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619231.log.gz 2024-04-01T00:15:26.623 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726539.log.gz 2024-04-01T00:15:26.623 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256618.log 2024-04-01T00:15:26.623 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254878.log 2024-04-01T00:15:26.623 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.356524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356524.log.gz 2024-04-01T00:15:26.623 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311931.log 2024-04-01T00:15:26.623 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.254878.log: /var/log/ceph/ceph-client.admin.256618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254878.log.gz 2024-04-01T00:15:26.624 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256618.log.gz 2024-04-01T00:15:26.624 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236355.log 2024-04-01T00:15:26.624 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.311931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833477.log 2024-04-01T00:15:26.624 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311931.log.gz 2024-04-01T00:15:26.624 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152372.log 2024-04-01T00:15:26.624 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.236355.log: /var/log/ceph/ceph-client.admin.833477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833477.log.gz 2024-04-01T00:15:26.624 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236355.log.gz 2024-04-01T00:15:26.624 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553681.log 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47638.log.gz 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202095.log 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.553681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553681.log.gz 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.152372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152372.log.gz 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315074.log 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.202095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250464.log 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202095.log.gz 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176028.log 2024-04-01T00:15:26.625 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.250464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250464.log.gz 2024-04-01T00:15:26.626 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315074.log.gz 2024-04-01T00:15:26.626 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163047.log 2024-04-01T00:15:26.626 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.176028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238163.log 2024-04-01T00:15:26.626 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176028.log.gz 2024-04-01T00:15:26.626 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714479.log 2024-04-01T00:15:26.626 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.238163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238163.log.gz 2024-04-01T00:15:26.626 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.163047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163047.log.gz 2024-04-01T00:15:26.626 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340509.log 2024-04-01T00:15:26.627 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.714479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276001.log 2024-04-01T00:15:26.627 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714479.log.gz 2024-04-01T00:15:26.627 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.340509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722776.log 2024-04-01T00:15:26.627 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340509.log.gz 2024-04-01T00:15:26.627 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144356.log 2024-04-01T00:15:26.627 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276001.log: /var/log/ceph/ceph-client.admin.722776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722776.log.gz 2024-04-01T00:15:26.627 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276001.log.gz 2024-04-01T00:15:26.627 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278272.log 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247916.log 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144356.log.gz 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543186.log 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.278272.log: /var/log/ceph/ceph-client.admin.247916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247916.log.gz 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278272.log.gz 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329063.log 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.543186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610732.log 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.543186.log.gz 2024-04-01T00:15:26.628 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267316.log 2024-04-01T00:15:26.629 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329063.log: /var/log/ceph/ceph-client.admin.610732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610732.log.gz 2024-04-01T00:15:26.629 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329063.log.gz 2024-04-01T00:15:26.629 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281085.log 2024-04-01T00:15:26.629 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.267316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336772.log 2024-04-01T00:15:26.629 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267316.log.gz 2024-04-01T00:15:26.629 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293108.log 2024-04-01T00:15:26.629 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.281085.log: /var/log/ceph/ceph-client.admin.336772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336772.log.gz 2024-04-01T00:15:26.629 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281085.log.gz 2024-04-01T00:15:26.630 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357006.log 2024-04-01T00:15:26.630 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114548.log 2024-04-01T00:15:26.630 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293108.log.gz 2024-04-01T00:15:26.630 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.357006.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.620763.log 2024-04-01T00:15:26.630 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357006.log.gz 2024-04-01T00:15:26.630 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.114548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325156.log 2024-04-01T00:15:26.630 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114548.log.gz 2024-04-01T00:15:26.630 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.620763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347534.log 2024-04-01T00:15:26.631 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620763.log.gz 2024-04-01T00:15:26.631 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.325156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265055.log 2024-04-01T00:15:26.631 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325156.log.gz 2024-04-01T00:15:26.631 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.347534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196365.log 2024-04-01T00:15:26.631 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347534.log.gz 2024-04-01T00:15:26.631 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284732.log 2024-04-01T00:15:26.631 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.265055.log: /var/log/ceph/ceph-client.admin.196365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196365.log.gz 2024-04-01T00:15:26.631 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265055.log.gz 2024-04-01T00:15:26.632 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201712.log 2024-04-01T00:15:26.632 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239395.log 2024-04-01T00:15:26.632 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.201712.log: /var/log/ceph/ceph-client.admin.284732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201712.log.gz 2024-04-01T00:15:26.632 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284732.log.gz 2024-04-01T00:15:26.632 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609825.log 2024-04-01T00:15:26.632 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330436.log 2024-04-01T00:15:26.632 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.609825.log: /var/log/ceph/ceph-client.admin.239395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609825.log.gz 2024-04-01T00:15:26.632 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239395.log.gz 2024-04-01T00:15:26.633 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.839728.log 2024-04-01T00:15:26.633 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720945.log 2024-04-01T00:15:26.633 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.839728.log: /var/log/ceph/ceph-client.admin.330436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.839728.log.gz 2024-04-01T00:15:26.633 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330436.log.gz 2024-04-01T00:15:26.633 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207758.log 2024-04-01T00:15:26.633 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.720945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332371.log 2024-04-01T00:15:26.633 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720945.log.gz 2024-04-01T00:15:26.633 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160815.log 2024-04-01T00:15:26.634 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.207758.log: /var/log/ceph/ceph-client.admin.332371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332371.log.gz 2024-04-01T00:15:26.634 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207758.log.gz 2024-04-01T00:15:26.634 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224927.log 2024-04-01T00:15:26.634 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235205.log 2024-04-01T00:15:26.634 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160815.log.gz 2024-04-01T00:15:26.634 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258905.log 2024-04-01T00:15:26.634 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.224927.log: /var/log/ceph/ceph-client.admin.235205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235205.log.gz 2024-04-01T00:15:26.634 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224927.log.gz 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539456.log 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.258905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157170.log 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258905.log.gz 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574448.log 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.539456.log: /var/log/ceph/ceph-client.admin.157170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157170.log.gz 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539456.log.gz 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689132.log 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.574448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304499.log 2024-04-01T00:15:26.635 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574448.log.gz 2024-04-01T00:15:26.636 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47833.log 2024-04-01T00:15:26.636 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.689132.log: /var/log/ceph/ceph-client.admin.304499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304499.log.gz 2024-04-01T00:15:26.636 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689132.log.gz 2024-04-01T00:15:26.636 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46517.log 2024-04-01T00:15:26.636 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-04-01T00:15:26.636 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.2.46517.log: /var/log/ceph/ceph-client.admin.47833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46517.log.gz 2024-04-01T00:15:26.636 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173977.log 2024-04-01T00:15:26.636 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548702.log 2024-04-01T00:15:26.637 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.173977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173977.log.gz 2024-04-01T00:15:26.637 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669755.log 2024-04-01T00:15:26.637 INFO:teuthology.orchestra.run.smithi120.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47833.log.gz 2024-04-01T00:15:26.637 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726552.log 2024-04-01T00:15:26.637 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.669755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669755.log.gz 2024-04-01T00:15:26.637 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.548702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.548702.log.gz 2024-04-01T00:15:26.637 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233104.log 2024-04-01T00:15:26.637 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46075.log 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.726552.log: /var/log/ceph/ceph-client.admin.233104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233104.log.gz 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726552.log.gz 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238368.log 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258631.log 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.238368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238368.log.gz 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.46075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46075.log.gz 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304061.log 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715564.log 2024-04-01T00:15:26.638 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.258631.log: /var/log/ceph/ceph-client.admin.304061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304061.log.gz 2024-04-01T00:15:26.639 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258631.log.gz 2024-04-01T00:15:26.639 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350088.log 2024-04-01T00:15:26.639 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215622.log 2024-04-01T00:15:26.639 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350088.log.gz 2024-04-01T00:15:26.639 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.715564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715564.log.gz 2024-04-01T00:15:26.639 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217074.log 2024-04-01T00:15:26.639 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412183.log 2024-04-01T00:15:26.639 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.215622.log: /var/log/ceph/ceph-client.admin.217074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217074.log.gz 2024-04-01T00:15:26.640 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215622.log.gz 2024-04-01T00:15:26.780 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308917.log 2024-04-01T00:15:26.780 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293190.log 2024-04-01T00:15:26.780 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.412183.log: /var/log/ceph/ceph-client.admin.308917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704737.log 2024-04-01T00:15:26.780 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412183.log.gz 2024-04-01T00:15:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293190.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293190.log.gz 2024-04-01T00:15:26.781 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.308917.log.gz 2024-04-01T00:15:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.835286.log 2024-04-01T00:15:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355559.log 2024-04-01T00:15:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.704737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704737.log.gz 2024-04-01T00:15:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.835286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280532.log 2024-04-01T00:15:26.781 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.835286.log.gz 2024-04-01T00:15:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279194.log 2024-04-01T00:15:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.280532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280532.log.gz 2024-04-01T00:15:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.355559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355559.log.gz 2024-04-01T00:15:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709771.log 2024-04-01T00:15:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276472.log 2024-04-01T00:15:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.279194.log: /var/log/ceph/ceph-client.admin.709771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709771.log.gz 2024-04-01T00:15:26.782 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279194.log.gz 2024-04-01T00:15:26.782 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267713.log 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725583.log 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276472.log: /var/log/ceph/ceph-client.admin.267713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267713.log.gz 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276472.log.gz 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158447.log 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353737.log 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.158447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158447.log.gz 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.725583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725583.log.gz 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342168.log 2024-04-01T00:15:26.783 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.838454.log 2024-04-01T00:15:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.353737.log: /var/log/ceph/ceph-client.admin.342168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342168.log.gz 2024-04-01T00:15:26.784 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353737.log.gz 2024-04-01T00:15:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126377.log 2024-04-01T00:15:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2024-04-01T00:15:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126377.log.gz 2024-04-01T00:15:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.838454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.838454.log.gz 2024-04-01T00:15:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321057.log 2024-04-01T00:15:26.784 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555287.log 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49171.log: /var/log/ceph/ceph-client.admin.321057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321057.log.gz 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568906.log 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44087.log 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568906.log.gz 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.555287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595378.log 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz/var/log/ceph/ceph-client.admin.44087.log: 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555287.log.gz 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44087.log.gz 2024-04-01T00:15:26.785 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317615.log 2024-04-01T00:15:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192858.log 2024-04-01T00:15:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.595378.log: /var/log/ceph/ceph-client.admin.317615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317615.log.gz 2024-04-01T00:15:26.786 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595378.log.gz 2024-04-01T00:15:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231615.log 2024-04-01T00:15:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.192858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598208.log 2024-04-01T00:15:26.786 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192858.log.gz 2024-04-01T00:15:26.786 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.231615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729305.log 0.0% 2024-04-01T00:15:26.786 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.231615.log.gz 2024-04-01T00:15:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324736.log 2024-04-01T00:15:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.598208.log: /var/log/ceph/ceph-client.admin.729305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729305.log.gz 2024-04-01T00:15:26.787 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598208.log.gz 2024-04-01T00:15:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616259.log 2024-04-01T00:15:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239134.log 2024-04-01T00:15:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.616259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616259.log.gz 2024-04-01T00:15:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.324736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324736.log.gz 2024-04-01T00:15:26.787 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.385133.log 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.239134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239134.log.gz 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393758.log 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.385133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406808.log 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385133.log.gz 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236642.log 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.393758.log: /var/log/ceph/ceph-client.admin.406808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406808.log.gz 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393758.log.gz 2024-04-01T00:15:26.788 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48253.log 2024-04-01T00:15:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142536.log 2024-04-01T00:15:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.236642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236642.log.gz 2024-04-01T00:15:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245560.log 2024-04-01T00:15:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48253.log: /var/log/ceph/ceph-client.admin.142536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142536.log.gz 2024-04-01T00:15:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535201.log 2024-04-01T00:15:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254317.log 2024-04-01T00:15:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.245560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245560.log.gz 2024-04-01T00:15:26.789 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287655.log 2024-04-01T00:15:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.535201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.535201.log.gz 2024-04-01T00:15:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.254317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254317.log.gz 2024-04-01T00:15:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49255.log 2024-04-01T00:15:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845944.log 2024-04-01T00:15:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49255.log: /var/log/ceph/ceph-client.admin.287655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287655.log.gz 2024-04-01T00:15:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224517.log 2024-04-01T00:15:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546897.log 2024-04-01T00:15:26.790 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.845944.log: /var/log/ceph/ceph-client.admin.224517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224517.log.gz 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845944.log.gz 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291681.log 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.546897.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.156848.log 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.546897.log.gz 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.291681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695119.log 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291681.log.gz 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359926.log 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.695119.log: /var/log/ceph/ceph-client.admin.156848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695119.log.gz 2024-04-01T00:15:26.791 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156848.log.gz 2024-04-01T00:15:26.792 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591837.log 2024-04-01T00:15:26.792 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.359926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193514.log 2024-04-01T00:15:26.792 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359926.log.gz 2024-04-01T00:15:26.792 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714782.log 2024-04-01T00:15:26.792 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.591837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46990.log 2024-04-01T00:15:26.792 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.193514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591837.log.gz 2024-04-01T00:15:26.792 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.714782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714782.log.gz 2024-04-01T00:15:26.792 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193514.log.gz 2024-04-01T00:15:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206323.log 2024-04-01T00:15:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293177.log 2024-04-01T00:15:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.206323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206323.log.gz 2024-04-01T00:15:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46990.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48253.log.gz 2024-04-01T00:15:26.793 INFO:teuthology.orchestra.run.smithi120.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49255.log.gz 2024-04-01T00:15:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343374.log 2024-04-01T00:15:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305654.log 2024-04-01T00:15:26.793 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343374.log.gz 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293177.log.gz 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144627.log 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299718.log 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144627.log.gz 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.305654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305654.log.gz 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128990.log 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.299718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299718.log.gz 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613706.log 2024-04-01T00:15:26.794 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254399.log 2024-04-01T00:15:26.795 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.613706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613706.log.gz 2024-04-01T00:15:26.795 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.128990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128990.log.gz 2024-04-01T00:15:26.795 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266794.log 2024-04-01T00:15:26.795 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142175.log 2024-04-01T00:15:26.795 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.254399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254399.log.gz 2024-04-01T00:15:26.795 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.266794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266794.log.gz 2024-04-01T00:15:26.795 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539171.log 2024-04-01T00:15:26.795 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260791.log 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.539171.log: /var/log/ceph/ceph-client.admin.142175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539171.log.gz 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142175.log.gz 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561163.log 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147380.log 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.561163.log: 0.0%/var/log/ceph/ceph-client.admin.260791.log: -- replaced with /var/log/ceph/ceph-client.admin.561163.log.gz 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260791.log.gz 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548633.log 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282066.log 2024-04-01T00:15:26.796 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.548633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.548633.log.gz 2024-04-01T00:15:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147380.log.gz 2024-04-01T00:15:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550857.log 2024-04-01T00:15:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49543.log 2024-04-01T00:15:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.282066.log: /var/log/ceph/ceph-client.admin.550857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.550857.log.gz 2024-04-01T00:15:26.797 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282066.log.gz 2024-04-01T00:15:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224722.log 2024-04-01T00:15:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360200.log 2024-04-01T00:15:26.797 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49543.log: /var/log/ceph/ceph-client.admin.224722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314634.log 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224722.log.gz 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.360200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360200.log.gz 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156658.log 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310577.log 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.314634.log: /var/log/ceph/ceph-client.admin.156658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156658.log.gz 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314634.log.gz 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205031.log 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610249.log 2024-04-01T00:15:26.798 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.310577.log: /var/log/ceph/ceph-client.admin.205031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205031.log.gz 2024-04-01T00:15:26.799 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310577.log.gz 2024-04-01T00:15:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603220.log 2024-04-01T00:15:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.610249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610249.log.gz 2024-04-01T00:15:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176542.log 2024-04-01T00:15:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.603220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241033.log 2024-04-01T00:15:26.799 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603220.log.gz 2024-04-01T00:15:26.799 INFO:teuthology.orchestra.run.smithi120.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46990.log.gz 2024-04-01T00:15:26.799 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.176542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176542.log.gz 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235684.log 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.241033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241033.log.gz 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49543.log.gz 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47158.log 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350730.log 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235684.log: /var/log/ceph/ceph-client.admin.47158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235684.log.gz 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42997.log 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261688.log 2024-04-01T00:15:26.800 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350730.log: /var/log/ceph/ceph-client.admin.42997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350730.log.gz 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338571.log 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.261688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218918.log 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261688.log.gz 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126096.log 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338571.log: /var/log/ceph/ceph-client.admin.218918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218918.log.gz 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338571.log.gz 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151022.log 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338181.log 2024-04-01T00:15:26.801 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126096.log.gz 2024-04-01T00:15:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250751.log 2024-04-01T00:15:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338181.log: /var/log/ceph/ceph-client.admin.151022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338181.log.gz 2024-04-01T00:15:26.802 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151022.log.gz 2024-04-01T00:15:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325954.log 2024-04-01T00:15:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.250751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250751.log.gz 2024-04-01T00:15:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227843.log 2024-04-01T00:15:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572491.log 2024-04-01T00:15:26.802 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.325954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325954.log.gz 2024-04-01T00:15:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285895.log 2024-04-01T00:15:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.572491.log: 0.0%/var/log/ceph/ceph-client.admin.227843.log: -- replaced with /var/log/ceph/ceph-client.admin.572491.log.gz 2024-04-01T00:15:26.803 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227843.log.gz 2024-04-01T00:15:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336404.log 2024-04-01T00:15:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172916.log 2024-04-01T00:15:26.803 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285895.log.gz 2024-04-01T00:15:26.803 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.336404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288408.log 2024-04-01T00:15:26.803 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336404.log.gz 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673296.log 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288408.log.gz 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.172916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172916.log.gz 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261701.log 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350988.log 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.261701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261701.log.gz 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.673296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348623.log 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673296.log.gz 2024-04-01T00:15:26.804 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323352.log 2024-04-01T00:15:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.348623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348623.log.gz 2024-04-01T00:15:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350988.log.gz 2024-04-01T00:15:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215230.log 2024-04-01T00:15:26.805 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47158.log.gz 2024-04-01T00:15:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.323352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323352.log.gz 2024-04-01T00:15:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710716.log 2024-04-01T00:15:26.805 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42997.log.gz 2024-04-01T00:15:26.805 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617204.log 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.215230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292353.log 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215230.log.gz 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710716.log: /var/log/ceph/ceph-client.admin.617204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617204.log.gz 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710716.log.gz 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124670.log 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585985.log 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.124670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124670.log.gz 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.292353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292353.log.gz 2024-04-01T00:15:26.806 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561916.log 2024-04-01T00:15:26.807 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320377.log 2024-04-01T00:15:26.807 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.585985.log: /var/log/ceph/ceph-client.admin.561916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561916.log.gz 2024-04-01T00:15:26.807 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585985.log.gz 2024-04-01T00:15:26.807 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562851.log 2024-04-01T00:15:26.807 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712153.log 2024-04-01T00:15:26.807 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.562851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562851.log.gz 2024-04-01T00:15:26.807 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320377.log.gz 2024-04-01T00:15:26.807 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123785.log 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.712153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340219.log 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712153.log.gz 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844023.log 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.340219.log: /var/log/ceph/ceph-client.admin.123785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340219.log.gz 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123785.log.gz 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145733.log 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.844023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267795.log 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844023.log.gz 2024-04-01T00:15:26.808 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154413.log 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145733.log: /var/log/ceph/ceph-client.admin.267795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267795.log.gz 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145733.log.gz 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392803.log 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148945.log 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.154413.log: /var/log/ceph/ceph-client.admin.392803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392803.log.gz 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154413.log.gz 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359649.log 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714795.log 2024-04-01T00:15:26.809 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148945.log: /var/log/ceph/ceph-client.admin.359649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359649.log.gz 2024-04-01T00:15:26.810 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148945.log.gz 2024-04-01T00:15:26.810 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286853.log 2024-04-01T00:15:26.810 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.714795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234236.log 2024-04-01T00:15:26.810 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714795.log.gz 2024-04-01T00:15:26.810 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309401.log 2024-04-01T00:15:26.810 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.286853.log: /var/log/ceph/ceph-client.admin.234236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234236.log.gz 2024-04-01T00:15:26.810 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286853.log.gz 2024-04-01T00:15:26.810 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147638.log 2024-04-01T00:15:26.811 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322084.log 2024-04-01T00:15:26.811 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309401.log.gz 2024-04-01T00:15:26.811 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671515.log 2024-04-01T00:15:26.811 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.322084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322084.log.gz 2024-04-01T00:15:26.811 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147638.log.gz 2024-04-01T00:15:26.811 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408443.log 2024-04-01T00:15:26.811 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159410.log 2024-04-01T00:15:26.811 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671515.log.gz 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227651.log 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.408443.log: /var/log/ceph/ceph-client.admin.159410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713808.log 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408443.log.gz 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.227651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159410.log.gz 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227651.log.gz 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346043.log 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713808.log.gz 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316616.log 2024-04-01T00:15:26.812 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545921.log 2024-04-01T00:15:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.316616.log: /var/log/ceph/ceph-client.admin.346043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316616.log.gz 2024-04-01T00:15:26.813 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346043.log.gz 2024-04-01T00:15:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548407.log 2024-04-01T00:15:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303065.log 2024-04-01T00:15:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.548407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.548407.log.gz 2024-04-01T00:15:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.545921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.545921.log.gz 2024-04-01T00:15:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266604.log 2024-04-01T00:15:26.813 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352252.log 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.266604.log: /var/log/ceph/ceph-client.admin.303065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266604.log.gz 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303065.log.gz 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560478.log 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325602.log 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.560478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560478.log.gz 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.352252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352252.log.gz 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669785.log 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706451.log 2024-04-01T00:15:26.814 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.325602.log: /var/log/ceph/ceph-client.admin.669785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669785.log.gz 2024-04-01T00:15:26.815 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325602.log.gz 2024-04-01T00:15:26.815 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260229.log 2024-04-01T00:15:26.815 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708060.log 2024-04-01T00:15:26.815 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.260229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260229.log.gz 2024-04-01T00:15:26.815 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.706451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706451.log.gz 2024-04-01T00:15:26.815 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260996.log 2024-04-01T00:15:26.815 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.708060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177227.log 2024-04-01T00:15:26.815 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708060.log.gz 2024-04-01T00:15:26.816 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-04-01T00:15:26.816 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.260996.log: /var/log/ceph/ceph-client.admin.177227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177227.log.gz 2024-04-01T00:15:26.816 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260996.log.gz 2024-04-01T00:15:26.816 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243698.log 2024-04-01T00:15:26.816 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595945.log 2024-04-01T00:15:26.816 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224735.log 2024-04-01T00:15:26.816 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243698.log: /var/log/ceph/ceph-client.admin.595945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595945.log.gz 2024-04-01T00:15:26.816 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243698.log.gz 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563069.log 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.224735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148113.log 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224735.log.gz 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205851.log 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.563069.log: /var/log/ceph/ceph-client.admin.148113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148113.log.gz 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563069.log.gz 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113074.log 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-04-01T00:15:26.817 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.205851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205851.log.gz 2024-04-01T00:15:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561424.log 2024-04-01T00:15:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.113074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193731.log 2024-04-01T00:15:26.818 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113074.log.gz 2024-04-01T00:15:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-01T00:15:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.561424.log: /var/log/ceph/ceph-client.admin.193731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193731.log.gz 2024-04-01T00:15:26.818 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561424.log.gz 2024-04-01T00:15:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568582.log 2024-04-01T00:15:26.818 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590383.log 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557385.log 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568582.log.gz 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.590383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382598.log 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590383.log.gz 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.557385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412114.log 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557385.log.gz 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.382598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730614.log 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382598.log.gz 2024-04-01T00:15:26.819 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.412114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619536.log 2024-04-01T00:15:26.820 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412114.log.gz 2024-04-01T00:15:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.730614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393009.log 2024-04-01T00:15:26.820 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730614.log.gz 2024-04-01T00:15:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.619536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848226.log 2024-04-01T00:15:26.820 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619536.log.gz 2024-04-01T00:15:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.393009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360213.log 2024-04-01T00:15:26.820 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393009.log.gz 2024-04-01T00:15:26.820 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606429.log 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.360213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558259.log 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.848226.log.gz 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360213.log.gz 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.606429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159977.log 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606429.log.gz 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.558259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143438.log 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558259.log.gz 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.159977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284540.log 2024-04-01T00:15:26.821 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159977.log.gz 2024-04-01T00:15:26.822 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2024-04-01T00:15:26.822 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143438.log.gz 2024-04-01T00:15:26.822 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279399.log 2024-04-01T00:15:26.822 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284540.log.gz 2024-04-01T00:15:26.822 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227638.log 2024-04-01T00:15:26.822 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.279399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241982.log 2024-04-01T00:15:26.822 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279399.log.gz 2024-04-01T00:15:26.822 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568818.log 2024-04-01T00:15:26.823 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.227638.log: /var/log/ceph/ceph-client.admin.241982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227638.log.gz 2024-04-01T00:15:26.823 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241982.log.gz 2024-04-01T00:15:26.823 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193813.log 2024-04-01T00:15:26.823 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125202.log 2024-04-01T00:15:26.823 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568818.log.gz 2024-04-01T00:15:26.823 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.193813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320103.log 2024-04-01T00:15:26.823 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193813.log.gz 2024-04-01T00:15:26.823 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306075.log 2024-04-01T00:15:26.824 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.125202.log: /var/log/ceph/ceph-client.admin.320103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125202.log.gz 2024-04-01T00:15:26.824 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320103.log.gz 2024-04-01T00:15:26.824 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706896.log 2024-04-01T00:15:26.824 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.306075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160884.log 2024-04-01T00:15:26.824 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306075.log.gz 2024-04-01T00:15:26.824 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.706896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122540.log 2024-04-01T00:15:26.824 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706896.log.gz 2024-04-01T00:15:26.824 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155301.log 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160884.log.gz 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.122540.log: /var/log/ceph/ceph-client.admin.359662.log 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122540.log.gz 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558272.log 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155301.log.gz 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.359662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569155.log 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359662.log.gz 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.558272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130124.log 2024-04-01T00:15:26.825 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558272.log.gz 2024-04-01T00:15:26.826 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.569155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203891.log 2024-04-01T00:15:26.826 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569155.log.gz 2024-04-01T00:15:26.826 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.130124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143696.log 2024-04-01T00:15:26.826 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130124.log.gz 2024-04-01T00:15:26.826 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.203891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616680.log 2024-04-01T00:15:26.826 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203891.log.gz 2024-04-01T00:15:26.826 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.143696.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45179.log 2024-04-01T00:15:26.826 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143696.log.gz 2024-04-01T00:15:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.616680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713590.log 2024-04-01T00:15:26.827 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616680.log.gz 2024-04-01T00:15:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293415.log 2024-04-01T00:15:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713590.log.gz 2024-04-01T00:15:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269150.log 2024-04-01T00:15:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.293415.log: -- /var/log/ceph/ceph-client.admin.547338.log 2024-04-01T00:15:26.827 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293415.log.gz 2024-04-01T00:15:26.827 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.269150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221663.log 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269150.log.gz 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.834312.log 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.547338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.547338.log.gz 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.221663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274167.log 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221663.log.gz 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.834312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672353.log 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.834312.log.gz 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607076.log 2024-04-01T00:15:26.828 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274167.log.gz 2024-04-01T00:15:26.829 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.672353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609536.log 2024-04-01T00:15:26.829 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672353.log.gz 2024-04-01T00:15:26.829 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.607076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608713.log 2024-04-01T00:15:26.829 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607076.log.gz 2024-04-01T00:15:26.829 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582894.log 2024-04-01T00:15:26.829 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.609536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609536.log.gz 2024-04-01T00:15:26.829 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.608713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321359.log 2024-04-01T00:15:26.829 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608713.log.gz 2024-04-01T00:15:26.830 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.582894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706464.log 2024-04-01T00:15:26.830 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582894.log.gz 2024-04-01T00:15:26.830 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143048.log 2024-04-01T00:15:26.830 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.321359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321359.log.gz 2024-04-01T00:15:26.830 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.706464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611823.log 2024-04-01T00:15:26.830 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706464.log.gz 2024-04-01T00:15:26.830 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568390.log 2024-04-01T00:15:26.830 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143048.log.gz 2024-04-01T00:15:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.611823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193289.log 2024-04-01T00:15:26.831 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611823.log.gz 2024-04-01T00:15:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568390.log.gz 2024-04-01T00:15:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342442.log 2024-04-01T00:15:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.193289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253676.log 2024-04-01T00:15:26.831 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193289.log.gz 2024-04-01T00:15:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.342442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342442.log.gz 2024-04-01T00:15:26.831 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290243.log 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50658.log 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253676.log.gz 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.290243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290243.log.gz 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668607.log 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.50658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241774.log 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50658.log.gz 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225488.log 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.668607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668607.log.gz 2024-04-01T00:15:26.832 INFO:teuthology.orchestra.run.smithi120.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2024-04-01T00:15:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604434.log 2024-04-01T00:15:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.241774.log: /var/log/ceph/ceph-client.admin.225488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225488.log.gz 2024-04-01T00:15:26.833 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241774.log.gz 2024-04-01T00:15:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106839.log 2024-04-01T00:15:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559508.log 2024-04-01T00:15:26.833 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604434.log.gz 2024-04-01T00:15:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.106839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106839.log.gz 2024-04-01T00:15:26.833 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311918.log 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.559508.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45179.log.gz 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.559508.log.gz -5 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.620558.log 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597770.log 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.311918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311918.log.gz 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.620558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227912.log 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620558.log.gz 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270214.log 2024-04-01T00:15:26.834 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597770.log.gz 2024-04-01T00:15:26.835 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.227912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270693.log 2024-04-01T00:15:26.835 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227912.log.gz 2024-04-01T00:15:26.835 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.270214.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.343768.log 2024-04-01T00:15:26.835 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270214.log.gz 2024-04-01T00:15:26.835 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.270693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322368.log 2024-04-01T00:15:26.835 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270693.log.gz 2024-04-01T00:15:26.835 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.834381.log 2024-04-01T00:15:26.835 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343768.log.gz 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110766.log 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.322368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322368.log.gz 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149677.log 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.834381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.834381.log.gz 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.110766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238655.log 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110766.log.gz 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409105.log 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149677.log.gz 2024-04-01T00:15:26.836 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.238655.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.606871.log 2024-04-01T00:15:26.837 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238655.log.gz 2024-04-01T00:15:26.837 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234031.log 2024-04-01T00:15:26.837 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409105.log.gz 2024-04-01T00:15:26.837 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614054.log 2024-04-01T00:15:26.837 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.606871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606871.log.gz 2024-04-01T00:15:26.837 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288875.log 2024-04-01T00:15:26.837 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.234031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234031.log.gz 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.614054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614054.log.gz 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230314.log 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224238.log 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288875.log.gz 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.230314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614328.log 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230314.log.gz 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.224238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546361.log 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224238.log.gz 2024-04-01T00:15:26.838 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.614328.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.614328.log.gz 2024-04-01T00:15:26.839 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.840730.log 2024-04-01T00:15:26.839 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.546361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.546361.log.gz 2024-04-01T00:15:26.839 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844497.log 2024-04-01T00:15:26.839 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.840730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569426.log 2024-04-01T00:15:26.839 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.840730.log.gz 2024-04-01T00:15:26.839 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.844497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844497.log.gz 2024-04-01T00:15:26.839 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843749.log 2024-04-01T00:15:26.839 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.569426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211998.log 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569426.log.gz 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843749.log.gz 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673736.log 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.211998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218457.log 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211998.log.gz 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.673736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537154.log 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673736.log.gz 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.218457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540827.log 2024-04-01T00:15:26.840 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218457.log.gz 2024-04-01T00:15:26.841 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.537154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604905.log 2024-04-01T00:15:26.841 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537154.log.gz 2024-04-01T00:15:26.841 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.540827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333313.log 2024-04-01T00:15:26.841 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.540827.log.gz 2024-04-01T00:15:26.841 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224448.log 2024-04-01T00:15:26.841 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604905.log.gz 2024-04-01T00:15:26.841 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844415.log 2024-04-01T00:15:26.841 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.333313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333313.log.gz 2024-04-01T00:15:26.842 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.224448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241020.log 2024-04-01T00:15:26.842 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224448.log.gz 2024-04-01T00:15:26.842 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.844415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253032.log 2024-04-01T00:15:26.842 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844415.log.gz 2024-04-01T00:15:26.842 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.241020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617656.log 2024-04-01T00:15:26.842 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241020.log.gz 2024-04-01T00:15:26.842 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281774.log 2024-04-01T00:15:26.842 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253032.log.gz 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.617656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617656.log.gz 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708800.log 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.281774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717399.log 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281774.log.gz 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.708800.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.708800.log.gz 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.710921.log 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.717399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598643.log 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717399.log.gz 2024-04-01T00:15:26.843 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710921.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.710921.log.gz 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.234727.log 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.598643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711413.log 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598643.log.gz 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.234727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234727.log.gz 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672435.log 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537613.log 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711413.log.gz 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.672435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711892.log 2024-04-01T00:15:26.844 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672435.log.gz 2024-04-01T00:15:26.845 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.537613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548142.log 2024-04-01T00:15:26.845 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537613.log.gz 2024-04-01T00:15:26.845 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307487.log 2024-04-01T00:15:26.845 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711892.log.gz 2024-04-01T00:15:26.845 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.548142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708539.log 2024-04-01T00:15:26.845 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.548142.log.gz 2024-04-01T00:15:26.845 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.307487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268657.log 2024-04-01T00:15:26.845 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307487.log.gz 2024-04-01T00:15:26.846 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.708539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723139.log 2024-04-01T00:15:26.846 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708539.log.gz 2024-04-01T00:15:26.846 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.268657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117691.log 2024-04-01T00:15:26.846 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268657.log.gz 2024-04-01T00:15:26.846 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.723139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617217.log 2024-04-01T00:15:26.846 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723139.log.gz 2024-04-01T00:15:26.846 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.117691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726067.log 2024-04-01T00:15:26.846 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117691.log.gz 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.617217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617217.log.gz 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548715.log 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.726067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549140.log 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726067.log.gz 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.548715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.548715.log.gz 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148313.log 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.549140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308643.log 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.549140.log.gz 2024-04-01T00:15:26.847 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148313.log.gz 2024-04-01T00:15:26.848 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236424.log 2024-04-01T00:15:26.848 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.308643.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.301593.log 2024-04-01T00:15:26.848 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308643.log.gz 2024-04-01T00:15:26.848 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.236424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236424.log.gz 2024-04-01T00:15:26.848 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334631.log 2024-04-01T00:15:26.848 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.301593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48667.log 2024-04-01T00:15:26.848 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301593.log.gz 2024-04-01T00:15:26.848 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.334631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334631.log.gz 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410718.log 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590314.log 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48667.log: /var/log/ceph/ceph-client.admin.410718.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.410718.log.gz --verbose 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.722694.log 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.590314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163554.log 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590314.log.gz 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.722694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393676.log 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722694.log.gz 2024-04-01T00:15:26.849 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.163554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328994.log 2024-04-01T00:15:26.850 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163554.log.gz 2024-04-01T00:15:26.850 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.393676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303639.log 2024-04-01T00:15:26.850 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393676.log.gz 2024-04-01T00:15:26.850 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.328994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591090.log 2024-04-01T00:15:26.850 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328994.log.gz 2024-04-01T00:15:26.850 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.303639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582208.log 2024-04-01T00:15:26.850 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303639.log.gz 2024-04-01T00:15:26.850 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.591090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591090.log.gzgzip 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.199539.log 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.582208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292846.log 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582208.log.gz 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218388.log 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.199539.log: /var/log/ceph/ceph-client.admin.292846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292846.log.gz 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199539.log.gz 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48667.log.gz 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150121.log 2024-04-01T00:15:26.851 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215704.log 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.218388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218388.log.gz 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.150121.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.150121.log.gz -5 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.110684.log 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.215704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545546.log 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215704.log.gz 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.110684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599084.log 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110684.log.gz 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.545546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176267.log 2024-04-01T00:15:26.852 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.545546.log.gz 2024-04-01T00:15:26.853 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.599084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620750.log 2024-04-01T00:15:26.853 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599084.log.gz 2024-04-01T00:15:26.853 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.176267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612905.log 2024-04-01T00:15:26.853 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176267.log.gz 2024-04-01T00:15:26.853 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.620750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549153.log 2024-04-01T00:15:26.853 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620750.log.gz 2024-04-01T00:15:26.853 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.612905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612905.log.gz 2024-04-01T00:15:26.853 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593507.log 2024-04-01T00:15:26.854 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223472.log 2024-04-01T00:15:26.854 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.549153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.549153.log.gz 2024-04-01T00:15:26.854 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.593507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253471.log 2024-04-01T00:15:26.854 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593507.log.gz 2024-04-01T00:15:26.854 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384196.log 2024-04-01T00:15:26.854 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223472.log.gz 2024-04-01T00:15:26.854 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554566.log 2024-04-01T00:15:26.854 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253471.log.gz 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.384196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195064.log 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384196.log.gz 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.554566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672790.log 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554566.log.gz 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.195064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195064.log.gz 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343580.log 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.672790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235000.log 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672790.log.gz 2024-04-01T00:15:26.855 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343580.log.gz 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270296.log 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549575.log 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235000.log.gz 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.270296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270296.log.gz 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341617.log 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.549575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294548.log 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.549575.log.gz 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584824.log 2024-04-01T00:15:26.856 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341617.log.gz 2024-04-01T00:15:26.857 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.294548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238847.log 2024-04-01T00:15:26.857 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294548.log.gz 2024-04-01T00:15:26.857 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848910.log 2024-04-01T00:15:26.857 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584824.log.gz 2024-04-01T00:15:26.857 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.238847.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.124739.log -- replaced with /var/log/ceph/ceph-client.admin.238847.log.gz 2024-04-01T00:15:26.857 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.857 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601857.log 2024-04-01T00:15:26.857 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.124739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559577.log 2024-04-01T00:15:26.858 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.848910.log.gz 2024-04-01T00:15:26.858 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124739.log.gz 2024-04-01T00:15:26.858 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.601857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151393.log 2024-04-01T00:15:26.858 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601857.log.gz 2024-04-01T00:15:26.858 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.559577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211916.log 2024-04-01T00:15:26.858 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559577.log.gz 2024-04-01T00:15:26.858 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318424.log 2024-04-01T00:15:26.858 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151393.log.gz 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725501.log 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.211916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211916.log.gz 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.318424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194175.log 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318424.log.gz 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.725501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727893.log 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725501.log.gz 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.194175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392816.log 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194175.log.gz 2024-04-01T00:15:26.859 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.727893.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.727893.log.gz 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.244561.log 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.392816.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.175392.log 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.392816.log.gz 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.244561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144884.log 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244561.log.gz 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.175392.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.175392.log.gz /var/log/ceph/ceph-client.admin.711687.log 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561834.log 2024-04-01T00:15:26.860 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144884.log.gz 2024-04-01T00:15:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711687.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.711687.log.gz 2024-04-01T00:15:26.861 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.556393.log 2024-04-01T00:15:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.561834.log: -- /var/log/ceph/ceph-client.admin.338112.log 2024-04-01T00:15:26.861 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561834.log.gz 2024-04-01T00:15:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.556393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706883.log 2024-04-01T00:15:26.861 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556393.log.gz 2024-04-01T00:15:26.861 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550926.log 2024-04-01T00:15:26.861 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338112.log.gz 2024-04-01T00:15:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.706883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362122.log 2024-04-01T00:15:26.862 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706883.log.gz 2024-04-01T00:15:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.550926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144438.log 2024-04-01T00:15:26.862 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.550926.log.gz 2024-04-01T00:15:26.862 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.362122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338194.log 2024-04-01T00:15:26.862 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362122.log.gz 2024-04-01T00:15:26.987 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843954.log 2024-04-01T00:15:26.987 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144438.log.gz 2024-04-01T00:15:26.987 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44434.log 2024-04-01T00:15:26.987 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338194.log.gz 2024-04-01T00:15:26.987 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847552.log 2024-04-01T00:15:26.987 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843954.log.gz 2024-04-01T00:15:26.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146450.log 2024-04-01T00:15:26.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282532.log 2024-04-01T00:15:26.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.838824.log 2024-04-01T00:15:26.988 INFO:teuthology.orchestra.run.smithi120.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.847552.log.gz 2024-04-01T00:15:26.988 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146450.log.gz 2024-04-01T00:15:26.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.282532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848646.log 2024-04-01T00:15:26.988 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282532.log.gz 2024-04-01T00:15:26.988 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.838824.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.838824.log.gz --verbose 2024-04-01T00:15:26.989 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.842069.log 2024-04-01T00:15:26.989 INFO:teuthology.orchestra.run.smithi120.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44434.log.gz 2024-04-01T00:15:26.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712371.log 2024-04-01T00:15:26.989 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.848646.log.gz 2024-04-01T00:15:26.989 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212920.log 2024-04-01T00:15:26.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.842069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842069.log.gz 2024-04-01T00:15:26.989 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.712371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43563.log 2024-04-01T00:15:26.989 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712371.log.gz 2024-04-01T00:15:26.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.212920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319387.log 2024-04-01T00:15:26.990 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212920.log.gz 2024-04-01T00:15:26.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221676.log 2024-04-01T00:15:26.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.319387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256971.log 2024-04-01T00:15:26.990 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319387.log.gz 2024-04-01T00:15:26.990 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.221676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717924.log 2024-04-01T00:15:26.990 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221676.log.gz 2024-04-01T00:15:26.990 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210319.log 2024-04-01T00:15:26.991 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.256971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256971.log.gz 2024-04-01T00:15:26.991 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.717924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717924.log.gz 2024-04-01T00:15:26.991 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540386.log 2024-04-01T00:15:26.991 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315087.log 2024-04-01T00:15:26.991 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210319.log.gz 2024-04-01T00:15:26.991 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.540386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.540386.log.gz 2024-04-01T00:15:26.991 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126857.log 2024-04-01T00:15:26.991 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559137.log 2024-04-01T00:15:26.992 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315087.log.gz 2024-04-01T00:15:26.992 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618591.log 2024-04-01T00:15:26.992 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126857.log.gz 2024-04-01T00:15:26.992 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.559137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49627.log 2024-04-01T00:15:26.992 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559137.log.gz 2024-04-01T00:15:26.992 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.618591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847174.log 2024-04-01T00:15:26.992 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618591.log.gz 2024-04-01T00:15:26.992 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212377.log 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722242.log 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557833.log 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.847174.log.gz 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.212377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212377.log.gz 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.722242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558705.log 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722242.log.gz 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.557833.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43563.log.gz 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.557833.log.gz /var/log/ceph/ceph-client.admin.716049.log 2024-04-01T00:15:26.993 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:26.994 INFO:teuthology.orchestra.run.smithi120.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49627.log.gz 2024-04-01T00:15:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.558705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729318.log 2024-04-01T00:15:26.994 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558705.log.gz 2024-04-01T00:15:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.716049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716049.log.gz 2024-04-01T00:15:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690246.log 2024-04-01T00:15:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.729318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540745.log 2024-04-01T00:15:26.994 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729318.log.gz 2024-04-01T00:15:26.994 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.690246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558190.log 2024-04-01T00:15:26.995 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690246.log.gz 2024-04-01T00:15:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.540745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.540745.log.gz 2024-04-01T00:15:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557751.log 2024-04-01T00:15:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.558190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216544.log 2024-04-01T00:15:26.995 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558190.log.gz 2024-04-01T00:15:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.557751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557751.log.gz 2024-04-01T00:15:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142093.log 2024-04-01T00:15:26.995 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.216544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360665.log 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216544.log.gz 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.142093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142093.log.gz 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274651.log 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.360665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269776.log 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360665.log.gz 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587838.log 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274651.log.gz 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.269776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219310.log 2024-04-01T00:15:26.996 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269776.log.gz 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.587838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338884.log 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587838.log.gz 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.219310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219310.log.gz 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548420.log 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338884.log.gz 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45347.log 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.548420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50654.log 2024-04-01T00:15:26.997 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.548420.log.gz 2024-04-01T00:15:26.998 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229765.log 2024-04-01T00:15:26.998 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2024-04-01T00:15:26.998 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.50654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728600.log 2024-04-01T00:15:26.998 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50654.log.gz 2024-04-01T00:15:26.998 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.admin.229765.log: --verbose -- /var/log/ceph/ceph-client.admin.551775.log 2024-04-01T00:15:26.998 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229765.log.gz 2024-04-01T00:15:26.998 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.728600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698322.log 2024-04-01T00:15:26.998 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728600.log.gz 2024-04-01T00:15:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.551775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324723.log 2024-04-01T00:15:26.999 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551775.log.gz 2024-04-01T00:15:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.698322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234044.log 2024-04-01T00:15:26.999 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698322.log.gz 2024-04-01T00:15:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.324723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145545.log 2024-04-01T00:15:26.999 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324723.log.gz 2024-04-01T00:15:26.999 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.234044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197887.log 2024-04-01T00:15:26.999 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234044.log.gz 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568082.log 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145545.log.gz 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.197887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694453.log 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197887.log.gz 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728792.log 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568082.log.gz 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211455.log 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694453.log.gz 2024-04-01T00:15:27.000 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.728792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716594.log 2024-04-01T00:15:27.001 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728792.log.gz 2024-04-01T00:15:27.001 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.211455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311278.log 2024-04-01T00:15:27.001 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211455.log.gz 2024-04-01T00:15:27.001 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.716594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539158.log 2024-04-01T00:15:27.001 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716594.log.gz 2024-04-01T00:15:27.001 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.311278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342790.log 2024-04-01T00:15:27.001 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311278.log.gz 2024-04-01T00:15:27.001 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.539158.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.290448.log 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539158.log.gz 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.342790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597332.log 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342790.log.gz 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.290448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594669.log 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290448.log.gz 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547256.log 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597332.log: /var/log/ceph/ceph-client.admin.594669.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45347.log.gz 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594669.log.gz 2024-04-01T00:15:27.002 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597332.log.gz 2024-04-01T00:15:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257953.log 2024-04-01T00:15:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349139.log 2024-04-01T00:15:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.547256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.547256.log.gz 2024-04-01T00:15:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549071.log 2024-04-01T00:15:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.257953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257953.log.gz 2024-04-01T00:15:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.349139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394721.log 2024-04-01T00:15:27.003 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349139.log.gz 2024-04-01T00:15:27.003 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.549071.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.549071.log.gz 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.582702.log 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.394721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582138.log 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394721.log.gz 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.582702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582702.log.gz 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600464.log 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.582138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222780.log 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582138.log.gz 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.600464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687198.log 2024-04-01T00:15:27.004 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600464.log.gz 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44171.log 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222780.log.gz 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.687198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316791.log 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687198.log.gz 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117622.log 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.316791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711674.log 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316791.log.gz 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.117622.log: -- /var/log/ceph/ceph-client.admin.705504.log 2024-04-01T00:15:27.005 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117622.log.gz 2024-04-01T00:15:27.006 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711208.log 2024-04-01T00:15:27.006 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711674.log.gz 2024-04-01T00:15:27.006 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351991.log 2024-04-01T00:15:27.006 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705504.log.gz 2024-04-01T00:15:27.006 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702013.log 2024-04-01T00:15:27.006 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711208.log.gz 2024-04-01T00:15:27.006 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.351991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112717.log 2024-04-01T00:15:27.006 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351991.log.gz 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.702013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702013.log.gz 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235671.log 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128921.log 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.112717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112717.log.gz 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44171.log.gz 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.839797.log 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235671.log: /var/log/ceph/ceph-client.admin.128921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128921.log.gz 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235671.log.gz 2024-04-01T00:15:27.007 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328188.log 2024-04-01T00:15:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.839797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284458.log 2024-04-01T00:15:27.008 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.839797.log.gz 2024-04-01T00:15:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.328188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594382.log 2024-04-01T00:15:27.008 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328188.log.gz 2024-04-01T00:15:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561629.log 2024-04-01T00:15:27.008 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284458.log.gz 2024-04-01T00:15:27.008 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.594382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217996.log 2024-04-01T00:15:27.008 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594382.log.gz 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.561629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561629.log.gz 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355052.log 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.217996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143709.log 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217996.log.gz 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.355052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355052.log.gz 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306527.log 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555300.log 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143709.log.gz 2024-04-01T00:15:27.009 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.306527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306527.log.gz 2024-04-01T00:15:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583169.log 2024-04-01T00:15:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620007.log 2024-04-01T00:15:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.555300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555300.log.gz 2024-04-01T00:15:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583169.log.gz 2024-04-01T00:15:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360583.log 2024-04-01T00:15:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.620007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214308.log 2024-04-01T00:15:27.010 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620007.log.gz 2024-04-01T00:15:27.010 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.360583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583853.log 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360583.log.gz 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.214308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588112.log 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214308.log.gz 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250190.log 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583853.log.gz 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.588112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720471.log 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588112.log.gz 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200331.log 2024-04-01T00:15:27.011 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.250190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250190.log.gz 2024-04-01T00:15:27.012 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.admin.720471.log: --verbose -- /var/log/ceph/ceph-client.admin.141290.log 2024-04-01T00:15:27.012 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720471.log.gz 2024-04-01T00:15:27.012 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.200331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251145.log 2024-04-01T00:15:27.012 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200331.log.gz 2024-04-01T00:15:27.012 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.141290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227444.log 2024-04-01T00:15:27.012 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141290.log.gz 2024-04-01T00:15:27.012 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.251145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251145.log.gz 2024-04-01T00:15:27.012 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144425.log 2024-04-01T00:15:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.227444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621036.log 2024-04-01T00:15:27.013 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227444.log.gz 2024-04-01T00:15:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144425.log.gz 2024-04-01T00:15:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122144.log 2024-04-01T00:15:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47749.log 2024-04-01T00:15:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.621036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621036.log.gz 2024-04-01T00:15:27.013 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.122144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122144.log.gzgzip 2024-04-01T00:15:27.013 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.603868.log 2024-04-01T00:15:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350293.log 2024-04-01T00:15:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.603868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724371.log 0.0% 2024-04-01T00:15:27.014 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.603868.log.gz 2024-04-01T00:15:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306514.log 2024-04-01T00:15:27.014 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350293.log.gz 2024-04-01T00:15:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.724371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247466.log 2024-04-01T00:15:27.014 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724371.log.gz 2024-04-01T00:15:27.014 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.306514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.838906.log 2024-04-01T00:15:27.015 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306514.log.gz 2024-04-01T00:15:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.247466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47032.log 2024-04-01T00:15:27.015 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247466.log.gz 2024-04-01T00:15:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.838906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273168.log 2024-04-01T00:15:27.015 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.838906.log.gz 2024-04-01T00:15:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45095.log 2024-04-01T00:15:27.015 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282271.log 2024-04-01T00:15:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.273168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273168.log.gz 2024-04-01T00:15:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607721.log 2024-04-01T00:15:27.016 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47749.log.gz 2024-04-01T00:15:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219840.log 2024-04-01T00:15:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.282271.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45095.log.gz 2024-04-01T00:15:27.016 INFO:teuthology.orchestra.run.smithi120.stderr: 88.3% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47032.log.gz -- replaced with /var/log/ceph/ceph-client.admin.282271.log.gz 2024-04-01T00:15:27.016 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:27.016 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.607721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597401.log 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607721.log.gz 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670438.log 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.219840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219840.log.gz 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315527.log 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597401.log.gz 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671707.log 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.670438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48835.log 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.315527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670438.log.gz 2024-04-01T00:15:27.017 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315527.log.gz 2024-04-01T00:15:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153958.log 2024-04-01T00:15:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671707.log.gz 2024-04-01T00:15:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674403.log 2024-04-01T00:15:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151917.log 2024-04-01T00:15:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.153958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212446.log 2024-04-01T00:15:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.674403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153958.log.gz 2024-04-01T00:15:27.018 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674403.log.gz 2024-04-01T00:15:27.018 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225214.log 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151917.log.gz 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.212446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844036.log 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212446.log.gz 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610180.log 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.225214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688088.log 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225214.log.gz 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.844036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844036.log.gz 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.610180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606789.log 2024-04-01T00:15:27.019 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610180.log.gz 2024-04-01T00:15:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603881.log 2024-04-01T00:15:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688088.log.gz 2024-04-01T00:15:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.606789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325589.log 2024-04-01T00:15:27.020 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606789.log.gz 2024-04-01T00:15:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562586.log 2024-04-01T00:15:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.603881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603881.log.gz 2024-04-01T00:15:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570065.log 2024-04-01T00:15:27.020 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.325589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325589.log.gz 2024-04-01T00:15:27.021 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536553.log 2024-04-01T00:15:27.021 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.562586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562586.log.gz 2024-04-01T00:15:27.021 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272194.log 2024-04-01T00:15:27.021 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.570065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570065.log.gz 2024-04-01T00:15:27.021 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118149.log 2024-04-01T00:15:27.021 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.536553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.536553.log.gz 2024-04-01T00:15:27.021 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331937.log 2024-04-01T00:15:27.021 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.272194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272194.log.gz 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574906.log 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.118149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118149.log.gz 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617858.log 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331937.log.gz 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.574906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722314.log 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574906.log.gz 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48835.log.gz 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.617858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727366.log 2024-04-01T00:15:27.022 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617858.log.gz 2024-04-01T00:15:27.023 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.722314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583374.log 2024-04-01T00:15:27.023 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722314.log.gz 2024-04-01T00:15:27.023 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.727366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727366.log.gz 2024-04-01T00:15:27.023 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409587.log 2024-04-01T00:15:27.023 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199355.log 2024-04-01T00:15:27.023 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583374.log.gz 2024-04-01T00:15:27.023 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124227.log 2024-04-01T00:15:27.023 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409587.log.gz 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279207.log 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.199355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199355.log.gz 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.124227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293621.log 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124227.log.gz 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329542.log 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.279207.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.385346.log 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.279207.log.gz 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293621.log.gz 2024-04-01T00:15:27.024 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843259.log 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329542.log.gz 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.385346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321879.log 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385346.log.gz 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848310.log 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696759.log 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843259.log.gz 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.321879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321879.log.gz 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268000.log 2024-04-01T00:15:27.025 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700367.log 2024-04-01T00:15:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.696759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696759.log.gz 2024-04-01T00:15:27.026 INFO:teuthology.orchestra.run.smithi120.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.848310.log.gz 2024-04-01T00:15:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142162.log 2024-04-01T00:15:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.268000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268000.log.gz 2024-04-01T00:15:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410505.log 2024-04-01T00:15:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.700367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700367.log.gz 2024-04-01T00:15:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562864.log 2024-04-01T00:15:27.026 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.142162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142162.log.gz 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160414.log 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.410505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570527.log 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.562864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410505.log.gz 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562864.log.gz 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600850.log 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.160414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160414.log.gz 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48121.log 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.570527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570527.log.gz 2024-04-01T00:15:27.027 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.600850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269858.log 2024-04-01T00:15:27.028 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600850.log.gz 2024-04-01T00:15:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.832060.log 2024-04-01T00:15:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694845.log 2024-04-01T00:15:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.269858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269858.log.gz 2024-04-01T00:15:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.832060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240349.log 2024-04-01T00:15:27.028 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.832060.log.gz 2024-04-01T00:15:27.028 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847384.log 2024-04-01T00:15:27.028 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694845.log.gz 2024-04-01T00:15:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600919.log 2024-04-01T00:15:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.240349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848184.log 2024-04-01T00:15:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240349.log.gz 2024-04-01T00:15:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.600919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206090.log 2024-04-01T00:15:27.029 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600919.log.gz 2024-04-01T00:15:27.029 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.847384.log.gz 2024-04-01T00:15:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555941.log 2024-04-01T00:15:27.029 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587006.log 2024-04-01T00:15:27.030 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.206090.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.848184.log.gz 2024-04-01T00:15:27.030 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206090.log.gz 2024-04-01T00:15:27.030 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-01T00:15:27.030 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.555941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555941.log.gz 2024-04-01T00:15:27.030 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276677.log 2024-04-01T00:15:27.030 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.587006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587006.log.gz 2024-04-01T00:15:27.030 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588030.log 2024-04-01T00:15:27.030 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234987.log 2024-04-01T00:15:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276677.log.gz 2024-04-01T00:15:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.837561.log 2024-04-01T00:15:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.588030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588030.log.gz 2024-04-01T00:15:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207205.log 2024-04-01T00:15:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.234987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234987.log.gz 2024-04-01T00:15:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233565.log 2024-04-01T00:15:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.837561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.837561.log.gz 2024-04-01T00:15:27.031 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249276.log 2024-04-01T00:15:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.207205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207205.log.gz 2024-04-01T00:15:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345831.log 2024-04-01T00:15:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.233565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233565.log.gz 2024-04-01T00:15:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729682.log 2024-04-01T00:15:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249276.log.gz 2024-04-01T00:15:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725787.log 2024-04-01T00:15:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.345831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345831.log.gz 2024-04-01T00:15:27.032 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309122.log 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.729682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729682.log.gz 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48121.log.gz 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.725787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349623.log 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725787.log.gz 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196895.log 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309122.log.gz 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.349623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50148.log 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349623.log.gz 2024-04-01T00:15:27.033 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.196895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217535.log 2024-04-01T00:15:27.034 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196895.log.gz 2024-04-01T00:15:27.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48295.log 2024-04-01T00:15:27.034 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336417.log 2024-04-01T00:15:27.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.217535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217535.log.gz 2024-04-01T00:15:27.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217005.log 2024-04-01T00:15:27.034 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845673.log 2024-04-01T00:15:27.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.336417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336417.log.gz 2024-04-01T00:15:27.034 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.217005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217005.log.gz 2024-04-01T00:15:27.035 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292558.log 2024-04-01T00:15:27.035 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571124.log 2024-04-01T00:15:27.035 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.845673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845673.log.gz 2024-04-01T00:15:27.035 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.292558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271633.log 2024-04-01T00:15:27.035 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292558.log.gz 2024-04-01T00:15:27.035 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.571124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848992.log 2024-04-01T00:15:27.035 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571124.log.gz 2024-04-01T00:15:27.035 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.271633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350812.log 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271633.log.gz 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49416.log 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350812.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.848992.log.gz 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350812.log.gz -5 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.602669.log 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259364.log 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568595.log 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.259364.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48295.log.gz 2024-04-01T00:15:27.036 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259364.log.gz 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.602669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602669.log.gz 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168251.log 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280614.log 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49416.log.gz 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568595.log: /var/log/ceph/ceph-client.admin.168251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168251.log.gz 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568595.log.gz 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115000.log 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693062.log 2024-04-01T00:15:27.037 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.280614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280614.log.gz 2024-04-01T00:15:27.038 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596455.log 2024-04-01T00:15:27.038 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.115000.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50148.log.gz 2024-04-01T00:15:27.038 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115000.log.gz 2024-04-01T00:15:27.038 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.693062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280601.log 2024-04-01T00:15:27.038 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693062.log.gz 2024-04-01T00:15:27.038 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.596455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561903.log 2024-04-01T00:15:27.038 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596455.log.gz 2024-04-01T00:15:27.038 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.280601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547325.log 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280601.log.gz 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847594.log 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.561903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561903.log.gz 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.547325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604700.log 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.547325.log.gz 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284527.log 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563772.log 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.847594.log.gz 2024-04-01T00:15:27.039 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604700.log.gz 2024-04-01T00:15:27.040 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591755.log 2024-04-01T00:15:27.040 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284527.log: /var/log/ceph/ceph-client.admin.563772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563772.log.gz 2024-04-01T00:15:27.040 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284527.log.gz 2024-04-01T00:15:27.040 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346584.log 2024-04-01T00:15:27.040 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.591755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591755.log.gz 2024-04-01T00:15:27.040 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48625.log 2024-04-01T00:15:27.040 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409874.log 2024-04-01T00:15:27.040 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.346584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346584.log.gz 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572959.log 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254796.log 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409874.log.gz 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222506.log 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.572959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572959.log.gz 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231154.log 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.254796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254796.log.gz 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237281.log 2024-04-01T00:15:27.041 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222506.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.148754.log 2024-04-01T00:15:27.042 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.222506.log.gz 2024-04-01T00:15:27.042 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.231154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231154.log.gz 2024-04-01T00:15:27.042 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.839358.log 2024-04-01T00:15:27.042 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.237281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237281.log.gz 2024-04-01T00:15:27.042 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229354.log 2024-04-01T00:15:27.042 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148754.log.gz 2024-04-01T00:15:27.042 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.839358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197974.log 2024-04-01T00:15:27.042 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.839358.log.gz 2024-04-01T00:15:27.043 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.229354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592189.log 2024-04-01T00:15:27.043 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229354.log.gz 2024-04-01T00:15:27.043 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.197974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726912.log 2024-04-01T00:15:27.043 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197974.log.gz 2024-04-01T00:15:27.043 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.592189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306088.log 2024-04-01T00:15:27.043 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592189.log.gz 2024-04-01T00:15:27.043 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.726912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847697.log 2024-04-01T00:15:27.043 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726912.log.gz 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.306088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167722.log 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306088.log.gz 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215161.log 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.167722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537343.log 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.847697.log.gz 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167722.log.gz 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.215161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220302.log 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215161.log.gz 2024-04-01T00:15:27.044 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.537343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283997.log 2024-04-01T00:15:27.045 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.537343.log.gz 2024-04-01T00:15:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559949.log 2024-04-01T00:15:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.220302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220302.log.gz 2024-04-01T00:15:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358044.log 2024-04-01T00:15:27.045 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283997.log.gz 2024-04-01T00:15:27.045 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.559949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345818.log 2024-04-01T00:15:27.045 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559949.log.gz 2024-04-01T00:15:27.045 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48625.log.gz 2024-04-01T00:15:27.046 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.358044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.836121.log 2024-04-01T00:15:27.046 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358044.log.gz 2024-04-01T00:15:27.046 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.345818.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345818.log.gz -5 2024-04-01T00:15:27.046 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.244164.log 2024-04-01T00:15:27.046 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.836121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.836121.log.gz 2024-04-01T00:15:27.046 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845484.log 2024-04-01T00:15:27.046 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.244164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157638.log 2024-04-01T00:15:27.046 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244164.log.gz 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.845484.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.122609.log -- replaced with /var/log/ceph/ceph-client.admin.845484.log.gz 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169195.log 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157638.log.gz 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.122609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.835738.log 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122609.log.gz 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.169195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381762.log 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169195.log.gz 2024-04-01T00:15:27.047 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.835738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.835738.log.gz 2024-04-01T00:15:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341878.log 2024-04-01T00:15:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.381762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407098.log 2024-04-01T00:15:27.048 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381762.log.gz 2024-04-01T00:15:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339135.log 2024-04-01T00:15:27.048 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341878.log.gz 2024-04-01T00:15:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.407098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326902.log 2024-04-01T00:15:27.048 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407098.log.gz 2024-04-01T00:15:27.048 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224530.log 2024-04-01T00:15:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.339135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339135.log.gz 2024-04-01T00:15:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.326902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46948.log 2024-04-01T00:15:27.049 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326902.log.gz 2024-04-01T00:15:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.224530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560465.log 2024-04-01T00:15:27.049 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224530.log.gz 2024-04-01T00:15:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689608.log 2024-04-01T00:15:27.049 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.560465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116795.log 2024-04-01T00:15:27.049 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560465.log.gz 2024-04-01T00:15:27.050 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.689608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111129.log 2024-04-01T00:15:27.050 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689608.log.gz 2024-04-01T00:15:27.050 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.116795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558692.log 2024-04-01T00:15:27.050 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116795.log.gz 2024-04-01T00:15:27.050 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.111129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382308.log 2024-04-01T00:15:27.050 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111129.log.gz 2024-04-01T00:15:27.050 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.558692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162602.log 2024-04-01T00:15:27.050 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558692.log.gz 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.382308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843047.log 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382308.log.gz 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.162602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704063.log 0.0% 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.162602.log.gz 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113513.log 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46948.log.gz 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843047.log.gz 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.704063.log: /var/log/ceph/ceph-client.admin.547695.log 2024-04-01T00:15:27.051 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704063.log.gz 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.113513.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.113513.log.gz /var/log/ceph/ceph-client.admin.568774.log 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.547695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271154.log 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.547695.log.gz 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717911.log 0.0% 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.568774.log.gz 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.271154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382585.log 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271154.log.gz 2024-04-01T00:15:27.052 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.717911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730696.log 2024-04-01T00:15:27.053 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717911.log.gz 2024-04-01T00:15:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.382585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382585.log.gz 2024-04-01T00:15:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273099.log 2024-04-01T00:15:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.730696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241705.log 2024-04-01T00:15:27.053 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730696.log.gz 2024-04-01T00:15:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.273099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273099.log.gz 2024-04-01T00:15:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583182.log 2024-04-01T00:15:27.053 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5/var/log/ceph/ceph-client.admin.241705.log: --verbose -- /var/log/ceph/ceph-client.admin.587559.log 2024-04-01T00:15:27.054 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241705.log.gz 2024-04-01T00:15:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583182.log.gz 2024-04-01T00:15:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613271.log 2024-04-01T00:15:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.587559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406598.log 2024-04-01T00:15:27.054 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587559.log.gz 2024-04-01T00:15:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.613271.log: gzip -5 --verbose -- /var/log/ceph/xfstests-dev-results/results/check.log 2024-04-01T00:15:27.054 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613271.log.gz 2024-04-01T00:15:27.054 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.406598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225475.log 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406598.log.gz 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283600.log 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.225475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243219.log 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225475.log.gz 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283600.log.gz 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600027.log 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312147.log 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr: 90.0% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2024-04-01T00:15:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243219.log.gz 2024-04-01T00:15:27.056 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.600027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353024.log 2024-04-01T00:15:27.056 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600027.log.gz 2024-04-01T00:15:27.056 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.312147.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.285703.log 2024-04-01T00:15:27.056 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312147.log.gz 2024-04-01T00:15:27.056 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.353024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353024.log.gz 2024-04-01T00:15:27.056 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172480.log 2024-04-01T00:15:27.056 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582689.log 2024-04-01T00:15:27.056 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285703.log.gz 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.172480.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.220764.log 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.172480.log.gz 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.582689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337287.log 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582689.log.gz 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.220764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327686.log 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220764.log.gz 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.337287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43793.log 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337287.log.gz 2024-04-01T00:15:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.327686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848099.log 2024-04-01T00:15:27.058 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327686.log.gz 2024-04-01T00:15:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334549.log 2024-04-01T00:15:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.848099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142618.log 2024-04-01T00:15:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.334549.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.848099.log.gz 2024-04-01T00:15:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344045.log 2024-04-01T00:15:27.058 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334549.log.gz 2024-04-01T00:15:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.142618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142618.log.gz 2024-04-01T00:15:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155742.log 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43793.log.gz 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541005.log 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.344045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344045.log.gz 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43877.log 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155742.log.gz 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.541005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276193.log 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.541005.log.gz 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-04-01T00:15:27.059 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596820.log 2024-04-01T00:15:27.060 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276193.log.gz 2024-04-01T00:15:27.060 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283518.log 2024-04-01T00:15:27.060 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356080.log 2024-04-01T00:15:27.060 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.596820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239874.log 2024-04-01T00:15:27.060 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596820.log.gz 2024-04-01T00:15:27.117 INFO:teuthology.orchestra.run.smithi203.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-01T00:15:27.144 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283518.log.gz 2024-04-01T00:15:27.144 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539374.log 2024-04-01T00:15:27.144 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.356080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356080.log.gz 2024-04-01T00:15:27.145 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620284.log 2024-04-01T00:15:27.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.239874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239874.log.gz 2024-04-01T00:15:27.145 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236629.log 2024-04-01T00:15:27.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.539374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539374.log.gz 2024-04-01T00:15:27.145 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163116.log 2024-04-01T00:15:27.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.620284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620284.log.gz 2024-04-01T00:15:27.145 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687129.log 2024-04-01T00:15:27.145 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.236629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236629.log.gz 2024-04-01T00:15:27.146 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221594.log 2024-04-01T00:15:27.146 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.163116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163116.log.gz 2024-04-01T00:15:27.146 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285964.log 2024-04-01T00:15:27.146 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.687129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687129.log.gz 2024-04-01T00:15:27.146 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43185.log 2024-04-01T00:15:27.146 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.221594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221594.log.gz 2024-04-01T00:15:27.146 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2024-04-01T00:15:27.146 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285964.log.gz 2024-04-01T00:15:27.147 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207934.log 2024-04-01T00:15:27.147 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584140.log 2024-04-01T00:15:27.147 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45473.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.207934.log: /var/log/ceph/ceph-client.admin.554194.log 2024-04-01T00:15:27.147 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207934.log.gz 2024-04-01T00:15:27.147 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573568.log 2024-04-01T00:15:27.147 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584140.log.gz 2024-04-01T00:15:27.147 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271702.log 2024-04-01T00:15:27.147 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.554194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43877.log.gz 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285498.log 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554194.log.gz 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.573568.log: /var/log/ceph/ceph-client.admin.271702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271702.log.gz 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254386.log 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573568.log.gz 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274359.log 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285498.log.gz 2024-04-01T00:15:27.148 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.254386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553478.log 2024-04-01T00:15:27.149 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254386.log.gz 2024-04-01T00:15:27.149 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612446.log 2024-04-01T00:15:27.149 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274359.log.gz 2024-04-01T00:15:27.149 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.553478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175461.log 2024-04-01T00:15:27.149 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553478.log.gz 2024-04-01T00:15:27.149 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.612446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612446.log.gz 2024-04-01T00:15:27.149 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842155.log 2024-04-01T00:15:27.149 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.175461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150052.log 2024-04-01T00:15:27.150 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175461.log.gz 2024-04-01T00:15:27.150 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.842155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674670.log 2024-04-01T00:15:27.150 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842155.log.gz 2024-04-01T00:15:27.150 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.150052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124296.log 2024-04-01T00:15:27.150 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150052.log.gz 2024-04-01T00:15:27.150 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.674670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268739.log 2024-04-01T00:15:27.150 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674670.log.gz 2024-04-01T00:15:27.150 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.124296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595863.log 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124296.log.gz 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.268739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223058.log 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268739.log.gz 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.595863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222109.log 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595863.log.gz 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585098.log 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223058.log.gz 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228805.log 2024-04-01T00:15:27.151 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222109.log.gz 2024-04-01T00:15:27.152 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.585098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593944.log 2024-04-01T00:15:27.152 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585098.log.gz 2024-04-01T00:15:27.152 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.228805.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228805.log.gz -5 2024-04-01T00:15:27.152 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.710442.log 2024-04-01T00:15:27.152 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43185.log.gz 2024-04-01T00:15:27.152 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.593944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286661.log 2024-04-01T00:15:27.152 INFO:teuthology.orchestra.run.smithi120.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-04-01T00:15:27.152 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593944.log.gz 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207947.log 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710442.log.gz 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.286661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196447.log 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286661.log.gz 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.207947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321290.log 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207947.log.gz 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.196447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126285.log 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196447.log.gz 2024-04-01T00:15:27.153 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.321290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730209.log 2024-04-01T00:15:27.154 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321290.log.gz 2024-04-01T00:15:27.154 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145274.log 2024-04-01T00:15:27.154 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126285.log.gz 2024-04-01T00:15:27.154 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286169.log 2024-04-01T00:15:27.154 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.730209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730209.log.gz 2024-04-01T00:15:27.154 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385359.log 2024-04-01T00:15:27.154 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145274.log.gz 2024-04-01T00:15:27.154 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.286169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237363.log 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286169.log.gz 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692098.log 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.385359.log: /var/log/ceph/ceph-client.admin.237363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151475.log 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385359.log.gz 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237363.log.gz 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251706.log 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692098.log.gz 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597414.log 2024-04-01T00:15:27.155 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151475.log.gz 2024-04-01T00:15:27.156 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.251706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350362.log 2024-04-01T00:15:27.156 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251706.log.gz 2024-04-01T00:15:27.156 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.597414.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.597414.log.gz --verbose 2024-04-01T00:15:27.156 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.349418.log 2024-04-01T00:15:27.156 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707376.log 2024-04-01T00:15:27.156 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350362.log.gz 2024-04-01T00:15:27.156 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.349418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290927.log 2024-04-01T00:15:27.156 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349418.log.gz 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690901.log 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707376.log.gz 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.290927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49837.log 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290927.log.gz 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.690901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588099.log 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690901.log.gz 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324285.log 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.588099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272702.log 2024-04-01T00:15:27.157 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588099.log.gz 2024-04-01T00:15:27.158 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.324285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348951.log 2024-04-01T00:15:27.158 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324285.log.gz 2024-04-01T00:15:27.158 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.272702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248400.log 2024-04-01T00:15:27.158 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272702.log.gz 2024-04-01T00:15:27.158 INFO:teuthology.orchestra.run.smithi120.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49837.log.gz 2024-04-01T00:15:27.158 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.348951.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.348951.log.gz 2024-04-01T00:15:27.158 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.671694.log 2024-04-01T00:15:27.158 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169182.log 2024-04-01T00:15:27.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.248400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248400.log.gz 2024-04-01T00:15:27.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128039.log 2024-04-01T00:15:27.159 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671694.log.gz 2024-04-01T00:15:27.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.169182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833860.log 2024-04-01T00:15:27.159 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169182.log.gz 2024-04-01T00:15:27.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.128039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619938.log 2024-04-01T00:15:27.159 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128039.log.gz 2024-04-01T00:15:27.159 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.833860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48499.log 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833860.log.gz 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.619938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619938.log.gz 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206405.log 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570152.log 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.206405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393296.log 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206405.log.gz 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.570152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555579.log 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570152.log.gz 2024-04-01T00:15:27.160 INFO:teuthology.orchestra.run.smithi120.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48499.log.gz 2024-04-01T00:15:27.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.393296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393296.log.gz 2024-04-01T00:15:27.161 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723576.log 2024-04-01T00:15:27.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.555579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229093.log 2024-04-01T00:15:27.161 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555579.log.gz 2024-04-01T00:15:27.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.723576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147843.log 2024-04-01T00:15:27.161 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723576.log.gz 2024-04-01T00:15:27.161 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.229093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2024-04-01T00:15:27.161 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229093.log.gz 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.147843.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.573486.log 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147843.log.gz 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561150.log 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.573486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573486.log.gz 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.561150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706190.log 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561150.log.gz 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220315.log 2024-04-01T00:15:27.162 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.706190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144168.log 2024-04-01T00:15:27.163 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706190.log.gz 2024-04-01T00:15:27.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.220315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175474.log 2024-04-01T00:15:27.163 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220315.log.gz 2024-04-01T00:15:27.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.144168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228887.log 2024-04-01T00:15:27.163 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144168.log.gz 2024-04-01T00:15:27.163 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.175474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175474.log.gz 2024-04-01T00:15:27.163 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229847.log 2024-04-01T00:15:27.163 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.228887.log: /var/log/ceph/ceph-client.admin.714000.log 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228887.log.gz 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz/var/log/ceph/ceph-client.admin.229847.log: 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246569.log 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229847.log.gz 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155314.log 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.714000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714000.log.gz 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540814.log 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.246569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246569.log.gz 2024-04-01T00:15:27.164 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.155314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216083.log 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155314.log.gz 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.540814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557316.log 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.540814.log.gz 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.216083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211076.log 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216083.log.gz 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.557316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704545.log 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557316.log.gz 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.211076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262545.log 2024-04-01T00:15:27.165 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211076.log.gz 2024-04-01T00:15:27.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.704545.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.156199.log 2024-04-01T00:15:27.166 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.704545.log.gz 2024-04-01T00:15:27.166 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710647.log 2024-04-01T00:15:27.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.262545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262545.log.gz 2024-04-01T00:15:27.166 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.156199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284937.log 2024-04-01T00:15:27.166 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156199.log.gz 2024-04-01T00:15:27.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607063.log 2024-04-01T00:15:27.167 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710647.log.gz 2024-04-01T00:15:27.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573926.log 2024-04-01T00:15:27.167 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284937.log.gz 2024-04-01T00:15:27.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.607063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250669.log 2024-04-01T00:15:27.167 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607063.log.gz 2024-04-01T00:15:27.167 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.573926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114535.log 2024-04-01T00:15:27.167 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573926.log.gz 2024-04-01T00:15:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.250669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243685.log 2024-04-01T00:15:27.168 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250669.log.gz 2024-04-01T00:15:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.114535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270488.log 2024-04-01T00:15:27.168 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114535.log.gz 2024-04-01T00:15:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2024-04-01T00:15:27.168 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243685.log.gz 2024-04-01T00:15:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.270488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44769.log 2024-04-01T00:15:27.168 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270488.log.gz 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341258.log 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222027.log 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.341258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115913.log 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341258.log.gz 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.222027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223759.log 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222027.log.gz 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.115913.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115913.log.gz 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.409382.log 2024-04-01T00:15:27.169 INFO:teuthology.orchestra.run.smithi120.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2024-04-01T00:15:27.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719668.log 2024-04-01T00:15:27.170 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223759.log.gz 2024-04-01T00:15:27.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.409382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262627.log 2024-04-01T00:15:27.170 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409382.log.gz 2024-04-01T00:15:27.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.719668.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-01T00:15:27.170 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719668.log.gz 2024-04-01T00:15:27.170 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.262627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156212.log 2024-04-01T00:15:27.170 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262627.log.gz 2024-04-01T00:15:27.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249358.log 2024-04-01T00:15:27.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.156212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232147.log 2024-04-01T00:15:27.171 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156212.log.gz 2024-04-01T00:15:27.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692302.log 2024-04-01T00:15:27.171 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249358.log.gz 2024-04-01T00:15:27.171 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.232147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.835751.log 2024-04-01T00:15:27.171 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232147.log.gz 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247019.log 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692302.log.gz 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.835751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563056.log 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.835751.log.gz 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266332.log 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.247019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247019.log.gz 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146651.log 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.563056.log: /var/log/ceph/ceph-client.admin.266332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266332.log.gz 2024-04-01T00:15:27.172 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563056.log.gz 2024-04-01T00:15:27.173 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2024-04-01T00:15:27.173 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44769.log.gz 2024-04-01T00:15:27.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48079.log 2024-04-01T00:15:27.173 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146651.log.gz 2024-04-01T00:15:27.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393022.log 2024-04-01T00:15:27.173 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354220.log 2024-04-01T00:15:27.173 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48079.log: /var/log/ceph/ceph-client.admin.393022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382859.log 2024-04-01T00:15:27.173 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393022.log.gz 2024-04-01T00:15:27.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.354220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589939.log 2024-04-01T00:15:27.174 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354220.log.gz 2024-04-01T00:15:27.174 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48079.log.gz 2024-04-01T00:15:27.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.382859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607273.log 2024-04-01T00:15:27.174 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382859.log.gz 2024-04-01T00:15:27.174 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216165.log 2024-04-01T00:15:27.174 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.589939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589939.log.gz 2024-04-01T00:15:27.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.607273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211985.log 2024-04-01T00:15:27.175 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607273.log.gz 2024-04-01T00:15:27.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.216165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2024-04-01T00:15:27.175 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216165.log.gz 2024-04-01T00:15:27.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.211985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211985.log.gz 2024-04-01T00:15:27.175 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.834764.log 2024-04-01T00:15:27.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847636.log 2024-04-01T00:15:27.175 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.834764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211537.log 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.834764.log.gz 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560671.log 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.211537.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.847636.log.gz 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424392.log 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211537.log.gz 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.560671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575366.log 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560671.log.gz 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.424392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410303.log 2024-04-01T00:15:27.176 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.424392.log.gz 2024-04-01T00:15:27.177 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2024-04-01T00:15:27.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.575366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575366.log.gz 2024-04-01T00:15:27.177 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2024-04-01T00:15:27.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.410303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611242.log 2024-04-01T00:15:27.177 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410303.log.gz 2024-04-01T00:15:27.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227157.log 2024-04-01T00:15:27.177 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289094.log 2024-04-01T00:15:27.177 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.611242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611242.log.gz 2024-04-01T00:15:27.178 INFO:teuthology.orchestra.run.smithi120.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2024-04-01T00:15:27.178 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.227157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288614.log 2024-04-01T00:15:27.178 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227157.log.gz 2024-04-01T00:15:27.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126652.log 2024-04-01T00:15:27.178 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.289094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289094.log.gz 2024-04-01T00:15:27.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331868.log 2024-04-01T00:15:27.178 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288614.log.gz 2024-04-01T00:15:27.178 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284255.log 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126652.log.gz 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49669.log 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331868.log.gz 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345626.log 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284255.log.gz 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277849.log 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235192.log 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.345626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345626.log.gz 2024-04-01T00:15:27.179 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49669.log.gz 2024-04-01T00:15:27.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.277849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283153.log 2024-04-01T00:15:27.180 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277849.log.gz 2024-04-01T00:15:27.180 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239887.log 2024-04-01T00:15:27.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245076.log 2024-04-01T00:15:27.180 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235192.log.gz 2024-04-01T00:15:27.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283153.log.gz 2024-04-01T00:15:27.180 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555566.log 2024-04-01T00:15:27.180 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.239887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239887.log.gz 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.245076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225885.log 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245076.log.gz 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317533.log 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.555566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538060.log 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555566.log.gz 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.225885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707568.log 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225885.log.gz 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.538060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538060.log.gz 2024-04-01T00:15:27.181 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.317533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317533.log.gz 2024-04-01T00:15:27.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320787.log 2024-04-01T00:15:27.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344662.log 2024-04-01T00:15:27.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707568.log.gz 2024-04-01T00:15:27.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163485.log 2024-04-01T00:15:27.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320787.log.gz 2024-04-01T00:15:27.182 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833408.log 2024-04-01T00:15:27.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.344662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344662.log.gz 2024-04-01T00:15:27.182 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.163485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716581.log 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163485.log.gz 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590860.log 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.833408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833408.log.gz 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330240.log 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.716581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716581.log.gz 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157625.log 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.590860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590860.log.gz 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.330240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284745.log 2024-04-01T00:15:27.183 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330240.log.gz 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362109.log 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157625.log.gz 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584606.log 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284745.log.gz 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587285.log 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.362109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362109.log.gz 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621228.log 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584606.log.gz 2024-04-01T00:15:27.184 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.587285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146463.log 2024-04-01T00:15:27.185 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587285.log.gz 2024-04-01T00:15:27.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.621228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306925.log 2024-04-01T00:15:27.185 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621228.log.gz 2024-04-01T00:15:27.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257406.log 2024-04-01T00:15:27.185 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146463.log.gz 2024-04-01T00:15:27.185 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.306925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191522.log 2024-04-01T00:15:27.185 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306925.log.gz 2024-04-01T00:15:27.185 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236903.log 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.257406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257406.log.gz 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.191522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43519.log 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191522.log.gz 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.236903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602299.log 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236903.log.gz 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201699.log 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.602299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326456.log 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602299.log.gz 2024-04-01T00:15:27.186 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.201699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301580.log 2024-04-01T00:15:27.187 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201699.log.gz 2024-04-01T00:15:27.187 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392734.log 2024-04-01T00:15:27.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.326456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326456.log.gz 2024-04-01T00:15:27.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.301580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226143.log 2024-04-01T00:15:27.187 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301580.log.gz 2024-04-01T00:15:27.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.392734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557398.log 2024-04-01T00:15:27.187 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392734.log.gz 2024-04-01T00:15:27.187 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307474.log 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226143.log.gz 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.557398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330931.log 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557398.log.gz 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.307474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688170.log 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307474.log.gz 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43519.log.gz 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49753.log 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.330931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330931.log.gz 2024-04-01T00:15:27.188 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332440.log 2024-04-01T00:15:27.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688170.log.gz 2024-04-01T00:15:27.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340771.log 2024-04-01T00:15:27.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49753.log: /var/log/ceph/ceph-client.admin.332440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281569.log 2024-04-01T00:15:27.189 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332440.log.gz 2024-04-01T00:15:27.189 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303134.log 2024-04-01T00:15:27.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.340771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340771.log.gz 2024-04-01T00:15:27.189 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.281569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172493.log 2024-04-01T00:15:27.189 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281569.log.gz 2024-04-01T00:15:27.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707363.log 2024-04-01T00:15:27.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.303134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585530.log 2024-04-01T00:15:27.190 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303134.log.gz 2024-04-01T00:15:27.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.172493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172493.log.gz 2024-04-01T00:15:27.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.707363.log: /var/log/ceph/ceph-client.admin.125637.log 2024-04-01T00:15:27.190 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707363.log.gz 2024-04-01T00:15:27.190 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292147.log 2024-04-01T00:15:27.190 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.585530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585530.log.gz 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350799.log 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.125637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125637.log.gz 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279412.log 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.292147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292147.log.gz 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351189.log 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.350799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350799.log.gz 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.279412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242000.log 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279412.log.gz 2024-04-01T00:15:27.191 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.351189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712084.log 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351189.log.gz 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49753.log.gz 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.836205.log 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242000.log.gz 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.712084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713603.log 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712084.log.gz 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.836205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332453.log 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.836205.log.gz 2024-04-01T00:15:27.192 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319829.log 2024-04-01T00:15:27.193 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713603.log.gz 2024-04-01T00:15:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.332453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197330.log 2024-04-01T00:15:27.193 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332453.log.gz 2024-04-01T00:15:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.319829.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.411724.log 2024-04-01T00:15:27.193 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319829.log.gz 2024-04-01T00:15:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.197330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312655.log 2024-04-01T00:15:27.193 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197330.log.gz 2024-04-01T00:15:27.193 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.411724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2024-04-01T00:15:27.194 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411724.log.gz 2024-04-01T00:15:27.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.312655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670078.log 2024-04-01T00:15:27.194 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312655.log.gz 2024-04-01T00:15:27.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587825.log 2024-04-01T00:15:27.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.670078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602230.log 2024-04-01T00:15:27.194 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670078.log.gz 2024-04-01T00:15:27.194 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.587825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325520.log 2024-04-01T00:15:27.194 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587825.log.gz 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.602230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604352.log 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602230.log.gz 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553001.log 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.325520.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325520.log.gz 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148958.log 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604352.log.gz 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.553001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150498.log 2024-04-01T00:15:27.195 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553001.log.gz 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833942.log 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148958.log.gz 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.150498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567884.log 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150498.log.gz 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.833942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352734.log 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833942.log.gz 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.567884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191962.log 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567884.log.gz 2024-04-01T00:15:27.196 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.352734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599521.log 2024-04-01T00:15:27.197 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352734.log.gz 2024-04-01T00:15:27.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.191962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411642.log 2024-04-01T00:15:27.197 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191962.log.gz 2024-04-01T00:15:27.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.599521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152589.log 2024-04-01T00:15:27.197 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599521.log.gz 2024-04-01T00:15:27.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.411642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539927.log 2024-04-01T00:15:27.197 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411642.log.gz 2024-04-01T00:15:27.197 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.152589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158969.log 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152589.log.gz 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.539927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575082.log 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539927.log.gz 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.158969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303147.log 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158969.log.gz 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.575082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671227.log 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575082.log.gz 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.303147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238642.log 2024-04-01T00:15:27.198 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303147.log.gz 2024-04-01T00:15:27.199 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846954.log 2024-04-01T00:15:27.199 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671227.log.gz 2024-04-01T00:15:27.199 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.238642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45053.log 2024-04-01T00:15:27.199 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238642.log.gz 2024-04-01T00:15:27.199 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.846954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293386.log 2024-04-01T00:15:27.199 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335495.log 2024-04-01T00:15:27.199 INFO:teuthology.orchestra.run.smithi120.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.846954.log.gz 2024-04-01T00:15:27.199 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163567.log 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293386.log.gz 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583661.log 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.335495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335495.log.gz 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.163567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158887.log 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163567.log.gz 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210295.log 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583661.log.gz 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252950.log 2024-04-01T00:15:27.200 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.158887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158887.log.gz 2024-04-01T00:15:27.201 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331649.log 2024-04-01T00:15:27.201 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210295.log.gz 2024-04-01T00:15:27.270 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.252950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.840180.log 2024-04-01T00:15:27.270 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252950.log.gz 2024-04-01T00:15:27.270 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331649.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45053.log.gz 2024-04-01T00:15:27.270 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145815.log 2024-04-01T00:15:27.271 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331649.log.gz 2024-04-01T00:15:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.840180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276969.log 2024-04-01T00:15:27.271 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.840180.log.gz 2024-04-01T00:15:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.145815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845497.log 2024-04-01T00:15:27.271 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145815.log.gz 2024-04-01T00:15:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276969.log.gz 2024-04-01T00:15:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583648.log 2024-04-01T00:15:27.271 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.845497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545030.log 2024-04-01T00:15:27.272 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845497.log.gz 2024-04-01T00:15:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583648.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.583648.log.gz 2024-04-01T00:15:27.272 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.191975.log 2024-04-01T00:15:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.545030.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.572972.log 2024-04-01T00:15:27.272 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.545030.log.gz 2024-04-01T00:15:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.191975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191975.log.gz 2024-04-01T00:15:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200262.log 2024-04-01T00:15:27.272 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.572972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310085.log 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572972.log.gz 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.200262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129393.log 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200262.log.gz 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.310085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572065.log 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310085.log.gz 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.129393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177158.log 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129393.log.gz 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.572065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556023.log 2024-04-01T00:15:27.273 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572065.log.gz 2024-04-01T00:15:27.274 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.177158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163757.log 2024-04-01T00:15:27.274 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177158.log.gz 2024-04-01T00:15:27.274 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.556023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845875.log 2024-04-01T00:15:27.274 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556023.log.gz 2024-04-01T00:15:27.274 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.163757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311722.log 2024-04-01T00:15:27.274 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163757.log.gz 2024-04-01T00:15:27.274 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.845875.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-01T00:15:27.274 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845875.log.gz 2024-04-01T00:15:27.275 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.311722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394203.log 2024-04-01T00:15:27.275 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311722.log.gz 2024-04-01T00:15:27.275 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310359.log 2024-04-01T00:15:27.275 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.394203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209560.log 2024-04-01T00:15:27.275 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394203.log.gz 2024-04-01T00:15:27.275 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.310359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709484.log 2024-04-01T00:15:27.275 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310359.log.gz 2024-04-01T00:15:27.275 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.209560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273875.log 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209560.log.gz 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206833.log 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709484.log.gz 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.273875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235466.log 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273875.log.gz 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669116.log/var/log/ceph/ceph-client.admin.206833.log: 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206833.log.gz 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207275.log 2024-04-01T00:15:27.276 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235466.log.gz 2024-04-01T00:15:27.277 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.669116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309606.log 2024-04-01T00:15:27.277 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669116.log.gz 2024-04-01T00:15:27.277 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.207275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671502.log 2024-04-01T00:15:27.277 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207275.log.gz 2024-04-01T00:15:27.277 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351978.log 2024-04-01T00:15:27.277 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309606.log.gz 2024-04-01T00:15:27.277 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.671502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43351.log 2024-04-01T00:15:27.277 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671502.log.gz 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356067.log 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.351978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351978.log.gz 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349336.log 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.356067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259282.log 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356067.log.gz 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.349336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243411.log 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349336.log.gz 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.259282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320869.log 2024-04-01T00:15:27.278 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259282.log.gz 2024-04-01T00:15:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290461.log 2024-04-01T00:15:27.279 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243411.log.gz 2024-04-01T00:15:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568685.log 2024-04-01T00:15:27.279 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320869.log.gz 2024-04-01T00:15:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570596.log 2024-04-01T00:15:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.290461.log: /var/log/ceph/ceph-client.admin.568685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568685.log.gz 2024-04-01T00:15:27.279 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290461.log.gz 2024-04-01T00:15:27.279 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326469.log 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146921.log/var/log/ceph/ceph-client.admin.570596.log: 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846321.log 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.570596.log.gz 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43351.log.gz 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.326469.log: /var/log/ceph/ceph-client.admin.146921.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146921.log.gz 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.846321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326469.log.gz 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr: -- /var/log/ceph/ceph-client.admin.407971.log 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846321.log.gz 2024-04-01T00:15:27.280 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608631.log 2024-04-01T00:15:27.281 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.407971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253950.log 2024-04-01T00:15:27.281 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407971.log.gz 2024-04-01T00:15:27.281 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.608631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724105.log 2024-04-01T00:15:27.281 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608631.log.gz 2024-04-01T00:15:27.281 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407531.log 2024-04-01T00:15:27.281 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.253950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253950.log.gz 2024-04-01T00:15:27.281 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.724105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594464.log 2024-04-01T00:15:27.281 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724105.log.gz 2024-04-01T00:15:27.282 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201630.log 2024-04-01T00:15:27.282 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.407531.log: /var/log/ceph/ceph-client.admin.594464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594464.log.gz 2024-04-01T00:15:27.282 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407531.log.gz 2024-04-01T00:15:27.282 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196908.log 2024-04-01T00:15:27.282 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.201630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201630.log.gz 2024-04-01T00:15:27.282 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126298.log 2024-04-01T00:15:27.282 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349815.log 2024-04-01T00:15:27.282 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.196908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196908.log.gz 2024-04-01T00:15:27.283 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708334.log 2024-04-01T00:15:27.283 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126298.log.gz 2024-04-01T00:15:27.283 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246487.log 2024-04-01T00:15:27.283 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.349815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349815.log.gz 2024-04-01T00:15:27.283 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539914.log 2024-04-01T00:15:27.283 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.708334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708334.log.gz 2024-04-01T00:15:27.283 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318937.log 2024-04-01T00:15:27.283 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.246487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246487.log.gz 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603607.log 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.539914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539914.log.gz 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.318937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617669.log 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318937.log.gz 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48709.log: /var/log/ceph/ceph-client.admin.603607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603607.log.gz 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248387.log 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225009.log 2024-04-01T00:15:27.284 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.617669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617669.log.gz 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302266.log 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.248387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248387.log.gz 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126930.log 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.225009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225009.log.gz 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302266.log.gz 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343361.log 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126930.log.gz 2024-04-01T00:15:27.285 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594930.log 2024-04-01T00:15:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343361.log: /var/log/ceph/ceph-osd.2.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343361.log.gz 2024-04-01T00:15:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2024-04-01T00:15:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.594930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721785.log 2024-04-01T00:15:27.286 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594930.log.gz 2024-04-01T00:15:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335426.log 2024-04-01T00:15:27.286 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.721785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247846.log 2024-04-01T00:15:27.286 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2024-04-01T00:15:27.286 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721785.log.gz 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.335426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269219.log 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335426.log.gz 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323053.log 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.247846.log: /var/log/ceph/ceph-client.admin.269219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269219.log.gz 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307200.log 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247846.log.gz 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.323053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303992.log 2024-04-01T00:15:27.287 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323053.log.gz 2024-04-01T00:15:27.288 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.307200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308656.log 2024-04-01T00:15:27.288 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307200.log.gz 2024-04-01T00:15:27.288 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.303992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242695.log 2024-04-01T00:15:27.288 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303992.log.gz 2024-04-01T00:15:27.288 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.308656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281303.log 2024-04-01T00:15:27.288 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308656.log.gz 2024-04-01T00:15:27.288 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223951.log 2024-04-01T00:15:27.288 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242695.log.gz 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.281303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358637.log 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281303.log.gz 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333244.log 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223951.log.gz 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.358637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729236.log 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358637.log.gz 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.333244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242777.log 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333244.log.gz 2024-04-01T00:15:27.289 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.729236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149228.log 2024-04-01T00:15:27.290 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729236.log.gz 2024-04-01T00:15:27.290 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320595.log 2024-04-01T00:15:27.290 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242777.log.gz 2024-04-01T00:15:27.290 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586924.log 2024-04-01T00:15:27.290 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149228.log.gz 2024-04-01T00:15:27.290 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.320595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694928.log 2024-04-01T00:15:27.290 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320595.log.gz 2024-04-01T00:15:27.290 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.586924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693995.log 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586924.log.gz 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588305.log 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694928.log.gz 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.693995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328621.log 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693995.log.gz 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.588305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110242.log 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588305.log.gz 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.328621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695794.log 2024-04-01T00:15:27.291 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328621.log.gz 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.110242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157998.log 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110242.log.gz 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.695794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276690.log 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695794.log.gz 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.157998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116347.log 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157998.log.gz 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276690.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276690.log.gz 2024-04-01T00:15:27.292 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.116347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844937.log 2024-04-01T00:15:27.293 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116347.log.gz 2024-04-01T00:15:27.293 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310564.log 2024-04-01T00:15:27.293 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.844937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592630.log 2024-04-01T00:15:27.293 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844937.log.gz 2024-04-01T00:15:27.293 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.310564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619467.log 2024-04-01T00:15:27.293 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310564.log.gz 2024-04-01T00:15:27.293 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.592630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205864.log 0.0% 2024-04-01T00:15:27.293 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.592630.log.gz 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.619467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288601.log 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619467.log.gz 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.205864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280806.log 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205864.log.gz 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240267.log 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288601.log.gz 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.280806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43089.log 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280806.log.gz 2024-04-01T00:15:27.294 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.240267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691177.log 2024-04-01T00:15:27.295 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240267.log.gz 2024-04-01T00:15:27.295 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.691177.log: /var/log/ceph/ceph-client.admin.563703.log/var/log/ceph/ceph-client.admin.43089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691177.log.gz 2024-04-01T00:15:27.295 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:27.295 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540116.log 2024-04-01T00:15:27.295 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.563703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563703.log.gz 2024-04-01T00:15:27.295 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251214.log 2024-04-01T00:15:27.295 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543168.log 2024-04-01T00:15:27.295 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.540116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.540116.log.gz 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258426.log 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.251214.log: /var/log/ceph/ceph-client.admin.543168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.543168.log.gz 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251214.log.gz 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707101.log 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552320.log 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.258426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258426.log.gz 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348431.log 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707101.log: /var/log/ceph/ceph-client.admin.552320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552320.log.gz 2024-04-01T00:15:27.296 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707101.log.gz 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551857.log 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335059.log 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.348431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348431.log.gz 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847258.log 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.551857.log: /var/log/ceph/ceph-client.admin.335059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335059.log.gz 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551857.log.gz 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351001.log 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347996.log 2024-04-01T00:15:27.297 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.847258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47116.log 2024-04-01T00:15:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.351001.log: /var/log/ceph/ceph-client.admin.347996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347996.log.gz 2024-04-01T00:15:27.298 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351001.log.gz 2024-04-01T00:15:27.298 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.847258.log.gz 2024-04-01T00:15:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340784.log 2024-04-01T00:15:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292833.log 2024-04-01T00:15:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47116.log: /var/log/ceph/ceph-client.admin.340784.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.340784.log.gz -- 2024-04-01T00:15:27.298 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.207676.log 2024-04-01T00:15:27.298 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153889.log 2024-04-01T00:15:27.299 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.292833.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267508.log 2024-04-01T00:15:27.299 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.292833.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47116.log.gz 2024-04-01T00:15:27.299 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:15:27.299 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.207676.log: /var/log/ceph/ceph-client.admin.153889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153889.log.gz 2024-04-01T00:15:27.299 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207676.log.gz 2024-04-01T00:15:27.299 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50190.log 2024-04-01T00:15:27.299 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.267508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286935.log 2024-04-01T00:15:27.299 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267508.log.gz 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246023.log 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.286935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195339.log 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286935.log.gz 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.246023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345179.log 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246023.log.gz 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.195339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251693.log 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195339.log.gz 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.345179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308930.log 2024-04-01T00:15:27.300 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345179.log.gz 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.251693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129941.log 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251693.log.gz 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383752.log 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.308930.log: /var/log/ceph/ceph-client.admin.129941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308930.log.gz 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129941.log.gz 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152385.log 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.383752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383752.log.gz 2024-04-01T00:15:27.301 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175017.log 2024-04-01T00:15:27.302 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.152385.log: /var/log/ceph/ceph-client.admin.46213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152385.log.gz 2024-04-01T00:15:27.302 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49087.log 2024-04-01T00:15:27.302 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.175017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318061.log 2024-04-01T00:15:27.302 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175017.log.gz 2024-04-01T00:15:27.302 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543204.log 2024-04-01T00:15:27.302 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49087.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43089.log.gz 2024-04-01T00:15:27.302 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.318061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709292.log 2024-04-01T00:15:27.302 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318061.log.gz 2024-04-01T00:15:27.303 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.543204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270283.log 2024-04-01T00:15:27.303 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.543204.log.gz 2024-04-01T00:15:27.303 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316534.log 2024-04-01T00:15:27.303 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709292.log.gz 2024-04-01T00:15:27.303 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712850.log 2024-04-01T00:15:27.303 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.270283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270283.log.gz 2024-04-01T00:15:27.303 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229080.log 2024-04-01T00:15:27.303 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.316534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271428.log 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316534.log.gz 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.712850.log: /var/log/ceph/ceph-client.admin.229080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229080.log.gz 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712850.log.gz 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688944.log 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.271428.log: /var/log/ceph/ceph-client.admin.317979.log 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49087.log.gz 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271428.log.gz 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688944.log.gz 2024-04-01T00:15:27.304 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249755.log 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275919.log 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.317979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715775.log 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317979.log.gz/var/log/ceph/ceph-client.admin.275919.log: 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275919.log.gz 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270951.log 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249755.log.gz 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142979.log 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.270951.log: 0.0%/var/log/ceph/ceph-client.admin.715775.log: -- replaced with /var/log/ceph/ceph-client.admin.270951.log.gz 2024-04-01T00:15:27.305 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715775.log.gz 2024-04-01T00:15:27.306 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227362.log 2024-04-01T00:15:27.306 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217466.log 2024-04-01T00:15:27.306 INFO:teuthology.orchestra.run.smithi120.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-04-01T00:15:27.306 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.142979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142979.log.gz 2024-04-01T00:15:27.306 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348361.log 2024-04-01T00:15:27.306 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.227362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227362.log.gz 2024-04-01T00:15:27.306 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289735.log 2024-04-01T00:15:27.306 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.217466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217466.log.gz 2024-04-01T00:15:27.307 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555095.log 2024-04-01T00:15:27.307 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.348361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348361.log.gz 2024-04-01T00:15:27.307 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593576.log 2024-04-01T00:15:27.307 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.289735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289735.log.gz 2024-04-01T00:15:27.307 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282545.log 2024-04-01T00:15:27.307 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.555095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555095.log.gz 2024-04-01T00:15:27.307 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551368.log 2024-04-01T00:15:27.307 INFO:teuthology.orchestra.run.smithi120.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50190.log.gz 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.593576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593576.log.gz 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.282545.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282545.log.gz 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.709210.log 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.551368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353298.log 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551368.log.gz 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.709210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243890.log 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709210.log.gz 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.353298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283805.log 2024-04-01T00:15:27.308 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353298.log.gz 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724384.log 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243890.log.gz 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304430.log 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283805.log.gz 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122622.log 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.724384.log: /var/log/ceph/ceph-client.admin.304430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304430.log.gz 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724384.log.gz 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712837.log 2024-04-01T00:15:27.309 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.122622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614969.log 2024-04-01T00:15:27.310 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122622.log.gz 2024-04-01T00:15:27.310 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.712837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584619.log 2024-04-01T00:15:27.310 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712837.log.gz 2024-04-01T00:15:27.310 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.614969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550939.log 2024-04-01T00:15:27.310 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614969.log.gz 2024-04-01T00:15:27.310 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285006.log 2024-04-01T00:15:27.310 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584619.log.gz 2024-04-01T00:15:27.310 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599166.log 2024-04-01T00:15:27.311 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.550939.log: /var/log/ceph/ceph-client.admin.285006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.550939.log.gz 2024-04-01T00:15:27.311 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285006.log.gz 2024-04-01T00:15:27.311 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691827.log 2024-04-01T00:15:27.311 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.599166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346515.log 2024-04-01T00:15:27.311 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599166.log.gz 2024-04-01T00:15:27.311 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329473.log 2024-04-01T00:15:27.311 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.691827.log: /var/log/ceph/ceph-client.admin.346515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691827.log.gz 2024-04-01T00:15:27.311 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346515.log.gz 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604160.log 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716952.log 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329473.log.gz 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49881.log 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604160.log.gz 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.716952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712645.log 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716952.log.gz 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556926.log 2024-04-01T00:15:27.312 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49881.log: /var/log/ceph/ceph-client.admin.712645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712645.log.gz 2024-04-01T00:15:27.313 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384681.log 2024-04-01T00:15:27.313 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.556926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301986.log 2024-04-01T00:15:27.313 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556926.log.gz 2024-04-01T00:15:27.313 INFO:teuthology.orchestra.run.smithi120.stderr: 89.0% -- replaced with /var/log/ceph/ceph.log.gzgzip 2024-04-01T00:15:27.313 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.674683.log 2024-04-01T00:15:27.313 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.384681.log: /var/log/ceph/ceph-client.admin.301986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301986.log.gz 2024-04-01T00:15:27.313 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384681.log.gz 2024-04-01T00:15:27.313 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573995.log 2024-04-01T00:15:27.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.674683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323544.log 2024-04-01T00:15:27.369 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674683.log.gz 2024-04-01T00:15:27.369 INFO:teuthology.orchestra.run.smithi120.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49881.log.gz 2024-04-01T00:15:27.369 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338906.log 2024-04-01T00:15:27.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.573995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573995.log.gz 2024-04-01T00:15:27.369 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.323544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218931.log 2024-04-01T00:15:27.370 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323544.log.gz 2024-04-01T00:15:27.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338906.log.gz 2024-04-01T00:15:27.370 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729764.log 2024-04-01T00:15:27.370 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192328.log 2024-04-01T00:15:27.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.218931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218931.log.gz 2024-04-01T00:15:27.370 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.729764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716512.log 2024-04-01T00:15:27.370 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729764.log.gz 2024-04-01T00:15:27.370 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601351.log 2024-04-01T00:15:27.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.192328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282053.log 2024-04-01T00:15:27.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.716512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192328.log.gz 2024-04-01T00:15:27.371 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716512.log.gz 2024-04-01T00:15:27.371 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714548.log 2024-04-01T00:15:27.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.601351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601351.log.gz 2024-04-01T00:15:27.371 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.839810.log 2024-04-01T00:15:27.371 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.282053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282053.log.gz 2024-04-01T00:15:27.371 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715788.log 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.714548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714548.log.gz 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545112.log 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.839810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572052.log 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.715788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.839810.log.gz 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715788.log.gz 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.545112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167282.log 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.545112.log.gz 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.572052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323750.log 2024-04-01T00:15:27.372 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572052.log.gz 2024-04-01T00:15:27.373 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694915.log 2024-04-01T00:15:27.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.167282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167282.log.gz 2024-04-01T00:15:27.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.323750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283587.log 2024-04-01T00:15:27.373 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323750.log.gz 2024-04-01T00:15:27.373 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259797.log 2024-04-01T00:15:27.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694915.log.gz 2024-04-01T00:15:27.373 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351701.log 2024-04-01T00:15:27.373 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.283587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283587.log.gz 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.259797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337733.log 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259797.log.gz 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.351701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559068.log 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351701.log.gz 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.337733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337733.log.gz 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208358.log 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.559068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571525.log 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559068.log.gz 2024-04-01T00:15:27.374 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.208358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614259.log 2024-04-01T00:15:27.375 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208358.log.gz 2024-04-01T00:15:27.375 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542857.log 2024-04-01T00:15:27.375 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.571525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571525.log.gz 2024-04-01T00:15:27.375 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.614259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147178.log 2024-04-01T00:15:27.375 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614259.log.gz 2024-04-01T00:15:27.375 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.542857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608232.log 2024-04-01T00:15:27.375 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.542857.log.gz 2024-04-01T00:15:27.375 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195972.log 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147178.log.gz 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.608232.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.347074.log 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.608232.log.gz 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.195972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45221.log 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195972.log.gz 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.347074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332891.log 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347074.log.gz 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291612.log 2024-04-01T00:15:27.376 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.332891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289286.log 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332891.log.gz 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45221.log.gz 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.291612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545990.log 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291612.log.gz 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.289286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118597.log 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289286.log.gz 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.545990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.545990.log.gz 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218009.log 2024-04-01T00:15:27.377 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.118597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125133.log 2024-04-01T00:15:27.378 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118597.log.gz 2024-04-01T00:15:27.378 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.218009.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.122075.log 2024-04-01T00:15:27.378 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218009.log.gz 2024-04-01T00:15:27.378 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833929.log 2024-04-01T00:15:27.378 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.122075.log: 0.0%/var/log/ceph/ceph-client.admin.125133.log: -- replaced with /var/log/ceph/ceph-client.admin.122075.log.gz 2024-04-01T00:15:27.378 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125133.log.gz 2024-04-01T00:15:27.378 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609812.log 2024-04-01T00:15:27.378 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.833929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255313.log 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833929.log.gz 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.609812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594943.log 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609812.log.gz 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707088.log 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.255313.log: /var/log/ceph/ceph-client.admin.594943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594943.log.gz 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255313.log.gz 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619048.log 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.707088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154788.log 2024-04-01T00:15:27.379 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707088.log.gz 2024-04-01T00:15:27.380 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610526.log 2024-04-01T00:15:27.380 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.154788.log: /var/log/ceph/ceph-client.admin.619048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154788.log.gz 2024-04-01T00:15:27.380 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619048.log.gz 2024-04-01T00:15:27.380 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557820.log 2024-04-01T00:15:27.380 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523485.log 2024-04-01T00:15:27.380 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.610526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610526.log.gz 2024-04-01T00:15:27.380 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37578.log 2024-04-01T00:15:27.380 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.557820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557820.log.gz 2024-04-01T00:15:27.381 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620297.log 2024-04-01T00:15:27.381 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.523485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673749.log 2024-04-01T00:15:27.381 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.523485.log.gz 2024-04-01T00:15:27.381 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.37578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293703.log 2024-04-01T00:15:27.381 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.620297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620297.log.gz 2024-04-01T00:15:27.381 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695413.log 2024-04-01T00:15:27.381 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.673749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673749.log.gz 2024-04-01T00:15:27.381 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.293703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118162.log 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293703.log.gz 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274154.log 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.695413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695413.log.gz 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332878.log 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.118162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118162.log.gz 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285416.log 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274154.log.gz 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694384.log 2024-04-01T00:15:27.382 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.332878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332878.log.gz 2024-04-01T00:15:27.383 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691548.log 2024-04-01T00:15:27.383 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285416.log.gz 2024-04-01T00:15:27.383 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.694384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45557.log 2024-04-01T00:15:27.383 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694384.log.gz 2024-04-01T00:15:27.383 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.691548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726996.log 2024-04-01T00:15:27.383 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691548.log.gz 2024-04-01T00:15:27.383 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.45557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292640.log 2024-04-01T00:15:27.383 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.726996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141208.log 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726996.log.gz 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.292640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715069.log 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292640.log.gz 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.141208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674198.log 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141208.log.gz 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.715069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611836.log 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715069.log.gz 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.674198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299290.log 2024-04-01T00:15:27.384 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674198.log.gz 2024-04-01T00:15:27.385 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.611836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277836.log 2024-04-01T00:15:27.385 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611836.log.gz 2024-04-01T00:15:27.385 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.299290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289817.log 2024-04-01T00:15:27.385 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299290.log.gz 2024-04-01T00:15:27.385 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.277836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239408.log 2024-04-01T00:15:27.385 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277836.log.gz 2024-04-01T00:15:27.385 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.289817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317037.log 2024-04-01T00:15:27.385 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289817.log.gz 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393745.log 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.239408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239408.log.gz 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.317037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689214.log 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317037.log.gz 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557128.log 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.393745.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45557.log.gz 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393745.log.gz 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336841.log 2024-04-01T00:15:27.386 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.689214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689214.log.gz 2024-04-01T00:15:27.387 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.557128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150580.log 2024-04-01T00:15:27.387 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557128.log.gz 2024-04-01T00:15:27.387 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288121.log 2024-04-01T00:15:27.387 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.336841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336841.log.gz 2024-04-01T00:15:27.387 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290722.log 2024-04-01T00:15:27.387 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.150580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727448.log 2024-04-01T00:15:27.387 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150580.log.gz 2024-04-01T00:15:27.387 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288121.log: /var/log/ceph/ceph-client.admin.290722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290722.log.gz 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288121.log.gz 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343068.log 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562299.log 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.727448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727448.log.gz 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594026.log 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.343068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343068.log.gz 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235479.log 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.562299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562299.log.gz 2024-04-01T00:15:27.388 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564224.log 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.594026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594026.log.gz 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411711.log 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.235479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235479.log.gz 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.564224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116360.log 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564224.log.gz 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.411711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284079.log 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411711.log.gz 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.116360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564142.log 2024-04-01T00:15:27.389 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116360.log.gz 2024-04-01T00:15:27.390 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.284079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284079.log.gz 2024-04-01T00:15:27.390 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273670.log 2024-04-01T00:15:27.390 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.564142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256183.log 2024-04-01T00:15:27.390 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564142.log.gz 2024-04-01T00:15:27.390 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.273670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273670.log.gz 2024-04-01T00:15:27.390 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841674.log 2024-04-01T00:15:27.390 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.256183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552333.log 2024-04-01T00:15:27.390 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256183.log.gz 2024-04-01T00:15:27.391 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.841674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841674.log.gz 2024-04-01T00:15:27.391 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260298.log 2024-04-01T00:15:27.391 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.552333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191453.log 2024-04-01T00:15:27.391 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552333.log.gz 2024-04-01T00:15:27.391 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.260298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260298.log.gz 2024-04-01T00:15:27.391 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301045.log 2024-04-01T00:15:27.391 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.191453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312872.log 2024-04-01T00:15:27.391 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191453.log.gz 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.301045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335925.log 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301045.log.gz 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.312872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340232.log 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312872.log.gz 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.335925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300613.log 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335925.log.gz 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410988.log 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.340232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340232.log.gz 2024-04-01T00:15:27.392 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.300613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349610.log 2024-04-01T00:15:27.393 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300613.log.gz 2024-04-01T00:15:27.393 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.410988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147569.log 2024-04-01T00:15:27.393 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410988.log.gz 2024-04-01T00:15:27.393 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.349610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347061.log 2024-04-01T00:15:27.393 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349610.log.gz 2024-04-01T00:15:27.393 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195986.log 2024-04-01T00:15:27.393 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147569.log.gz 2024-04-01T00:15:27.393 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.347061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842965.log 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347061.log.gz 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.195986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241225.log 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195986.log.gz 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.842965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842965.log.gz 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272112.log 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.241225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331000.log 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241225.log.gz 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.272112.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.272112.log.gz 2024-04-01T00:15:27.394 INFO:teuthology.orchestra.run.smithi120.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.126898.log 2024-04-01T00:15:27.395 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.331000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609267.log 2024-04-01T00:15:27.395 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331000.log.gz 2024-04-01T00:15:27.395 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.126898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705697.log 2024-04-01T00:15:27.395 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126898.log.gz 2024-04-01T00:15:27.395 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.609267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554207.log 2024-04-01T00:15:27.395 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609267.log.gz 2024-04-01T00:15:27.395 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.705697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695331.log 2024-04-01T00:15:27.395 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705697.log.gz 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.554207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46864.log 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554207.log.gz 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.695331.log: /var/log/ceph/ceph-client.admin.690259.log 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695331.log.gz 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.46864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111728.log 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.690259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718417.log 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690259.log.gz 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.111728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37856.log 2024-04-01T00:15:27.396 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111728.log.gz 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.718417.log: /var/log/ceph/ceph-client.admin.117704.log 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718417.log.gz 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.37856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594451.log 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.117704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233091.log 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117704.log.gz 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.594451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704049.log 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594451.log.gz 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.233091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348661.log 2024-04-01T00:15:27.397 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233091.log.gz 2024-04-01T00:15:27.398 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.704049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563330.log 2024-04-01T00:15:27.398 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704049.log.gz 2024-04-01T00:15:27.398 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.348661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616482.log 2024-04-01T00:15:27.398 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348661.log.gz 2024-04-01T00:15:27.398 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.563330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127236.log 2024-04-01T00:15:27.398 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563330.log.gz 2024-04-01T00:15:27.398 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.616482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220233.log 87.8% 2024-04-01T00:15:27.398 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46864.log.gz 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616482.log.gz 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.127236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168729.log 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127236.log.gz 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.220233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385051.log 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220233.log.gz 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.168729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.834833.log 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168729.log.gz 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.385051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555082.log 2024-04-01T00:15:27.399 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385051.log.gz 2024-04-01T00:15:27.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.834833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357529.log 2024-04-01T00:15:27.400 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.834833.log.gz 2024-04-01T00:15:27.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.555082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281016.log 2024-04-01T00:15:27.400 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555082.log.gz 2024-04-01T00:15:27.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.357529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407029.log 2024-04-01T00:15:27.400 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357529.log.gz 2024-04-01T00:15:27.400 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.281016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.836191.log 2024-04-01T00:15:27.400 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281016.log.gz 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.407029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43435.log 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407029.log.gz 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.836191.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.275488.log 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.836191.log.gz 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114043.log 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256170.log 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.275488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275488.log.gz 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.114043.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.346991.log 2024-04-01T00:15:27.401 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114043.log.gz 2024-04-01T00:15:27.402 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.256170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141732.log 2024-04-01T00:15:27.402 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256170.log.gz 2024-04-01T00:15:27.402 INFO:teuthology.orchestra.run.smithi120.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43435.log.gz 2024-04-01T00:15:27.402 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111211.log 2024-04-01T00:15:27.402 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.346991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346991.log.gz 2024-04-01T00:15:27.402 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.141732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721867.log 2024-04-01T00:15:27.402 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141732.log.gz 2024-04-01T00:15:27.402 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.111211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.837479.log 2024-04-01T00:15:27.403 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111211.log.gz 2024-04-01T00:15:27.403 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.721867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2024-04-01T00:15:27.403 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721867.log.gz 2024-04-01T00:15:27.403 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713111.log 2024-04-01T00:15:27.403 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.837479.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.837479.log.gz -5 2024-04-01T00:15:27.403 INFO:teuthology.orchestra.run.smithi120.stderr: --verbose -- /var/log/ceph/ceph-client.admin.289355.log 2024-04-01T00:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143897.log 2024-04-01T00:15:27.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.713111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713111.log.gz 2024-04-01T00:15:27.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.289355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316804.log 2024-04-01T00:15:27.443 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289355.log.gz 2024-04-01T00:15:27.443 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199801.log 2024-04-01T00:15:27.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.143897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215691.log 2024-04-01T00:15:27.443 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143897.log.gz 2024-04-01T00:15:27.443 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.316804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316804.log.gz 2024-04-01T00:15:27.443 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226471.log 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.199801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199801.log.gz 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324654.log 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.215691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215691.log.gz 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550493.log 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226471.log.gz 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.324654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286456.log 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324654.log.gz 2024-04-01T00:15:27.444 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566317.log 2024-04-01T00:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.550493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.550493.log.gz 2024-04-01T00:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.286456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49711.log 2024-04-01T00:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286456.log.gz 2024-04-01T00:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.566317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566317.log.gz 2024-04-01T00:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549588.log 2024-04-01T00:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267234.log 2024-04-01T00:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.549588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843034.log 2024-04-01T00:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.549588.log.gz 2024-04-01T00:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.267234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241787.log 2024-04-01T00:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267234.log.gz 2024-04-01T00:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.843034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316146.log 2024-04-01T00:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843034.log.gz 2024-04-01T00:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.241787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674601.log 2024-04-01T00:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241787.log.gz 2024-04-01T00:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.316146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316146.log.gz 2024-04-01T00:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305641.log 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.674601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116278.log 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674601.log.gz 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.305641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305641.log.gz 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244630.log 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.116278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711195.log 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116278.log.gz 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49711.log.gz 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.244630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262086.log 2024-04-01T00:15:27.447 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244630.log.gz 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.711195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280162.log 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711195.log.gz 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.262086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302306.log 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262086.log.gz 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.280162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288134.log 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280162.log.gz 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337664.log 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302306.log.gz 2024-04-01T00:15:27.448 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47791.log 2024-04-01T00:15:27.449 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288134.log.gz 2024-04-01T00:15:27.449 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.337664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536188.log 2024-04-01T00:15:27.449 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337664.log.gz 2024-04-01T00:15:27.449 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.47791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510767.log 2024-04-01T00:15:27.449 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.536188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551299.log 2024-04-01T00:15:27.449 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.536188.log.gz 2024-04-01T00:15:27.449 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.510767.log: -- /var/log/ceph/ceph-client.admin.539443.log 2024-04-01T00:15:27.449 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.510767.log.gz 2024-04-01T00:15:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.551299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307954.log 2024-04-01T00:15:27.450 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551299.log.gz 2024-04-01T00:15:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.539443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553750.log 2024-04-01T00:15:27.450 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.539443.log.gz 2024-04-01T00:15:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.307954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257475.log 2024-04-01T00:15:27.450 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307954.log.gz 2024-04-01T00:15:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249084.log 2024-04-01T00:15:27.450 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.553750.log: /var/log/ceph/ceph-client.admin.257475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553750.log.gz 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257475.log.gz 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329953.log 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47791.log.gz 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.249084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587477.log 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249084.log.gz 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.329953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146720.log 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329953.log.gz 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.587477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321892.log 2024-04-01T00:15:27.451 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587477.log.gz 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.146720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287131.log 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146720.log.gz 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.321892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.835217.log 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321892.log.gz 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.287131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362040.log 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287131.log.gz 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.835217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669559.log 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.835217.log.gz 2024-04-01T00:15:27.452 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.362040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48919.log 2024-04-01T00:15:27.453 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362040.log.gz 2024-04-01T00:15:27.453 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307693.log 2024-04-01T00:15:27.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.669559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669559.log.gz 2024-04-01T00:15:27.453 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238176.log 2024-04-01T00:15:27.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48919.log: /var/log/ceph/ceph-client.admin.307693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304950.log 2024-04-01T00:15:27.453 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307693.log.gz 2024-04-01T00:15:27.453 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600395.log 2024-04-01T00:15:27.453 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.238176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238176.log.gz 2024-04-01T00:15:27.454 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-04-01T00:15:27.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.304950.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48919.log.gz 2024-04-01T00:15:27.454 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304950.log.gz 2024-04-01T00:15:27.454 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535474.log 2024-04-01T00:15:27.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.600395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199870.log 2024-04-01T00:15:27.454 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600395.log.gz 2024-04-01T00:15:27.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.44428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695876.log 2024-04-01T00:15:27.454 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.535474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.535474.log.gz 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690719.log 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.199870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199870.log.gz 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.695876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174411.log 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695876.log.gz 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192410.log 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.690719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574824.log 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690719.log.gz 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.174411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174411.log.gz 2024-04-01T00:15:27.455 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287916.log 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.192410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192410.log.gz 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.574824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384209.log 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574824.log.gz 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618111.log 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.287916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287916.log.gz 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.384209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587272.log 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384209.log.gz 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.618111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200792.log 2024-04-01T00:15:27.456 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618111.log.gz 2024-04-01T00:15:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.587272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267521.log 2024-04-01T00:15:27.457 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587272.log.gz 2024-04-01T00:15:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719278.log 2024-04-01T00:15:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.200792.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz 2024-04-01T00:15:27.457 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200792.log.gz 2024-04-01T00:15:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.267521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688756.log 2024-04-01T00:15:27.457 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267521.log.gz 2024-04-01T00:15:27.457 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710237.log 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.719278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719278.log.gz 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.688756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147367.log 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688756.log.gz 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.710237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598725.log 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710237.log.gz 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.147367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147367.log.gz 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276206.log 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.598725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609254.log 2024-04-01T00:15:27.458 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598725.log.gz 2024-04-01T00:15:27.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.276206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276206.log.gz 2024-04-01T00:15:27.459 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266401.log 2024-04-01T00:15:27.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.609254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267782.log 2024-04-01T00:15:27.459 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609254.log.gz 2024-04-01T00:15:27.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.266401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266401.log.gz 2024-04-01T00:15:27.459 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50400.log 2024-04-01T00:15:27.459 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269845.log 2024-04-01T00:15:27.459 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.267782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267782.log.gz 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph-client.admin.50400.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.198420.log 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260709.log 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.269845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670065.log 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269845.log.gz 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.260709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260709.log.gz 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.198420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198420.log.gz 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568619.log 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.670065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218849.log 2024-04-01T00:15:27.460 INFO:teuthology.orchestra.run.smithi120.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50400.log.gz 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670065.log.gz 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605897.log 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.568619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568619.log.gz 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196434.log 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.218849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218849.log.gz 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352265.log 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.605897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605897.log.gz 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.196434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610815.log 2024-04-01T00:15:27.461 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196434.log.gz 2024-04-01T00:15:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167804.log 2024-04-01T00:15:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.352265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213778.log 2024-04-01T00:15:27.462 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352265.log.gz 2024-04-01T00:15:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.610815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610815.log.gz 2024-04-01T00:15:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223276.log 2024-04-01T00:15:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.167804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167804.log.gz 2024-04-01T00:15:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274843.log 2024-04-01T00:15:27.462 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.213778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213778.log.gz 2024-04-01T00:15:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50274.log 2024-04-01T00:15:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.223276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223276.log.gz 2024-04-01T00:15:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687667.log 2024-04-01T00:15:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.274843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274843.log.gz 2024-04-01T00:15:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603289.log 2024-04-01T00:15:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233552.log 2024-04-01T00:15:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.687667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687667.log.gz 2024-04-01T00:15:27.463 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173364.log 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.603289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603289.log.gz 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.233552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50358.log 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233552.log.gz 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383670.log 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.173364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675593.log 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173364.log.gz 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.50358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725130.log 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.383670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383670.log.gz 2024-04-01T00:15:27.464 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271236.log 2024-04-01T00:15:27.465 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675593.log.gz 2024-04-01T00:15:27.465 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.725130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230762.log 2024-04-01T00:15:27.465 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725130.log.gz 2024-04-01T00:15:27.465 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583100.log 2024-04-01T00:15:27.465 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.271236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226950.log 2024-04-01T00:15:27.465 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271236.log.gz 2024-04-01T00:15:27.465 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.230762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230762.log.gz 2024-04-01T00:15:27.465 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381979.log 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.583100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583100.log.gz 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.836657.log 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226950.log.gz 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605266.log 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.381979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381979.log.gz 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277406.log 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.836657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.836657.log.gz 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309893.log 2024-04-01T00:15:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.605266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605266.log.gz 2024-04-01T00:15:27.467 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292366.log 2024-04-01T00:15:27.467 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.277406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277406.log.gz 2024-04-01T00:15:27.467 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614067.log 2024-04-01T00:15:27.467 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309893.log.gz 2024-04-01T00:15:27.467 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299277.log 2024-04-01T00:15:27.467 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.292366.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50358.log.gz 2024-04-01T00:15:27.467 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292366.log.gz 2024-04-01T00:15:27.467 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.614067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560396.log 2024-04-01T00:15:27.468 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614067.log.gz 2024-04-01T00:15:27.468 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.299277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313367.log 2024-04-01T00:15:27.468 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299277.log.gz 2024-04-01T00:15:27.468 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.560396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219379.log 2024-04-01T00:15:27.468 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.560396.log.gz 2024-04-01T00:15:27.468 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550029.log 2024-04-01T00:15:27.468 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.313367.log: /var/log/ceph/ceph-client.admin.219379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219379.log.gz 2024-04-01T00:15:27.468 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313367.log.gz 2024-04-01T00:15:27.469 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2024-04-01T00:15:27.469 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.550029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353668.log 2024-04-01T00:15:27.469 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.550029.log.gz 2024-04-01T00:15:27.469 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601420.log 2024-04-01T00:15:27.469 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.353668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552809.log 2024-04-01T00:15:27.469 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353668.log.gz 2024-04-01T00:15:27.469 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.601420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290940.log 2024-04-01T00:15:27.469 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601420.log.gz 2024-04-01T00:15:27.492 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327322.log 2024-04-01T00:15:27.492 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.552809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552809.log.gz 2024-04-01T00:15:27.493 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.290940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290256.log 2024-04-01T00:15:27.493 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290940.log.gz 2024-04-01T00:15:27.493 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702802.log 2024-04-01T00:15:27.493 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.327322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327322.log.gz 2024-04-01T00:15:27.493 INFO:teuthology.orchestra.run.smithi120.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2024-04-01T00:15:27.493 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242297.log 2024-04-01T00:15:27.493 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.290256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290256.log.gz 2024-04-01T00:15:27.493 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.702802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702802.log.gz 2024-04-01T00:15:27.494 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411445.log 2024-04-01T00:15:27.494 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242215.log 2024-04-01T00:15:27.494 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242297.log.gz 2024-04-01T00:15:27.494 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699744.log 2024-04-01T00:15:27.494 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.411445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411445.log.gz 2024-04-01T00:15:27.494 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.242215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300626.log 2024-04-01T00:15:27.494 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242215.log.gz 2024-04-01T00:15:27.494 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675328.log 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.699744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699744.log.gz 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49976.log 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.300626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300626.log.gz 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675328.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675328.log.gz 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.49976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148031.log 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243424.log 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.148031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268192.log 2024-04-01T00:15:27.495 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148031.log.gz 2024-04-01T00:15:27.496 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.243424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569690.log 2024-04-01T00:15:27.496 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243424.log.gz 2024-04-01T00:15:27.496 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.268192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198894.log 2024-04-01T00:15:27.496 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268192.log.gz 2024-04-01T00:15:27.496 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.569690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725769.log 2024-04-01T00:15:27.496 INFO:teuthology.orchestra.run.smithi120.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49976.log.gz 2024-04-01T00:15:27.496 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569690.log.gz 2024-04-01T00:15:27.496 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.198894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550479.log 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198894.log.gz 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.725769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846391.log 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725769.log.gz 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.550479.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.550479.log.gz -- 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr: /var/log/ceph/ceph-client.admin.199552.log 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.846391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.833490.log 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846391.log.gz 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.199552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603799.log 2024-04-01T00:15:27.497 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199552.log.gz 2024-04-01T00:15:27.498 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.833490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693576.log 2024-04-01T00:15:27.498 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.833490.log.gz 2024-04-01T00:15:27.498 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.603799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225680.log 2024-04-01T00:15:27.498 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603799.log.gz 2024-04-01T00:15:27.498 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.693576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592258.log 2024-04-01T00:15:27.498 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693576.log.gz 2024-04-01T00:15:27.498 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.225680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612377.log 2024-04-01T00:15:27.498 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225680.log.gz 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.592258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406824.log 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592258.log.gz 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.612377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344744.log 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612377.log.gz 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.406824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202885.log 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406824.log.gz 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.344744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841605.log 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344744.log.gz 2024-04-01T00:15:27.499 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.202885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109623.log 2024-04-01T00:15:27.500 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202885.log.gz 2024-04-01T00:15:27.500 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.841605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302819.log 2024-04-01T00:15:27.500 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841605.log.gz 2024-04-01T00:15:27.500 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.109623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210282.log 2024-04-01T00:15:27.500 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109623.log.gz 2024-04-01T00:15:27.500 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.302819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201165.log 2024-04-01T00:15:27.500 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302819.log.gz 2024-04-01T00:15:27.500 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.210282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265430.log 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210282.log.gz 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.201165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584058.log 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201165.log.gz 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.265430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672152.log 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265430.log.gz 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.584058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285485.log 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584058.log.gz 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.672152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672152.log.gz 2024-04-01T00:15:27.501 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.834847.log 2024-04-01T00:15:27.502 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280093.log 2024-04-01T00:15:27.502 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.285485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285485.log.gz 2024-04-01T00:15:27.502 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335938.log 2024-04-01T00:15:27.502 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.834847.log: /var/log/ceph/ceph-client.admin.280093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280093.log.gz 2024-04-01T00:15:27.502 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.834847.log.gz 2024-04-01T00:15:27.502 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154426.log 2024-04-01T00:15:27.502 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600040.log 2024-04-01T00:15:27.502 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.335938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335938.log.gz 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330022.log 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.154426.log: /var/log/ceph/ceph-client.admin.600040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600040.log.gz 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154426.log.gz 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311735.log 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247479.log 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.330022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330022.log.gz 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.311735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149215.log 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311735.log.gz 2024-04-01T00:15:27.503 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.247479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300086.log 2024-04-01T00:15:27.504 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247479.log.gz 2024-04-01T00:15:27.504 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.149215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382321.log 2024-04-01T00:15:27.504 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149215.log.gz 2024-04-01T00:15:27.504 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.300086.log: /var/log/ceph/ceph-client.admin.151462.log 2024-04-01T00:15:27.504 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300086.log.gz 2024-04-01T00:15:27.504 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.382321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48421.log 2024-04-01T00:15:27.504 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382321.log.gz 2024-04-01T00:15:27.504 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.151462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412387.log 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151462.log.gz 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.48421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612635.log 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.412387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558623.log 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412387.log.gz 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48421.log.gz 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.612635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116782.log 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612635.log.gz 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.558623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117178.log 2024-04-01T00:15:27.505 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558623.log.gz 2024-04-01T00:15:27.506 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.116782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192845.log 2024-04-01T00:15:27.506 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116782.log.gz 2024-04-01T00:15:27.506 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.117178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43919.log 2024-04-01T00:15:27.506 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117178.log.gz 2024-04-01T00:15:27.506 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.192845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604987.log 2024-04-01T00:15:27.506 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192845.log.gz 2024-04-01T00:15:27.506 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.43919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586353.log 2024-04-01T00:15:27.506 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.604987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117247.log 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604987.log.gz 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.586353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203960.log 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586353.log.gz 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.117247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127680.log 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117247.log.gz 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.203960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226484.log 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203960.log.gz 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43919.log.gz 2024-04-01T00:15:27.507 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.127680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288326.log 2024-04-01T00:15:27.508 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127680.log.gz 2024-04-01T00:15:27.508 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.226484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301145.log 2024-04-01T00:15:27.508 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226484.log.gz 2024-04-01T00:15:27.508 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.288326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675524.log 2024-04-01T00:15:27.508 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288326.log.gz 2024-04-01T00:15:27.508 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.301145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159479.log 2024-04-01T00:15:27.508 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301145.log.gz 2024-04-01T00:15:27.517 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234714.log 2024-04-01T00:15:27.517 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675524.log.gz 2024-04-01T00:15:27.517 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.159479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549506.log 2024-04-01T00:15:27.518 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159479.log.gz 2024-04-01T00:15:27.518 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.234714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687585.log 2024-04-01T00:15:27.518 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234714.log.gz 2024-04-01T00:15:27.518 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.549506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595391.log 2024-04-01T00:15:27.518 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.549506.log.gz 2024-04-01T00:15:27.518 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.687585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228600.log 2024-04-01T00:15:27.518 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687585.log.gz 2024-04-01T00:15:27.518 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.595391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304074.log 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595391.log.gz 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.228600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326036.log 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228600.log.gz 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.304074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596889.log 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304074.log.gz 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.326036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708252.log 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326036.log.gz 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.596889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198433.log 2024-04-01T00:15:27.519 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596889.log.gz 2024-04-01T00:15:27.520 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.708252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277393.log 2024-04-01T00:15:27.520 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708252.log.gz 2024-04-01T00:15:27.520 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.198433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692859.log 2024-04-01T00:15:27.520 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198433.log.gz 2024-04-01T00:15:27.520 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.277393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381992.log 2024-04-01T00:15:27.520 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277393.log.gz 2024-04-01T00:15:27.520 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.692859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330518.log 2024-04-01T00:15:27.520 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692859.log.gz 2024-04-01T00:15:27.521 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.381992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338862.log 2024-04-01T00:15:27.521 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381992.log.gz 2024-04-01T00:15:27.521 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.330518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621215.log 2024-04-01T00:15:27.521 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330518.log.gz 2024-04-01T00:15:27.521 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.338862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338862.log.gz 2024-04-01T00:15:27.521 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225201.log 2024-04-01T00:15:27.521 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.621215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309619.log 2024-04-01T00:15:27.521 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621215.log.gz 2024-04-01T00:15:27.522 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.225201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691108.log 2024-04-01T00:15:27.522 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225201.log.gz 2024-04-01T00:15:27.522 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.309619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174619.log 2024-04-01T00:15:27.522 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309619.log.gz 2024-04-01T00:15:27.522 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.691108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327755.log 2024-04-01T00:15:27.522 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691108.log.gz 2024-04-01T00:15:27.522 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.174619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232817.log 2024-04-01T00:15:27.522 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174619.log.gz 2024-04-01T00:15:27.523 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.327755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308159.log 2024-04-01T00:15:27.523 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327755.log.gz 2024-04-01T00:15:27.523 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.232817.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.675606.log 2024-04-01T00:15:27.523 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.232817.log.gz 2024-04-01T00:15:27.523 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.308159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271907.log 2024-04-01T00:15:27.523 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308159.log.gz 2024-04-01T00:15:27.523 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.675606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675606.log.gz 2024-04-01T00:15:27.523 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.271907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271907.log.gz 2024-04-01T00:15:27.676 INFO:teuthology.orchestra.run.smithi203.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-01T00:15:27.971 INFO:teuthology.orchestra.run.smithi203.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-01T00:15:28.628 INFO:teuthology.orchestra.run.smithi120.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50274.log.gz 2024-04-01T00:15:28.630 INFO:teuthology.orchestra.run.smithi120.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37856.log.gz 2024-04-01T00:15:28.637 INFO:teuthology.orchestra.run.smithi120.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37578.log.gz 2024-04-01T00:15:31.482 INFO:teuthology.orchestra.run.smithi120.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-01T00:15:40.853 INFO:teuthology.orchestra.run.smithi203.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-01T00:15:43.107 INFO:teuthology.orchestra.run.smithi120.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-01T00:15:56.702 INFO:teuthology.orchestra.run.smithi203.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-01T00:15:57.026 INFO:teuthology.orchestra.run.smithi203.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-01T00:15:59.096 INFO:teuthology.orchestra.run.smithi120.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-01T00:16:04.004 INFO:teuthology.orchestra.run.smithi203.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-01T00:16:10.109 INFO:teuthology.orchestra.run.smithi203.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-01T00:16:49.235 INFO:teuthology.orchestra.run.smithi203.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-01T00:16:49.237 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-01T00:16:49.237 INFO:teuthology.orchestra.run.smithi203.stderr:real 1m23.564s 2024-04-01T00:16:49.237 INFO:teuthology.orchestra.run.smithi203.stderr:user 2m3.934s 2024-04-01T00:16:49.237 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m5.426s 2024-04-01T00:17:04.940 INFO:teuthology.orchestra.run.smithi120.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-01T00:21:37.914 INFO:teuthology.orchestra.run.smithi120.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-01T00:23:18.758 INFO:teuthology.orchestra.run.smithi120.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-01T00:24:13.019 INFO:teuthology.orchestra.run.smithi120.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-01T00:25:08.203 INFO:teuthology.orchestra.run.smithi120.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-01T00:25:08.204 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-04-01T00:25:08.205 INFO:teuthology.orchestra.run.smithi120.stderr:real 9m42.553s 2024-04-01T00:25:08.205 INFO:teuthology.orchestra.run.smithi120.stderr:user 8m37.288s 2024-04-01T00:25:08.205 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m25.632s 2024-04-01T00:25:08.205 INFO:tasks.ceph:Archiving logs... 2024-04-01T00:25:08.206 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/remote/smithi120/log 2024-04-01T00:25:08.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T00:38:28.507 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/remote/smithi203/log 2024-04-01T00:38:28.529 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T00:44:43.002 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-01T00:44:43.013 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-01T00:44:43.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T00:44:43.017 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T00:44:43.167 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-01T00:44:43.176 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-01T00:44:43.176 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T00:44:43.180 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T00:44:43.196 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-04-01T00:44:43.207 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-04-01T00:44:43.217 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T00:44:43.217 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-04-01T00:44:43.217 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 39 +170us[ +170us] +/- 69ms 2024-04-01T00:44:43.217 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 -198us[ -204us] +/- 59ms 2024-04-01T00:44:43.217 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +47us[ +47us] +/- 79ms 2024-04-01T00:44:43.218 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T00:44:43.266 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T00:44:43.266 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-04-01T00:44:43.266 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 31 +158us[ +178us] +/- 69ms 2024-04-01T00:44:43.266 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -154us[ -133us] +/- 59ms 2024-04-01T00:44:43.266 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +43us[ +43us] +/- 79ms 2024-04-01T00:44:43.267 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T00:44:43.268 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-01T00:44:43.278 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-01T00:44:43.278 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-01T00:44:43.302 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T00:44:43.634 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T00:44:43.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T00:44:43.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T00:44:43.824 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-01T00:44:43.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T00:44:43.858 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-01T00:44:43.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-01T00:44:43.878 INFO:teuthology.task.internal:Duration was 29797.848886 seconds 2024-04-01T00:44:43.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-01T00:44:43.888 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-01T00:44:43.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T00:44:43.892 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T00:44:43.983 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T00:44:44.025 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T00:44:44.288 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-01T00:44:44.289 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-04-01T00:44:44.289 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T00:44:44.352 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-04-01T00:44:44.352 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T00:44:44.387 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-01T00:44:44.387 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T00:44:44.391 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T00:44:44.460 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-01T00:44:44.461 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T00:44:44.465 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T00:44:44.945 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-01T00:44:44.989 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-01T00:44:44.989 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T00:44:45.056 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T00:44:45.087 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-01T00:44:45.105 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T00:44:45.109 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T00:44:45.172 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-04-01T00:44:45.190 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-04-01T00:44:45.253 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T00:44:45.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T00:44:45.283 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T00:44:45.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T00:44:45.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-01T00:44:45.310 INFO:teuthology.task.internal:Transferring archived files... 2024-04-01T00:44:45.312 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/remote/smithi120 2024-04-01T00:44:45.312 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T00:44:45.400 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726/remote/smithi203 2024-04-01T00:44:45.401 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T00:44:45.446 INFO:teuthology.task.internal:Removing archive directory... 2024-04-01T00:44:45.447 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T00:44:45.451 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T00:44:45.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-01T00:44:45.509 INFO:teuthology.task.internal:Not uploading archives. 2024-04-01T00:44:45.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-01T00:44:45.531 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-01T00:44:45.532 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T00:44:45.535 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T00:44:45.549 INFO:teuthology.orchestra.run.smithi203.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 00:44 /home/ubuntu/cephtest 2024-04-01T00:44:45.567 INFO:teuthology.orchestra.run.smithi120.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 00:44 /home/ubuntu/cephtest 2024-04-01T00:44:45.569 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-01T00:44:45.580 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-01T00:44:45.606 INFO:teuthology.nuke:Checking targets against current locks 2024-04-01T00:44:45.641 DEBUG:teuthology.nuke:shortname: smithi120 2024-04-01T00:44:45.642 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T00:44:45.691 DEBUG:teuthology.nuke:shortname: smithi203 2024-04-01T00:44:45.691 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T00:44:45.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 16:19:10.435615', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhY8US6Ge34UWgaDHj0ZjdR4fCh2E7PyFW209rLTnqcuKDV1IQJV1P84aHVznOmLFCnkOlj8N/0a4djwkNHB1c='} 2024-04-01T00:44:45.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-30_23:12:08-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7631726', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-31 16:19:10.437638', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwiwdjjC9aL5fb+iaVZ4hHAo/12NgvfdqjIyaYoTZLH1KH4Sln9iXwd+6AguPT0P8uM4+hZVue+8pZhE1ILMBQ='} 2024-04-01T00:44:45.790 INFO:teuthology.orchestra.console.smithi120:Power off 2024-04-01T00:44:45.790 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T00:44:45.850 INFO:teuthology.orchestra.console.smithi203:Power off 2024-04-01T00:44:45.850 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T00:44:45.861 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2024-04-01T00:44:45.862 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T00:44:45.901 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2024-04-01T00:44:45.901 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T00:44:45.913 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-01T00:44:45.955 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-01T00:44:49.914 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T00:44:49.956 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T00:44:50.028 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-01T00:44:50.075 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-01T00:44:54.029 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T00:44:54.075 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T00:44:54.140 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-01T00:44:54.186 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-04-01T00:44:54.242 INFO:teuthology.orchestra.console.smithi120:Power off completed 2024-04-01T00:44:54.288 INFO:teuthology.orchestra.console.smithi203:Power off completed 2024-04-01T00:44:54.394 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} duration: 29797.84888625145 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8c448b2f64474086875934a782e41e51 status: fail success: false 2024-04-01T00:44:54.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T00:44:54.492 INFO:teuthology.run:FAIL